2023-05-10T03:58:55.486 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-10T03:58:55.487 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --name vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi/7269329 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} -- /home/teuthworker/archive/vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi/7269329/orig.config.yaml 2023-05-10T03:58:55.533 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2023-05-10T03:58:55.608 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi/7269329 branch: wip-vshankar-testing-20230509.054005 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7269329' kernel: flavor: default kdb: true sha1: f1e69e4d36541db1c678e2015bfdc10d07c10e5b ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-vshankar-testing-20230509.054005 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 2ef5137fbb6e28908d2161218e7b594628c1b6d3 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 2ef5137fbb6e28908d2161218e7b594628c1b6d3 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20230510.034551 sha1: 38d0174b6b3ad6dc690a927ef6824114d9a01704 owner: scheduled_vshankar@teuthology priority: 30 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: 2ef5137fbb6e28908d2161218e7b594628c1b6d3 sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing-20230510.034551 suite_path: /home/teuthworker/src/github.com_vshankar_ceph_38d0174b6b3ad6dc690a927ef6824114d9a01704/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: 38d0174b6b3ad6dc690a927ef6824114d9a01704 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi132.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-10_03:47:39 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-10T03:58:55.609 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_38d0174b6b3ad6dc690a927ef6824114d9a01704/qa; will attempt to use it 2023-05-10T03:58:55.610 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_38d0174b6b3ad6dc690a927ef6824114d9a01704/qa/tasks 2023-05-10T03:58:55.610 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-10T03:58:55.612 INFO:teuthology.task.internal:Checking packages... 2023-05-10T03:58:55.643 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '2ef5137fbb6e28908d2161218e7b594628c1b6d3' 2023-05-10T03:58:55.643 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-10T03:58:55.644 INFO:teuthology.packaging:ref: None 2023-05-10T03:58:55.644 INFO:teuthology.packaging:tag: None 2023-05-10T03:58:55.644 INFO:teuthology.packaging:branch: wip-vshankar-testing-20230509.054005 2023-05-10T03:58:55.645 INFO:teuthology.packaging:sha1: 2ef5137fbb6e28908d2161218e7b594628c1b6d3 2023-05-10T03:58:55.645 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing-20230509.054005 2023-05-10T03:58:55.787 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3851.g2ef5137f 2023-05-10T03:58:55.788 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-10T03:58:55.794 INFO:teuthology.task.internal:no buildpackages task found 2023-05-10T03:58:55.795 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-10T03:58:55.801 INFO:teuthology.task.internal:Saving configuration 2023-05-10T03:58:55.817 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-10T03:58:55.823 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-10T03:58:55.852 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi/7269329', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-10 03:53:51.315250', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-05-10T03:58:55.878 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi154.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi/7269329', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-10 03:53:51.313771', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-05-10T03:58:55.878 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-10T03:58:55.884 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-05-10T03:58:55.885 INFO:teuthology.task.internal:roles: ubuntu@smithi154.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-05-10T03:58:55.885 INFO:teuthology.run_tasks:Running task console_log... 2023-05-10T03:58:55.965 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fcff7342e50>, signals=[15]) 2023-05-10T03:58:55.966 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-10T03:58:55.972 INFO:teuthology.task.internal:Opening connections... 2023-05-10T03:58:55.972 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T03:58:55.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T03:58:56.042 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi154.front.sepia.ceph.com 2023-05-10T03:58:56.043 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T03:58:56.111 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-10T03:58:56.118 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-05-10T03:58:56.137 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-05-10T03:58:56.138 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-05-10T03:58:56.196 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2023-05-10T03:58:56.196 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.6 (Ootpa)" 2023-05-10T03:58:56.196 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2023-05-10T03:58:56.197 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2023-05-10T03:58:56.197 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.6" 2023-05-10T03:58:56.197 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2023-05-10T03:58:56.197 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-10T03:58:56.197 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-05-10T03:58:56.197 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-10T03:58:56.197 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2023-05-10T03:58:56.198 INFO:teuthology.orchestra.run.smithi132.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-10T03:58:56.198 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-10T03:58:56.198 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T03:58:56.198 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-10T03:58:56.198 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-10T03:58:56.198 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-10T03:58:56.198 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-10T03:58:56.199 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-05-10T03:58:56.225 DEBUG:teuthology.orchestra.run.smithi154:> uname -m 2023-05-10T03:58:56.245 INFO:teuthology.orchestra.run.smithi154.stdout:x86_64 2023-05-10T03:58:56.245 DEBUG:teuthology.orchestra.run.smithi154:> cat /etc/os-release 2023-05-10T03:58:56.304 INFO:teuthology.orchestra.run.smithi154.stdout:NAME="Red Hat Enterprise Linux" 2023-05-10T03:58:56.304 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION="8.6 (Ootpa)" 2023-05-10T03:58:56.304 INFO:teuthology.orchestra.run.smithi154.stdout:ID="rhel" 2023-05-10T03:58:56.304 INFO:teuthology.orchestra.run.smithi154.stdout:ID_LIKE="fedora" 2023-05-10T03:58:56.305 INFO:teuthology.orchestra.run.smithi154.stdout:VERSION_ID="8.6" 2023-05-10T03:58:56.305 INFO:teuthology.orchestra.run.smithi154.stdout:PLATFORM_ID="platform:el8" 2023-05-10T03:58:56.305 INFO:teuthology.orchestra.run.smithi154.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-05-10T03:58:56.305 INFO:teuthology.orchestra.run.smithi154.stdout:ANSI_COLOR="0;31" 2023-05-10T03:58:56.305 INFO:teuthology.orchestra.run.smithi154.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-05-10T03:58:56.305 INFO:teuthology.orchestra.run.smithi154.stdout:HOME_URL="https://www.redhat.com/" 2023-05-10T03:58:56.305 INFO:teuthology.orchestra.run.smithi154.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-05-10T03:58:56.305 INFO:teuthology.orchestra.run.smithi154.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-05-10T03:58:56.306 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T03:58:56.306 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-05-10T03:58:56.306 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-05-10T03:58:56.306 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-05-10T03:58:56.306 INFO:teuthology.orchestra.run.smithi154.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-05-10T03:58:56.306 INFO:teuthology.lock.ops:Updating smithi154.front.sepia.ceph.com on lock server 2023-05-10T03:58:56.332 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-10T03:58:56.341 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-10T03:58:56.347 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-10T03:58:56.348 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2023-05-10T03:58:56.350 DEBUG:teuthology.orchestra.run.smithi154:> test '!' -e /home/ubuntu/cephtest 2023-05-10T03:58:56.367 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-10T03:58:56.374 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-10T03:58:56.374 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2023-05-10T03:58:56.409 DEBUG:teuthology.orchestra.run.smithi154:> test -z $(ls -A /var/lib/ceph) 2023-05-10T03:58:56.452 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-10T03:58:56.515 INFO:teuthology.run_tasks:Running task kernel... 2023-05-10T03:58:56.532 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'f1e69e4d36541db1c678e2015bfdc10d07c10e5b'} 2023-05-10T03:58:56.533 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'f1e69e4d36541db1c678e2015bfdc10d07c10e5b'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'f1e69e4d36541db1c678e2015bfdc10d07c10e5b'}}, timeout 300 2023-05-10T03:58:56.534 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-10T03:58:56.535 DEBUG:teuthology.orchestra.run.smithi154:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-10T03:58:56.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T03:58:56.554 DEBUG:teuthology.task.kernel:sha1 for mon.a is f1e69e4d36541db1c678e2015bfdc10d07c10e5b 2023-05-10T03:58:56.555 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "f1e69e4d36541db1c678e2015bfdc10d07c10e5b"... 2023-05-10T03:58:56.555 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-05-10T03:58:56.555 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T03:58:56.556 DEBUG:teuthology.task.kernel:sha1 for mon.b is f1e69e4d36541db1c678e2015bfdc10d07c10e5b 2023-05-10T03:58:56.556 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "f1e69e4d36541db1c678e2015bfdc10d07c10e5b"... 2023-05-10T03:58:56.557 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-05-10T03:58:56.614 INFO:teuthology.orchestra.run.smithi132.stdout:4.18.0-372.9.1.el8.x86_64 2023-05-10T03:58:56.615 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs f1e69e4d36541db1c678e2015bfdc10d07c10e5b 2023-05-10T03:58:56.615 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-10T03:58:56.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f1e69e4d36541db1c678e2015bfdc10d07c10e5b 2023-05-10T03:58:56.619 INFO:teuthology.orchestra.run.smithi154.stdout:4.18.0-372.9.1.el8.x86_64 2023-05-10T03:58:56.619 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs f1e69e4d36541db1c678e2015bfdc10d07c10e5b 2023-05-10T03:58:56.620 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-10T03:58:56.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f1e69e4d36541db1c678e2015bfdc10d07c10e5b 2023-05-10T03:58:56.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum upgrade -y linux-firmware 2023-05-10T03:58:56.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum upgrade -y linux-firmware 2023-05-10T03:58:57.897 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2023-05-10T03:58:57.898 INFO:teuthology.orchestra.run.smithi132.stdout:Unable to read consumer identity 2023-05-10T03:58:58.006 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-05-10T03:58:58.006 INFO:teuthology.orchestra.run.smithi154.stdout:Unable to read consumer identity 2023-05-10T03:59:01.719 INFO:teuthology.orchestra.run.smithi132.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-10T03:59:01.769 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-10T03:59:02.378 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 22 MB/s | 14 MB 00:00 2023-05-10T03:59:02.494 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 20 MB/s | 14 MB 00:00 2023-05-10T03:59:05.578 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 194 kB/s | 24 kB 00:00 2023-05-10T03:59:05.619 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 409 kB/s | 24 kB 00:00 2023-05-10T03:59:06.300 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-05-10T03:59:06.301 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2023-05-10T03:59:06.301 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-05-10T03:59:06.333 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-05-10T03:59:06.334 INFO:teuthology.orchestra.run.smithi154.stdout:Nothing to do. 2023-05-10T03:59:06.334 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-05-10T03:59:06.456 INFO:teuthology.task.kernel:Downloading kernel f1e69e4d36541db1c678e2015bfdc10d07c10e5b on mon.b... 2023-05-10T03:59:06.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f1e69e4d36541db1c678e2015bfdc10d07c10e5b 2023-05-10T03:59:06.509 INFO:teuthology.task.kernel:Downloading kernel f1e69e4d36541db1c678e2015bfdc10d07c10e5b on mon.a... 2023-05-10T03:59:06.509 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=f1e69e4d36541db1c678e2015bfdc10d07c10e5b 2023-05-10T03:59:06.602 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/f1e69e4d36541db1c678e2015bfdc10d07c10e5b/centos/8/flavors/default/x86_64/ 2023-05-10T03:59:06.603 DEBUG:teuthology.orchestra.run.smithi154:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_gf1e69e4d3654-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/f1e69e4d36541db1c678e2015bfdc10d07c10e5b/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-10T03:59:06.607 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi154.front.sepia.ceph.com to complete... 2023-05-10T03:59:06.648 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/f1e69e4d36541db1c678e2015bfdc10d07c10e5b/centos/8/flavors/default/x86_64/ 2023-05-10T03:59:06.648 DEBUG:teuthology.orchestra.run.smithi132:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.3.0_gf1e69e4d3654-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/f1e69e4d36541db1c678e2015bfdc10d07c10e5b/centos/8/flavors/default/x86_64/ --input-file=- 2023-05-10T03:59:06.650 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi132.front.sepia.ceph.com to complete... 2023-05-10T03:59:25.540 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10 03:59:25 URL:https://3.chacra.ceph.com/r/kernel/testing/f1e69e4d36541db1c678e2015bfdc10d07c10e5b/centos/8/flavors/default/x86_64/kernel-6.3.0_gf1e69e4d3654-1.x86_64.rpm [378546496/378546496] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-10T03:59:25.541 INFO:teuthology.orchestra.run.smithi154.stderr:FINISHED --2023-05-10 03:59:25-- 2023-05-10T03:59:25.541 INFO:teuthology.orchestra.run.smithi154.stderr:Total wall clock time: 19s 2023-05-10T03:59:25.541 INFO:teuthology.orchestra.run.smithi154.stderr:Downloaded: 1 files, 361M in 19s (19.3 MB/s) 2023-05-10T03:59:25.542 INFO:teuthology.task.kernel:Installing kernel f1e69e4d36541db1c678e2015bfdc10d07c10e5b on mon.b... 2023-05-10T03:59:25.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-10T03:59:27.134 INFO:teuthology.orchestra.run.smithi154.stdout:Verifying... ######################################## 2023-05-10T03:59:27.212 INFO:teuthology.orchestra.run.smithi154.stdout:Preparing... ######################################## 2023-05-10T03:59:27.297 INFO:teuthology.orchestra.run.smithi154.stdout:Updating / installing... 2023-05-10T03:59:31.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10 03:59:31 URL:https://3.chacra.ceph.com/r/kernel/testing/f1e69e4d36541db1c678e2015bfdc10d07c10e5b/centos/8/flavors/default/x86_64/kernel-6.3.0_gf1e69e4d3654-1.x86_64.rpm [378546496/378546496] -> "/tmp/kernel.x86_64.rpm" [1] 2023-05-10T03:59:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:FINISHED --2023-05-10 03:59:31-- 2023-05-10T03:59:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:Total wall clock time: 25s 2023-05-10T03:59:31.743 INFO:teuthology.orchestra.run.smithi132.stderr:Downloaded: 1 files, 361M in 25s (14.5 MB/s) 2023-05-10T03:59:31.772 INFO:teuthology.task.kernel:Installing kernel f1e69e4d36541db1c678e2015bfdc10d07c10e5b on mon.a... 2023-05-10T03:59:31.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-05-10T03:59:33.672 INFO:teuthology.orchestra.run.smithi132.stdout:Verifying... ######################################## 2023-05-10T03:59:33.976 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing... ######################################## 2023-05-10T03:59:34.071 INFO:teuthology.orchestra.run.smithi132.stdout:Updating / installing... 2023-05-10T04:00:04.942 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-6.3.0_gf1e69e4d3654-1 ######################################## 2023-05-10T04:00:11.672 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-6.3.0_gf1e69e4d3654-1 ######################################## 2023-05-10T04:00:31.376 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi154.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-10T04:00:31.376 DEBUG:teuthology.orchestra.run.smithi154:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-10T04:00:31.405 INFO:teuthology.orchestra.run.smithi154.stdout:/boot/System.map-6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.406 INFO:teuthology.orchestra.run.smithi154.stdout:/boot/config-6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.406 INFO:teuthology.orchestra.run.smithi154.stdout:/boot/vmlinuz-6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.406 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.406 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel 2023-05-10T04:00:31.406 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch 2023-05-10T04:00:31.407 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86 2023-05-10T04:00:31.407 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto 2023-05-10T04:00:31.407 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-10T04:00:31.407 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-10T04:00:31.407 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-10T04:00:31.407 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-10T04:00:31.407 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-10T04:00:31.407 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-10T04:00:31.408 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-10T04:00:31.408 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-10T04:00:31.408 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-10T04:00:31.408 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-10T04:00:31.408 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-10T04:00:31.409 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-10T04:00:31.409 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-10T04:00:31.409 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-10T04:00:31.409 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-10T04:00:31.409 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-10T04:00:31.409 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-10T04:00:31.409 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-10T04:00:31.409 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-10T04:00:31.410 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-10T04:00:31.410 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kernel 2023-05-10T04:00:31.410 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kernel/cpu 2023-05-10T04:00:31.410 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kernel/cpu/mce 2023-05-10T04:00:31.410 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-10T04:00:31.410 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kvm 2023-05-10T04:00:31.410 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-10T04:00:31.411 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-10T04:00:31.411 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kvm/kvm.ko 2023-05-10T04:00:31.411 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto 2023-05-10T04:00:31.411 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/ansi_cprng.ko 2023-05-10T04:00:31.411 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/anubis.ko 2023-05-10T04:00:31.427 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/arc4.ko 2023-05-10T04:00:31.427 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx 2023-05-10T04:00:31.427 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_memcpy.ko 2023-05-10T04:00:31.427 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_pq.ko 2023-05-10T04:00:31.427 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-10T04:00:31.427 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_tx.ko 2023-05-10T04:00:31.428 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_xor.ko 2023-05-10T04:00:31.428 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/raid6test.ko 2023-05-10T04:00:31.428 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/authenc.ko 2023-05-10T04:00:31.428 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/authencesn.ko 2023-05-10T04:00:31.428 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/blake2b_generic.ko 2023-05-10T04:00:31.428 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/blowfish_common.ko 2023-05-10T04:00:31.428 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/blowfish_generic.ko 2023-05-10T04:00:31.429 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/camellia_generic.ko 2023-05-10T04:00:31.429 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cast5_generic.ko 2023-05-10T04:00:31.429 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cast6_generic.ko 2023-05-10T04:00:31.429 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cast_common.ko 2023-05-10T04:00:31.429 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/ccm.ko 2023-05-10T04:00:31.429 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cmac.ko 2023-05-10T04:00:31.429 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/crc32_generic.ko 2023-05-10T04:00:31.429 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/crypto_engine.ko 2023-05-10T04:00:31.430 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/crypto_user.ko 2023-05-10T04:00:31.430 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cts.ko 2023-05-10T04:00:31.430 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/des_generic.ko 2023-05-10T04:00:31.430 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/dh_generic.ko 2023-05-10T04:00:31.430 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/echainiv.ko 2023-05-10T04:00:31.430 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/essiv.ko 2023-05-10T04:00:31.430 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/fcrypt.ko 2023-05-10T04:00:31.430 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/khazad.ko 2023-05-10T04:00:31.431 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/lz4.ko 2023-05-10T04:00:31.431 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/lz4hc.ko 2023-05-10T04:00:31.431 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/md4.ko 2023-05-10T04:00:31.431 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/michael_mic.ko 2023-05-10T04:00:31.431 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/pcbc.ko 2023-05-10T04:00:31.431 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/pcrypt.ko 2023-05-10T04:00:31.431 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/rmd160.ko 2023-05-10T04:00:31.431 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/seed.ko 2023-05-10T04:00:31.432 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/serpent_generic.ko 2023-05-10T04:00:31.432 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/tcrypt.ko 2023-05-10T04:00:31.432 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/tea.ko 2023-05-10T04:00:31.432 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/twofish_common.ko 2023-05-10T04:00:31.432 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/twofish_generic.ko 2023-05-10T04:00:31.432 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/vmac.ko 2023-05-10T04:00:31.432 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/wp512.ko 2023-05-10T04:00:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/xcbc.ko 2023-05-10T04:00:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/xor.ko 2023-05-10T04:00:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/xxhash_generic.ko 2023-05-10T04:00:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers 2023-05-10T04:00:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi 2023-05-10T04:00:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-10T04:00:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/acpi_pad.ko 2023-05-10T04:00:31.433 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/custom_method.ko 2023-05-10T04:00:31.434 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/ec_sys.ko 2023-05-10T04:00:31.434 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/platform_profile.ko 2023-05-10T04:00:31.434 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/sbs.ko 2023-05-10T04:00:31.434 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/sbshc.ko 2023-05-10T04:00:31.434 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/video.ko 2023-05-10T04:00:31.434 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata 2023-05-10T04:00:31.434 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/acard-ahci.ko 2023-05-10T04:00:31.434 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/ahci_platform.ko 2023-05-10T04:00:31.435 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/ata_generic.ko 2023-05-10T04:00:31.435 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/libahci_platform.ko 2023-05-10T04:00:31.435 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_acpi.ko 2023-05-10T04:00:31.435 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_ali.ko 2023-05-10T04:00:31.435 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_amd.ko 2023-05-10T04:00:31.435 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_artop.ko 2023-05-10T04:00:31.435 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_atiixp.ko 2023-05-10T04:00:31.435 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_atp867x.ko 2023-05-10T04:00:31.436 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_cmd640.ko 2023-05-10T04:00:31.436 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_cmd64x.ko 2023-05-10T04:00:31.436 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_cypress.ko 2023-05-10T04:00:31.436 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_efar.ko 2023-05-10T04:00:31.436 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_hpt366.ko 2023-05-10T04:00:31.436 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_hpt37x.ko 2023-05-10T04:00:31.436 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-10T04:00:31.437 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-10T04:00:31.437 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_it8213.ko 2023-05-10T04:00:31.437 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_it821x.ko 2023-05-10T04:00:31.437 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_jmicron.ko 2023-05-10T04:00:31.437 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_marvell.ko 2023-05-10T04:00:31.437 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_mpiix.ko 2023-05-10T04:00:31.437 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_netcell.ko 2023-05-10T04:00:31.437 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_ninja32.ko 2023-05-10T04:00:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_ns87410.ko 2023-05-10T04:00:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_ns87415.ko 2023-05-10T04:00:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_oldpiix.ko 2023-05-10T04:00:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_opti.ko 2023-05-10T04:00:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_optidma.ko 2023-05-10T04:00:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_pcmcia.ko 2023-05-10T04:00:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-10T04:00:31.438 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-10T04:00:31.439 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_piccolo.ko 2023-05-10T04:00:31.439 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_rdc.ko 2023-05-10T04:00:31.439 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_sch.ko 2023-05-10T04:00:31.439 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_serverworks.ko 2023-05-10T04:00:31.439 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_sil680.ko 2023-05-10T04:00:31.439 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_sis.ko 2023-05-10T04:00:31.439 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_sl82c105.ko 2023-05-10T04:00:31.440 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_triflex.ko 2023-05-10T04:00:31.440 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_via.ko 2023-05-10T04:00:31.440 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pdc_adma.ko 2023-05-10T04:00:31.440 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_inic162x.ko 2023-05-10T04:00:31.440 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_mv.ko 2023-05-10T04:00:31.441 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_nv.ko 2023-05-10T04:00:31.441 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_promise.ko 2023-05-10T04:00:31.441 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_qstor.ko 2023-05-10T04:00:31.441 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_sil.ko 2023-05-10T04:00:31.441 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_sil24.ko 2023-05-10T04:00:31.441 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_sis.ko 2023-05-10T04:00:31.441 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_svw.ko 2023-05-10T04:00:31.441 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_sx4.ko 2023-05-10T04:00:31.442 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_uli.ko 2023-05-10T04:00:31.442 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_via.ko 2023-05-10T04:00:31.442 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_vsc.ko 2023-05-10T04:00:31.442 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/auxdisplay 2023-05-10T04:00:31.442 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/auxdisplay/ks0108.ko 2023-05-10T04:00:31.442 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/base 2023-05-10T04:00:31.442 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/base/regmap 2023-05-10T04:00:31.442 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-10T04:00:31.443 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/bcma 2023-05-10T04:00:31.443 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/bcma/bcma.ko 2023-05-10T04:00:31.443 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block 2023-05-10T04:00:31.443 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/aoe 2023-05-10T04:00:31.443 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/aoe/aoe.ko 2023-05-10T04:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/brd.ko 2023-05-10T04:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/drbd 2023-05-10T04:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/drbd/drbd.ko 2023-05-10T04:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/floppy.ko 2023-05-10T04:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/loop.ko 2023-05-10T04:00:31.444 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/mtip32xx 2023-05-10T04:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-10T04:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/nbd.ko 2023-05-10T04:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/null_blk 2023-05-10T04:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/null_blk/null_blk.ko 2023-05-10T04:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/pktcdvd.ko 2023-05-10T04:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/rbd.ko 2023-05-10T04:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/virtio_blk.ko 2023-05-10T04:00:31.445 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/xen-blkback 2023-05-10T04:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-10T04:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/xen-blkfront.ko 2023-05-10T04:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/zram 2023-05-10T04:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/zram/zram.ko 2023-05-10T04:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char 2023-05-10T04:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hangcheck-timer.ko 2023-05-10T04:00:31.446 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random 2023-05-10T04:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-10T04:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-10T04:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-10T04:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/via-rng.ko 2023-05-10T04:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-10T04:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi 2023-05-10T04:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-10T04:00:31.447 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-10T04:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-10T04:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-10T04:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-10T04:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-10T04:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/lp.ko 2023-05-10T04:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/mwave 2023-05-10T04:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/mwave/mwave.ko 2023-05-10T04:00:31.448 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/pcmcia 2023-05-10T04:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-10T04:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-10T04:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ppdev.ko 2023-05-10T04:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tlclk.ko 2023-05-10T04:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm 2023-05-10T04:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm.ko 2023-05-10T04:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-10T04:00:31.449 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-10T04:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-10T04:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-10T04:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-10T04:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/uv_mmtimer.ko 2023-05-10T04:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/virtio_console.ko 2023-05-10T04:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq 2023-05-10T04:00:31.450 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-10T04:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-10T04:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-10T04:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-10T04:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-10T04:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-10T04:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto 2023-05-10T04:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/ccp 2023-05-10T04:00:31.451 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-10T04:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/ccp/ccp.ko 2023-05-10T04:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/padlock-aes.ko 2023-05-10T04:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/padlock-sha.ko 2023-05-10T04:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat 2023-05-10T04:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat/qat_common 2023-05-10T04:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-10T04:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-10T04:00:31.452 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-10T04:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/virtio 2023-05-10T04:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-10T04:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dca 2023-05-10T04:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dca/dca.ko 2023-05-10T04:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/devfreq 2023-05-10T04:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-10T04:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma 2023-05-10T04:00:31.453 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma/dw 2023-05-10T04:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-10T04:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma/ioat 2023-05-10T04:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-10T04:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac 2023-05-10T04:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/amd64_edac.ko 2023-05-10T04:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/e752x_edac.ko 2023-05-10T04:00:31.454 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/edac_mce_amd.ko 2023-05-10T04:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i3000_edac.ko 2023-05-10T04:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i3200_edac.ko 2023-05-10T04:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i5100_edac.ko 2023-05-10T04:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i5400_edac.ko 2023-05-10T04:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i7300_edac.ko 2023-05-10T04:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i7core_edac.ko 2023-05-10T04:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i82975x_edac.ko 2023-05-10T04:00:31.455 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/ie31200_edac.ko 2023-05-10T04:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/sb_edac.ko 2023-05-10T04:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/x38_edac.ko 2023-05-10T04:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/firmware 2023-05-10T04:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/firmware/edd.ko 2023-05-10T04:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-10T04:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/gpio 2023-05-10T04:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/gpio/gpio-ich.ko 2023-05-10T04:00:31.456 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-10T04:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid 2023-05-10T04:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-appleir.ko 2023-05-10T04:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-aureal.ko 2023-05-10T04:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-axff.ko 2023-05-10T04:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-dr.ko 2023-05-10T04:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-elecom.ko 2023-05-10T04:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-elo.ko 2023-05-10T04:00:31.457 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-emsff.ko 2023-05-10T04:00:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-gaff.ko 2023-05-10T04:00:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-gt683r.ko 2023-05-10T04:00:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-gyration.ko 2023-05-10T04:00:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-10T04:00:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-10T04:00:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-holtekff.ko 2023-05-10T04:00:31.458 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-hyperv.ko 2023-05-10T04:00:31.459 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-icade.ko 2023-05-10T04:00:31.459 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-keytouch.ko 2023-05-10T04:00:31.459 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-kye.ko 2023-05-10T04:00:31.459 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-lcpower.ko 2023-05-10T04:00:31.459 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-led.ko 2023-05-10T04:00:31.459 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-lenovo.ko 2023-05-10T04:00:31.459 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-10T04:00:31.459 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-10T04:00:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-multitouch.ko 2023-05-10T04:00:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-ortek.ko 2023-05-10T04:00:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-penmount.ko 2023-05-10T04:00:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-petalynx.ko 2023-05-10T04:00:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-picolcd.ko 2023-05-10T04:00:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-pl.ko 2023-05-10T04:00:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-plantronics.ko 2023-05-10T04:00:31.460 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-primax.ko 2023-05-10T04:00:31.461 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-rmi.ko 2023-05-10T04:00:31.461 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-10T04:00:31.461 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-common.ko 2023-05-10T04:00:31.461 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-10T04:00:31.461 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-10T04:00:31.461 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-10T04:00:31.461 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-10T04:00:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-10T04:00:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-10T04:00:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-10T04:00:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-10T04:00:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-10T04:00:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat.ko 2023-05-10T04:00:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-saitek.ko 2023-05-10T04:00:31.462 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-samsung.ko 2023-05-10T04:00:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-10T04:00:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-sjoy.ko 2023-05-10T04:00:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-sony.ko 2023-05-10T04:00:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-speedlink.ko 2023-05-10T04:00:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-steelseries.ko 2023-05-10T04:00:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-sunplus.ko 2023-05-10T04:00:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-10T04:00:31.463 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-tivo.ko 2023-05-10T04:00:31.464 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-tmff.ko 2023-05-10T04:00:31.464 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-topseed.ko 2023-05-10T04:00:31.464 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-twinhan.ko 2023-05-10T04:00:31.464 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-uclogic.ko 2023-05-10T04:00:31.464 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-waltop.ko 2023-05-10T04:00:31.464 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-wiimote.ko 2023-05-10T04:00:31.464 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-xinmo.ko 2023-05-10T04:00:31.464 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-zpff.ko 2023-05-10T04:00:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-zydacron.ko 2023-05-10T04:00:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/uhid.ko 2023-05-10T04:00:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/wacom.ko 2023-05-10T04:00:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hv 2023-05-10T04:00:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hv/hv_balloon.ko 2023-05-10T04:00:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hv/hv_utils.ko 2023-05-10T04:00:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hv/hv_vmbus.ko 2023-05-10T04:00:31.465 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon 2023-05-10T04:00:31.466 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/abituguru.ko 2023-05-10T04:00:31.466 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/abituguru3.ko 2023-05-10T04:00:31.466 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-10T04:00:31.466 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ad7414.ko 2023-05-10T04:00:31.466 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ad7418.ko 2023-05-10T04:00:31.466 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adc128d818.ko 2023-05-10T04:00:31.466 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm1025.ko 2023-05-10T04:00:31.466 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm1026.ko 2023-05-10T04:00:31.467 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm1029.ko 2023-05-10T04:00:31.467 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm1031.ko 2023-05-10T04:00:31.467 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm9240.ko 2023-05-10T04:00:31.467 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ads7828.ko 2023-05-10T04:00:31.467 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7410.ko 2023-05-10T04:00:31.467 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7411.ko 2023-05-10T04:00:31.467 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7462.ko 2023-05-10T04:00:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7470.ko 2023-05-10T04:00:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7475.ko 2023-05-10T04:00:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7x10.ko 2023-05-10T04:00:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/amc6821.ko 2023-05-10T04:00:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/applesmc.ko 2023-05-10T04:00:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/asb100.ko 2023-05-10T04:00:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/asc7621.ko 2023-05-10T04:00:31.468 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-10T04:00:31.469 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/atxp1.ko 2023-05-10T04:00:31.469 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/coretemp.ko 2023-05-10T04:00:31.469 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-10T04:00:31.469 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/dme1737.ko 2023-05-10T04:00:31.469 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ds1621.ko 2023-05-10T04:00:31.469 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ds620.ko 2023-05-10T04:00:31.469 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/emc1403.ko 2023-05-10T04:00:31.469 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/emc6w201.ko 2023-05-10T04:00:31.470 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/f71805f.ko 2023-05-10T04:00:31.470 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/f71882fg.ko 2023-05-10T04:00:31.470 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/f75375s.ko 2023-05-10T04:00:31.470 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/fam15h_power.ko 2023-05-10T04:00:31.470 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/fschmd.ko 2023-05-10T04:00:31.470 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/g760a.ko 2023-05-10T04:00:31.470 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/g762.ko 2023-05-10T04:00:31.471 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/gl518sm.ko 2023-05-10T04:00:31.471 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/gl520sm.ko 2023-05-10T04:00:31.471 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-10T04:00:31.471 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/i5500_temp.ko 2023-05-10T04:00:31.471 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/i5k_amb.ko 2023-05-10T04:00:31.471 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ibmaem.ko 2023-05-10T04:00:31.471 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ibmpex.ko 2023-05-10T04:00:31.471 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ina209.ko 2023-05-10T04:00:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ina2xx.ko 2023-05-10T04:00:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/it87.ko 2023-05-10T04:00:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/k10temp.ko 2023-05-10T04:00:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/k8temp.ko 2023-05-10T04:00:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lineage-pem.ko 2023-05-10T04:00:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm63.ko 2023-05-10T04:00:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm73.ko 2023-05-10T04:00:31.472 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm75.ko 2023-05-10T04:00:31.473 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm77.ko 2023-05-10T04:00:31.473 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm78.ko 2023-05-10T04:00:31.473 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm80.ko 2023-05-10T04:00:31.473 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm83.ko 2023-05-10T04:00:31.473 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm85.ko 2023-05-10T04:00:31.473 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm87.ko 2023-05-10T04:00:31.473 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm90.ko 2023-05-10T04:00:31.473 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm92.ko 2023-05-10T04:00:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm93.ko 2023-05-10T04:00:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm95234.ko 2023-05-10T04:00:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm95241.ko 2023-05-10T04:00:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm95245.ko 2023-05-10T04:00:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc2945.ko 2023-05-10T04:00:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4151.ko 2023-05-10T04:00:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4215.ko 2023-05-10T04:00:31.474 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4222.ko 2023-05-10T04:00:31.475 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4245.ko 2023-05-10T04:00:31.475 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4260.ko 2023-05-10T04:00:31.475 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4261.ko 2023-05-10T04:00:31.475 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max16065.ko 2023-05-10T04:00:31.475 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max1619.ko 2023-05-10T04:00:31.475 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max1668.ko 2023-05-10T04:00:31.475 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max197.ko 2023-05-10T04:00:31.475 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max6639.ko 2023-05-10T04:00:31.476 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max6650.ko 2023-05-10T04:00:31.476 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max6697.ko 2023-05-10T04:00:31.476 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/mcp3021.ko 2023-05-10T04:00:31.476 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/nct6683.ko 2023-05-10T04:00:31.476 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/nct6775-core.ko 2023-05-10T04:00:31.476 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/nct6775.ko 2023-05-10T04:00:31.476 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/nct7802.ko 2023-05-10T04:00:31.477 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pc87360.ko 2023-05-10T04:00:31.477 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pc87427.ko 2023-05-10T04:00:31.477 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pcf8591.ko 2023-05-10T04:00:31.477 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus 2023-05-10T04:00:31.477 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-10T04:00:31.477 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-10T04:00:31.477 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-10T04:00:31.477 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-10T04:00:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-10T04:00:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-10T04:00:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-10T04:00:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-10T04:00:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-10T04:00:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-10T04:00:31.478 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-10T04:00:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-10T04:00:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/powr1220.ko 2023-05-10T04:00:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sch5627.ko 2023-05-10T04:00:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sch5636.ko 2023-05-10T04:00:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-10T04:00:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sht15.ko 2023-05-10T04:00:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sht21.ko 2023-05-10T04:00:31.479 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/shtc1.ko 2023-05-10T04:00:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sis5595.ko 2023-05-10T04:00:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/smsc47b397.ko 2023-05-10T04:00:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/smsc47m1.ko 2023-05-10T04:00:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/smsc47m192.ko 2023-05-10T04:00:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/thmc50.ko 2023-05-10T04:00:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/tmp102.ko 2023-05-10T04:00:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/tmp103.ko 2023-05-10T04:00:31.480 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/tmp401.ko 2023-05-10T04:00:31.481 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/tmp421.ko 2023-05-10T04:00:31.481 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/via-cputemp.ko 2023-05-10T04:00:31.481 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/via686a.ko 2023-05-10T04:00:31.481 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/vt1211.ko 2023-05-10T04:00:31.481 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/vt8231.ko 2023-05-10T04:00:31.481 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83627ehf.ko 2023-05-10T04:00:31.481 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83627hf.ko 2023-05-10T04:00:31.481 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83781d.ko 2023-05-10T04:00:31.482 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83791d.ko 2023-05-10T04:00:31.482 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83792d.ko 2023-05-10T04:00:31.482 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83793.ko 2023-05-10T04:00:31.482 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83795.ko 2023-05-10T04:00:31.482 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83l785ts.ko 2023-05-10T04:00:31.482 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83l786ng.ko 2023-05-10T04:00:31.482 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c 2023-05-10T04:00:31.483 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/algos 2023-05-10T04:00:31.483 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-10T04:00:31.483 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-10T04:00:31.483 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses 2023-05-10T04:00:31.483 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-10T04:00:31.483 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-10T04:00:31.483 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-10T04:00:31.483 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-10T04:00:31.484 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-10T04:00:31.484 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-10T04:00:31.484 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-10T04:00:31.484 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-10T04:00:31.484 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-10T04:00:31.484 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-10T04:00:31.484 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-10T04:00:31.484 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-10T04:00:31.485 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-10T04:00:31.485 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-10T04:00:31.485 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-10T04:00:31.485 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-10T04:00:31.485 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-10T04:00:31.485 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-10T04:00:31.485 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-10T04:00:31.485 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-10T04:00:31.486 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-10T04:00:31.486 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-10T04:00:31.486 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-10T04:00:31.486 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-dev.ko 2023-05-10T04:00:31.486 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-mux.ko 2023-05-10T04:00:31.486 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-10T04:00:31.486 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-smbus.ko 2023-05-10T04:00:31.486 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-stub.ko 2023-05-10T04:00:31.487 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband 2023-05-10T04:00:31.487 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core 2023-05-10T04:00:31.487 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-10T04:00:31.487 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/ib_core.ko 2023-05-10T04:00:31.487 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-10T04:00:31.487 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-10T04:00:31.487 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-10T04:00:31.488 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-10T04:00:31.488 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-10T04:00:31.488 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw 2023-05-10T04:00:31.488 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/cxgb4 2023-05-10T04:00:31.488 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-10T04:00:31.488 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mlx4 2023-05-10T04:00:31.488 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-10T04:00:31.488 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mlx5 2023-05-10T04:00:31.489 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-10T04:00:31.489 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mthca 2023-05-10T04:00:31.489 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-10T04:00:31.489 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp 2023-05-10T04:00:31.489 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/ipoib 2023-05-10T04:00:31.489 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-10T04:00:31.489 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/iser 2023-05-10T04:00:31.489 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-10T04:00:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/isert 2023-05-10T04:00:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-10T04:00:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/srp 2023-05-10T04:00:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-10T04:00:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/srpt 2023-05-10T04:00:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-10T04:00:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input 2023-05-10T04:00:31.490 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport 2023-05-10T04:00:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-10T04:00:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-10T04:00:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/gameport.ko 2023-05-10T04:00:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/lightning.ko 2023-05-10T04:00:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/ns558.ko 2023-05-10T04:00:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/joydev.ko 2023-05-10T04:00:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/keyboard 2023-05-10T04:00:31.491 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-10T04:00:31.492 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse 2023-05-10T04:00:31.492 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/appletouch.ko 2023-05-10T04:00:31.492 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/bcm5974.ko 2023-05-10T04:00:31.492 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/cyapatp.ko 2023-05-10T04:00:31.492 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-10T04:00:31.492 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/sermouse.ko 2023-05-10T04:00:31.492 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-10T04:00:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-10T04:00:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-10T04:00:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/rmi4 2023-05-10T04:00:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-10T04:00:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio 2023-05-10T04:00:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio/altera_ps2.ko 2023-05-10T04:00:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio/arc_ps2.ko 2023-05-10T04:00:31.493 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-10T04:00:31.494 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio/serio_raw.ko 2023-05-10T04:00:31.494 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/sparse-keymap.ko 2023-05-10T04:00:31.494 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/iommu 2023-05-10T04:00:31.494 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/iommu/amd 2023-05-10T04:00:31.494 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-10T04:00:31.494 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds 2023-05-10T04:00:31.494 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/leds-blinkm.ko 2023-05-10T04:00:31.494 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/leds-lm3530.ko 2023-05-10T04:00:31.495 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/leds-lp3944.ko 2023-05-10T04:00:31.495 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/leds-ss4200.ko 2023-05-10T04:00:31.495 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger 2023-05-10T04:00:31.495 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-10T04:00:31.495 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-10T04:00:31.495 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-10T04:00:31.495 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-10T04:00:31.495 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-10T04:00:31.496 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-10T04:00:31.496 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-10T04:00:31.496 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-10T04:00:31.496 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-10T04:00:31.496 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md 2023-05-10T04:00:31.496 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/bcache 2023-05-10T04:00:31.496 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/bcache/bcache.ko 2023-05-10T04:00:31.497 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-bio-prison.ko 2023-05-10T04:00:31.497 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-cache-smq.ko 2023-05-10T04:00:31.497 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-cache.ko 2023-05-10T04:00:31.497 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-crypt.ko 2023-05-10T04:00:31.497 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-delay.ko 2023-05-10T04:00:31.497 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-flakey.ko 2023-05-10T04:00:31.497 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-log-userspace.ko 2023-05-10T04:00:31.497 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-multipath.ko 2023-05-10T04:00:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-queue-length.ko 2023-05-10T04:00:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-raid.ko 2023-05-10T04:00:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-round-robin.ko 2023-05-10T04:00:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-service-time.ko 2023-05-10T04:00:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-switch.ko 2023-05-10T04:00:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-thin-pool.ko 2023-05-10T04:00:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-verity.ko 2023-05-10T04:00:31.498 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/faulty.ko 2023-05-10T04:00:31.499 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/linear.ko 2023-05-10T04:00:31.499 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/multipath.ko 2023-05-10T04:00:31.499 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/persistent-data 2023-05-10T04:00:31.499 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-10T04:00:31.499 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/raid0.ko 2023-05-10T04:00:31.499 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/raid1.ko 2023-05-10T04:00:31.499 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/raid10.ko 2023-05-10T04:00:31.499 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/raid456.ko 2023-05-10T04:00:31.500 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message 2023-05-10T04:00:31.500 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion 2023-05-10T04:00:31.500 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptbase.ko 2023-05-10T04:00:31.500 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptctl.ko 2023-05-10T04:00:31.500 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptfc.ko 2023-05-10T04:00:31.500 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptlan.ko 2023-05-10T04:00:31.500 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptsas.ko 2023-05-10T04:00:31.500 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptscsih.ko 2023-05-10T04:00:31.501 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptspi.ko 2023-05-10T04:00:31.501 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd 2023-05-10T04:00:31.501 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/lpc_ich.ko 2023-05-10T04:00:31.501 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/lpc_sch.ko 2023-05-10T04:00:31.501 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/mfd-core.ko 2023-05-10T04:00:31.501 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/sm501.ko 2023-05-10T04:00:31.501 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/viperboard.ko 2023-05-10T04:00:31.501 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/vx855.ko 2023-05-10T04:00:31.502 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/wl1273-core.ko 2023-05-10T04:00:31.502 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc 2023-05-10T04:00:31.502 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/altera-stapl 2023-05-10T04:00:31.502 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-10T04:00:31.502 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/apds9802als.ko 2023-05-10T04:00:31.502 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/apds990x.ko 2023-05-10T04:00:31.502 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/bh1770glc.ko 2023-05-10T04:00:31.502 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/cb710 2023-05-10T04:00:31.503 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/cb710/cb710.ko 2023-05-10T04:00:31.503 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom 2023-05-10T04:00:31.503 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom/at24.ko 2023-05-10T04:00:31.503 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-10T04:00:31.503 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-10T04:00:31.503 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom/max6875.ko 2023-05-10T04:00:31.503 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/enclosure.ko 2023-05-10T04:00:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/hpilo.ko 2023-05-10T04:00:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/isl29003.ko 2023-05-10T04:00:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/isl29020.ko 2023-05-10T04:00:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/lis3lv02d 2023-05-10T04:00:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-10T04:00:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-10T04:00:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/mei 2023-05-10T04:00:31.504 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/mei/mei-me.ko 2023-05-10T04:00:31.505 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/mei/mei-txe.ko 2023-05-10T04:00:31.505 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/mei/mei.ko 2023-05-10T04:00:31.505 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-gru 2023-05-10T04:00:31.505 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-10T04:00:31.505 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-xp 2023-05-10T04:00:31.505 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-10T04:00:31.505 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-10T04:00:31.505 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-10T04:00:31.506 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/tifm_7xx1.ko 2023-05-10T04:00:31.506 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/tifm_core.ko 2023-05-10T04:00:31.506 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/tsl2550.ko 2023-05-10T04:00:31.506 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/vmw_balloon.ko 2023-05-10T04:00:31.506 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/vmw_vmci 2023-05-10T04:00:31.506 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-10T04:00:31.506 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net 2023-05-10T04:00:31.506 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/bonding 2023-05-10T04:00:31.507 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/bonding/bonding.ko 2023-05-10T04:00:31.507 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa 2023-05-10T04:00:31.507 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/b53 2023-05-10T04:00:31.507 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-10T04:00:31.507 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-10T04:00:31.507 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-10T04:00:31.507 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/mv88e6xxx 2023-05-10T04:00:31.508 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-10T04:00:31.508 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dummy.ko 2023-05-10T04:00:31.508 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/eql.ko 2023-05-10T04:00:31.508 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet 2023-05-10T04:00:31.508 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com 2023-05-10T04:00:31.508 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-10T04:00:31.508 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-10T04:00:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-10T04:00:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-10T04:00:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390 2023-05-10T04:00:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-10T04:00:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-10T04:00:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-10T04:00:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-10T04:00:31.509 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/adaptec 2023-05-10T04:00:31.510 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-10T04:00:31.510 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/agere 2023-05-10T04:00:31.510 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-10T04:00:31.510 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/alteon 2023-05-10T04:00:31.510 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-10T04:00:31.510 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/altera 2023-05-10T04:00:31.510 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-10T04:00:31.510 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/amd 2023-05-10T04:00:31.511 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-10T04:00:31.511 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-10T04:00:31.511 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-10T04:00:31.511 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros 2023-05-10T04:00:31.511 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/alx 2023-05-10T04:00:31.511 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-10T04:00:31.511 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-10T04:00:31.511 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-10T04:00:31.512 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-10T04:00:31.512 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-10T04:00:31.512 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atlx 2023-05-10T04:00:31.512 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-10T04:00:31.512 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-10T04:00:31.512 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom 2023-05-10T04:00:31.512 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-10T04:00:31.513 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-10T04:00:31.513 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-10T04:00:31.513 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-10T04:00:31.513 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-10T04:00:31.513 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/genet 2023-05-10T04:00:31.513 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-10T04:00:31.513 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-10T04:00:31.513 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/brocade 2023-05-10T04:00:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/brocade/bna 2023-05-10T04:00:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-10T04:00:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio 2023-05-10T04:00:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-10T04:00:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-10T04:00:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-10T04:00:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-10T04:00:31.514 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-10T04:00:31.515 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-10T04:00:31.515 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-10T04:00:31.515 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-10T04:00:31.515 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-10T04:00:31.515 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-10T04:00:31.515 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/cisco 2023-05-10T04:00:31.515 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/cisco/enic 2023-05-10T04:00:31.515 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-10T04:00:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec 2023-05-10T04:00:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip 2023-05-10T04:00:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-10T04:00:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-10T04:00:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-10T04:00:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-10T04:00:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-10T04:00:31.516 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-10T04:00:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dlink 2023-05-10T04:00:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-10T04:00:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-10T04:00:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dnet.ko 2023-05-10T04:00:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/emulex 2023-05-10T04:00:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/emulex/benet 2023-05-10T04:00:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-10T04:00:31.517 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/ethoc.ko 2023-05-10T04:00:31.518 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/fealnx.ko 2023-05-10T04:00:31.518 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel 2023-05-10T04:00:31.518 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-10T04:00:31.518 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e1000 2023-05-10T04:00:31.518 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-10T04:00:31.518 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e1000e 2023-05-10T04:00:31.518 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-10T04:00:31.518 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/fm10k 2023-05-10T04:00:31.519 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-10T04:00:31.519 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/i40e 2023-05-10T04:00:31.519 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-10T04:00:31.519 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/iavf 2023-05-10T04:00:31.519 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-10T04:00:31.519 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/igb 2023-05-10T04:00:31.519 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-10T04:00:31.519 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/igbvf 2023-05-10T04:00:31.520 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-10T04:00:31.520 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgb 2023-05-10T04:00:31.520 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-10T04:00:31.520 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-10T04:00:31.520 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-10T04:00:31.520 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-10T04:00:31.520 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-10T04:00:31.521 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/jme.ko 2023-05-10T04:00:31.521 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/marvell 2023-05-10T04:00:31.521 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-10T04:00:31.521 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-10T04:00:31.521 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-10T04:00:31.521 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox 2023-05-10T04:00:31.521 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-10T04:00:31.521 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-10T04:00:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-10T04:00:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-10T04:00:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-10T04:00:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-10T04:00:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/micrel 2023-05-10T04:00:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-10T04:00:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/myricom 2023-05-10T04:00:31.522 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-10T04:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-10T04:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/natsemi 2023-05-10T04:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-10T04:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-10T04:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/neterion 2023-05-10T04:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-10T04:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/nvidia 2023-05-10T04:00:31.523 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-10T04:00:31.524 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/packetengines 2023-05-10T04:00:31.524 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-10T04:00:31.524 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-10T04:00:31.524 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic 2023-05-10T04:00:31.524 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-10T04:00:31.524 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-10T04:00:31.524 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-10T04:00:31.525 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-10T04:00:31.525 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-10T04:00:31.525 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/rdc 2023-05-10T04:00:31.525 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-10T04:00:31.525 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek 2023-05-10T04:00:31.525 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-10T04:00:31.525 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-10T04:00:31.525 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-10T04:00:31.526 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-10T04:00:31.526 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/rocker 2023-05-10T04:00:31.526 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-10T04:00:31.526 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sfc 2023-05-10T04:00:31.526 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-10T04:00:31.526 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/silan 2023-05-10T04:00:31.526 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-10T04:00:31.526 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sis 2023-05-10T04:00:31.527 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-10T04:00:31.527 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-10T04:00:31.527 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc 2023-05-10T04:00:31.527 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-10T04:00:31.527 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-10T04:00:31.527 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-10T04:00:31.527 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-10T04:00:31.527 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/stmicro 2023-05-10T04:00:31.528 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-10T04:00:31.528 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-10T04:00:31.528 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-10T04:00:31.528 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun 2023-05-10T04:00:31.528 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-10T04:00:31.528 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-10T04:00:31.528 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-10T04:00:31.528 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-10T04:00:31.529 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/tehuti 2023-05-10T04:00:31.529 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-10T04:00:31.529 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/ti 2023-05-10T04:00:31.529 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-10T04:00:31.529 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/via 2023-05-10T04:00:31.529 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-10T04:00:31.529 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-10T04:00:31.529 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/wiznet 2023-05-10T04:00:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-10T04:00:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-10T04:00:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/xircom 2023-05-10T04:00:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-10T04:00:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/geneve.ko 2023-05-10T04:00:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/hyperv 2023-05-10T04:00:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-10T04:00:31.530 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ieee802154 2023-05-10T04:00:31.531 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-10T04:00:31.531 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ifb.ko 2023-05-10T04:00:31.531 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ipvlan 2023-05-10T04:00:31.531 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-10T04:00:31.531 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/macvlan.ko 2023-05-10T04:00:31.531 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/macvtap.ko 2023-05-10T04:00:31.531 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mdio 2023-05-10T04:00:31.531 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mdio.ko 2023-05-10T04:00:31.532 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-10T04:00:31.532 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-10T04:00:31.532 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mii.ko 2023-05-10T04:00:31.532 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/net_failover.ko 2023-05-10T04:00:31.532 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/netconsole.ko 2023-05-10T04:00:31.532 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/nlmon.ko 2023-05-10T04:00:31.532 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/pcs 2023-05-10T04:00:31.533 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-10T04:00:31.533 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-10T04:00:31.533 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy 2023-05-10T04:00:31.533 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/amd.ko 2023-05-10T04:00:31.533 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-10T04:00:31.533 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-10T04:00:31.533 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-10T04:00:31.533 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/bcm87xx.ko 2023-05-10T04:00:31.534 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/broadcom.ko 2023-05-10T04:00:31.534 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/cicada.ko 2023-05-10T04:00:31.534 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/davicom.ko 2023-05-10T04:00:31.534 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/dp83640.ko 2023-05-10T04:00:31.534 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/et1011c.ko 2023-05-10T04:00:31.534 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/icplus.ko 2023-05-10T04:00:31.534 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/lxt.ko 2023-05-10T04:00:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/marvell.ko 2023-05-10T04:00:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/micrel.ko 2023-05-10T04:00:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/national.ko 2023-05-10T04:00:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/phylink.ko 2023-05-10T04:00:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/qsemi.ko 2023-05-10T04:00:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/realtek.ko 2023-05-10T04:00:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/smsc.ko 2023-05-10T04:00:31.535 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/ste10Xp.ko 2023-05-10T04:00:31.536 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/vitesse.ko 2023-05-10T04:00:31.536 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp 2023-05-10T04:00:31.536 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-10T04:00:31.536 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_async.ko 2023-05-10T04:00:31.536 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-10T04:00:31.536 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-10T04:00:31.536 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-10T04:00:31.536 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-10T04:00:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/pppoe.ko 2023-05-10T04:00:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/pppox.ko 2023-05-10T04:00:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/pptp.ko 2023-05-10T04:00:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/slip 2023-05-10T04:00:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/slip/slhc.ko 2023-05-10T04:00:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/slip/slip.ko 2023-05-10T04:00:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/sungem_phy.ko 2023-05-10T04:00:31.537 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/tap.ko 2023-05-10T04:00:31.538 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team 2023-05-10T04:00:31.538 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team.ko 2023-05-10T04:00:31.538 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-10T04:00:31.538 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-10T04:00:31.538 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-10T04:00:31.538 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_random.ko 2023-05-10T04:00:31.538 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-10T04:00:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/tun.ko 2023-05-10T04:00:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/veth.ko 2023-05-10T04:00:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/virtio_net.ko 2023-05-10T04:00:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/vmxnet3 2023-05-10T04:00:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-10T04:00:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/vxlan 2023-05-10T04:00:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/vxlan/vxlan.ko 2023-05-10T04:00:31.539 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/xen-netback 2023-05-10T04:00:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-10T04:00:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/xen-netfront.ko 2023-05-10T04:00:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ntb 2023-05-10T04:00:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ntb/ntb.ko 2023-05-10T04:00:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/nvme 2023-05-10T04:00:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/nvme/host 2023-05-10T04:00:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/nvme/host/nvme-core.ko 2023-05-10T04:00:31.540 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/nvme/host/nvme.ko 2023-05-10T04:00:31.541 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport 2023-05-10T04:00:31.541 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport/parport.ko 2023-05-10T04:00:31.541 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport/parport_cs.ko 2023-05-10T04:00:31.541 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport/parport_pc.ko 2023-05-10T04:00:31.541 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport/parport_serial.ko 2023-05-10T04:00:31.541 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci 2023-05-10T04:00:31.541 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/hotplug 2023-05-10T04:00:31.541 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-10T04:00:31.542 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/pcie 2023-05-10T04:00:31.542 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-10T04:00:31.542 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/xen-pcifront.ko 2023-05-10T04:00:31.542 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pcmcia 2023-05-10T04:00:31.542 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pcmcia/i82092.ko 2023-05-10T04:00:31.542 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pcmcia/pd6729.ko 2023-05-10T04:00:31.542 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-10T04:00:31.542 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pinctrl 2023-05-10T04:00:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pinctrl/intel 2023-05-10T04:00:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-10T04:00:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform 2023-05-10T04:00:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86 2023-05-10T04:00:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-10T04:00:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/acerhdf.ko 2023-05-10T04:00:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-10T04:00:31.543 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-10T04:00:31.544 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-10T04:00:31.544 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-10T04:00:31.544 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-10T04:00:31.544 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-10T04:00:31.544 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-10T04:00:31.544 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-10T04:00:31.544 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-10T04:00:31.545 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/hdaps.ko 2023-05-10T04:00:31.545 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/intel 2023-05-10T04:00:31.545 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-10T04:00:31.545 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/intel_ips.ko 2023-05-10T04:00:31.545 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-10T04:00:31.545 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-10T04:00:31.545 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-10T04:00:31.545 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-10T04:00:31.546 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-10T04:00:31.546 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-10T04:00:31.546 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-10T04:00:31.546 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-10T04:00:31.546 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-10T04:00:31.546 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/wmi.ko 2023-05-10T04:00:31.546 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/powercap 2023-05-10T04:00:31.546 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-10T04:00:31.547 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-10T04:00:31.547 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps 2023-05-10T04:00:31.547 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/clients 2023-05-10T04:00:31.547 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-10T04:00:31.547 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-10T04:00:31.547 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/clients/pps_parport.ko 2023-05-10T04:00:31.547 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/pps_core.ko 2023-05-10T04:00:31.547 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ptp 2023-05-10T04:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ptp/ptp.ko 2023-05-10T04:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ptp/ptp_kvm.ko 2023-05-10T04:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc 2023-05-10T04:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-10T04:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-10T04:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-10T04:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-10T04:00:31.548 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-10T04:00:31.549 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-10T04:00:31.549 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-10T04:00:31.549 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-10T04:00:31.549 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-10T04:00:31.549 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-10T04:00:31.549 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-10T04:00:31.549 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-em3027.ko 2023-05-10T04:00:31.549 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-10T04:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-10T04:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-10T04:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-10T04:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-10T04:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-10T04:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-max6900.ko 2023-05-10T04:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-10T04:00:31.550 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-10T04:00:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-10T04:00:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-10T04:00:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-10T04:00:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-10T04:00:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-10T04:00:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-10T04:00:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-10T04:00:31.551 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-10T04:00:31.552 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-10T04:00:31.552 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-10T04:00:31.552 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-x1205.ko 2023-05-10T04:00:31.552 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi 2023-05-10T04:00:31.552 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/3w-9xxx.ko 2023-05-10T04:00:31.552 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/3w-sas.ko 2023-05-10T04:00:31.552 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/3w-xxxx.ko 2023-05-10T04:00:31.552 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/BusLogic.ko 2023-05-10T04:00:31.553 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/a100u2w.ko 2023-05-10T04:00:31.553 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aacraid 2023-05-10T04:00:31.553 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-10T04:00:31.553 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/advansys.ko 2023-05-10T04:00:31.553 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aic7xxx 2023-05-10T04:00:31.553 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-10T04:00:31.553 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-10T04:00:31.553 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/am53c974.ko 2023-05-10T04:00:31.554 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/arcmsr 2023-05-10T04:00:31.554 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-10T04:00:31.554 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/atp870u.ko 2023-05-10T04:00:31.554 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/be2iscsi 2023-05-10T04:00:31.554 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-10T04:00:31.554 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bfa 2023-05-10T04:00:31.554 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bfa/bfa.ko 2023-05-10T04:00:31.554 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bnx2fc 2023-05-10T04:00:31.555 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-10T04:00:31.555 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bnx2i 2023-05-10T04:00:31.555 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-10T04:00:31.555 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/ch.ko 2023-05-10T04:00:31.555 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/csiostor 2023-05-10T04:00:31.555 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-10T04:00:31.555 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi 2023-05-10T04:00:31.555 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-10T04:00:31.556 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-10T04:00:31.556 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-10T04:00:31.556 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-10T04:00:31.556 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-10T04:00:31.556 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/dc395x.ko 2023-05-10T04:00:31.556 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler 2023-05-10T04:00:31.556 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-10T04:00:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-10T04:00:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-10T04:00:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-10T04:00:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/dmx3191d.ko 2023-05-10T04:00:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/esas2r 2023-05-10T04:00:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-10T04:00:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/esp_scsi.ko 2023-05-10T04:00:31.557 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fcoe 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fnic 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fnic/fnic.ko 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/hpsa.ko 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/hptiop.ko 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/hv_storvsc.ko 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/initio.ko 2023-05-10T04:00:31.558 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/ipr.ko 2023-05-10T04:00:31.559 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/ips.ko 2023-05-10T04:00:31.559 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/isci 2023-05-10T04:00:31.559 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/isci/isci.ko 2023-05-10T04:00:31.559 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-10T04:00:31.559 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-10T04:00:31.559 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libfc 2023-05-10T04:00:31.559 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libfc/libfc.ko 2023-05-10T04:00:31.559 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libiscsi.ko 2023-05-10T04:00:31.560 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-10T04:00:31.560 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libsas 2023-05-10T04:00:31.560 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libsas/libsas.ko 2023-05-10T04:00:31.560 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/lpfc 2023-05-10T04:00:31.560 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-10T04:00:31.560 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid 2023-05-10T04:00:31.560 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid.ko 2023-05-10T04:00:31.561 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-10T04:00:31.561 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-10T04:00:31.561 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-10T04:00:31.561 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mpt3sas 2023-05-10T04:00:31.561 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-10T04:00:31.561 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mvsas 2023-05-10T04:00:31.561 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-10T04:00:31.561 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mvumi.ko 2023-05-10T04:00:31.562 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/pm8001 2023-05-10T04:00:31.562 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-10T04:00:31.562 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/pmcraid.ko 2023-05-10T04:00:31.562 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla1280.ko 2023-05-10T04:00:31.562 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla2xxx 2023-05-10T04:00:31.562 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-10T04:00:31.562 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-10T04:00:31.562 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla4xxx 2023-05-10T04:00:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-10T04:00:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/raid_class.ko 2023-05-10T04:00:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_debug.ko 2023-05-10T04:00:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-10T04:00:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-10T04:00:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-10T04:00:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-10T04:00:31.563 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-10T04:00:31.564 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/ses.ko 2023-05-10T04:00:31.564 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/st.ko 2023-05-10T04:00:31.564 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/stex.ko 2023-05-10T04:00:31.564 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/sym53c8xx_2 2023-05-10T04:00:31.564 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-10T04:00:31.564 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/virtio_scsi.ko 2023-05-10T04:00:31.564 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-10T04:00:31.564 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/wd719x.ko 2023-05-10T04:00:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ssb 2023-05-10T04:00:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ssb/ssb.ko 2023-05-10T04:00:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target 2023-05-10T04:00:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/iscsi 2023-05-10T04:00:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-10T04:00:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/loopback 2023-05-10T04:00:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-10T04:00:31.565 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_file.ko 2023-05-10T04:00:31.566 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_iblock.ko 2023-05-10T04:00:31.566 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_mod.ko 2023-05-10T04:00:31.566 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_pscsi.ko 2023-05-10T04:00:31.566 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_user.ko 2023-05-10T04:00:31.566 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/tcm_fc 2023-05-10T04:00:31.566 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-10T04:00:31.566 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal 2023-05-10T04:00:31.566 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel 2023-05-10T04:00:31.567 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal 2023-05-10T04:00:31.567 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-10T04:00:31.567 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-10T04:00:31.567 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-10T04:00:31.567 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-10T04:00:31.567 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-10T04:00:31.567 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-10T04:00:31.567 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-10T04:00:31.568 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-10T04:00:31.568 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-10T04:00:31.568 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-10T04:00:31.568 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-10T04:00:31.568 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-10T04:00:31.568 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-10T04:00:31.568 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-10T04:00:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-10T04:00:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty 2023-05-10T04:00:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/ipwireless 2023-05-10T04:00:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-10T04:00:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/n_gsm.ko 2023-05-10T04:00:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/n_hdlc.ko 2023-05-10T04:00:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/nozomi.ko 2023-05-10T04:00:31.569 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial 2023-05-10T04:00:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/8250 2023-05-10T04:00:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-10T04:00:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/arc_uart.ko 2023-05-10T04:00:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/jsm 2023-05-10T04:00:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-10T04:00:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/synclink_gt.ko 2023-05-10T04:00:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs 2023-05-10T04:00:31.570 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs/core 2023-05-10T04:00:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-10T04:00:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs/host 2023-05-10T04:00:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-10T04:00:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio 2023-05-10T04:00:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio.ko 2023-05-10T04:00:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio_aec.ko 2023-05-10T04:00:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio_cif.ko 2023-05-10T04:00:31.571 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio_pci_generic.ko 2023-05-10T04:00:31.572 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio_sercos3.ko 2023-05-10T04:00:31.572 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb 2023-05-10T04:00:31.572 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class 2023-05-10T04:00:31.572 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class/cdc-acm.ko 2023-05-10T04:00:31.572 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-10T04:00:31.572 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class/usblp.ko 2023-05-10T04:00:31.572 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class/usbtmc.ko 2023-05-10T04:00:31.573 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/host 2023-05-10T04:00:31.573 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-10T04:00:31.573 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/host/u132-hcd.ko 2023-05-10T04:00:31.573 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/image 2023-05-10T04:00:31.573 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/image/mdc800.ko 2023-05-10T04:00:31.573 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/image/microtek.ko 2023-05-10T04:00:31.573 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc 2023-05-10T04:00:31.573 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/adutux.ko 2023-05-10T04:00:31.574 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/appledisplay.ko 2023-05-10T04:00:31.574 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/emi26.ko 2023-05-10T04:00:31.574 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/emi62.ko 2023-05-10T04:00:31.574 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/ezusb.ko 2023-05-10T04:00:31.574 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-10T04:00:31.574 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/idmouse.ko 2023-05-10T04:00:31.574 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/iowarrior.ko 2023-05-10T04:00:31.574 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-10T04:00:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/ldusb.ko 2023-05-10T04:00:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/legousbtower.ko 2023-05-10T04:00:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/sisusbvga 2023-05-10T04:00:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-10T04:00:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-10T04:00:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/usb3503.ko 2023-05-10T04:00:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/usblcd.ko 2023-05-10T04:00:31.575 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-10T04:00:31.576 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/uss720.ko 2023-05-10T04:00:31.576 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/yurex.ko 2023-05-10T04:00:31.576 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/phy 2023-05-10T04:00:31.576 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/phy/phy-generic.ko 2023-05-10T04:00:31.576 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial 2023-05-10T04:00:31.576 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/aircable.ko 2023-05-10T04:00:31.576 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ark3116.ko 2023-05-10T04:00:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-10T04:00:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ch341.ko 2023-05-10T04:00:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/cp210x.ko 2023-05-10T04:00:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/cyberjack.ko 2023-05-10T04:00:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-10T04:00:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-10T04:00:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/empeg.ko 2023-05-10T04:00:31.577 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-10T04:00:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-10T04:00:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-10T04:00:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/io_ti.ko 2023-05-10T04:00:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ipaq.ko 2023-05-10T04:00:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ipw.ko 2023-05-10T04:00:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ir-usb.ko 2023-05-10T04:00:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-10T04:00:31.578 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/keyspan.ko 2023-05-10T04:00:31.579 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-10T04:00:31.579 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-10T04:00:31.579 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-10T04:00:31.579 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/mct_u232.ko 2023-05-10T04:00:31.579 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/mos7720.ko 2023-05-10T04:00:31.579 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/mos7840.ko 2023-05-10T04:00:31.579 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/navman.ko 2023-05-10T04:00:31.579 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/omninet.ko 2023-05-10T04:00:31.580 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/opticon.ko 2023-05-10T04:00:31.580 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/option.ko 2023-05-10T04:00:31.580 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/oti6858.ko 2023-05-10T04:00:31.580 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/pl2303.ko 2023-05-10T04:00:31.580 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/qcaux.ko 2023-05-10T04:00:31.580 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/qcserial.ko 2023-05-10T04:00:31.580 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/quatech2.ko 2023-05-10T04:00:31.580 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/safe_serial.ko 2023-05-10T04:00:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/sierra.ko 2023-05-10T04:00:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-10T04:00:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ssu100.ko 2023-05-10T04:00:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/symbolserial.ko 2023-05-10T04:00:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-10T04:00:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-10T04:00:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/usb_debug.ko 2023-05-10T04:00:31.581 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-10T04:00:31.582 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/visor.ko 2023-05-10T04:00:31.582 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/whiteheat.ko 2023-05-10T04:00:31.582 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-10T04:00:31.582 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage 2023-05-10T04:00:31.582 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/uas.ko 2023-05-10T04:00:31.582 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-10T04:00:31.582 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-10T04:00:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-10T04:00:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-10T04:00:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-10T04:00:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-10T04:00:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-10T04:00:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-karma.ko 2023-05-10T04:00:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-10T04:00:31.583 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-10T04:00:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-10T04:00:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-10T04:00:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-10T04:00:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/usb-storage.ko 2023-05-10T04:00:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/usbip 2023-05-10T04:00:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-10T04:00:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-10T04:00:31.584 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-10T04:00:31.585 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio 2023-05-10T04:00:31.585 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/pci 2023-05-10T04:00:31.585 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-10T04:00:31.585 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-10T04:00:31.585 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/vfio.ko 2023-05-10T04:00:31.585 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-10T04:00:31.585 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost 2023-05-10T04:00:31.585 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost/vhost.ko 2023-05-10T04:00:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-10T04:00:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost/vhost_net.ko 2023-05-10T04:00:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost/vhost_scsi.ko 2023-05-10T04:00:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video 2023-05-10T04:00:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video/backlight 2023-05-10T04:00:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video/backlight/apple_bl.ko 2023-05-10T04:00:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video/backlight/lcd.ko 2023-05-10T04:00:31.586 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-10T04:00:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio 2023-05-10T04:00:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio.ko 2023-05-10T04:00:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_balloon.ko 2023-05-10T04:00:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_mmio.ko 2023-05-10T04:00:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_pci.ko 2023-05-10T04:00:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-10T04:00:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-10T04:00:31.587 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_ring.ko 2023-05-10T04:00:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1 2023-05-10T04:00:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/masters 2023-05-10T04:00:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/masters/ds2482.ko 2023-05-10T04:00:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/masters/ds2490.ko 2023-05-10T04:00:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves 2023-05-10T04:00:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-10T04:00:31.588 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-10T04:00:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-10T04:00:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-10T04:00:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-10T04:00:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-10T04:00:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-10T04:00:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-10T04:00:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-10T04:00:31.589 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-10T04:00:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-10T04:00:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/wire.ko 2023-05-10T04:00:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog 2023-05-10T04:00:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-10T04:00:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-10T04:00:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-10T04:00:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/hpwdt.ko 2023-05-10T04:00:31.590 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/i6300esb.ko 2023-05-10T04:00:31.591 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-10T04:00:31.591 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-10T04:00:31.591 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/ib700wdt.ko 2023-05-10T04:00:31.591 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/ibmasr.ko 2023-05-10T04:00:31.591 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-10T04:00:31.591 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-10T04:00:31.591 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/it87_wdt.ko 2023-05-10T04:00:31.591 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/machzwd.ko 2023-05-10T04:00:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/nv_tco.ko 2023-05-10T04:00:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-10T04:00:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-10T04:00:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-10T04:00:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-10T04:00:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/softdog.ko 2023-05-10T04:00:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-10T04:00:31.592 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/via_wdt.ko 2023-05-10T04:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-10T04:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-10T04:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-10T04:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/wdt_pci.ko 2023-05-10T04:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/xen_wdt.ko 2023-05-10T04:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen 2023-05-10T04:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-10T04:00:31.593 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-evtchn.ko 2023-05-10T04:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-gntalloc.ko 2023-05-10T04:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-gntdev.ko 2023-05-10T04:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-pciback 2023-05-10T04:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-10T04:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-privcmd.ko 2023-05-10T04:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xenfs 2023-05-10T04:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-10T04:00:31.594 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs 2023-05-10T04:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/9p 2023-05-10T04:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/9p/9p.ko 2023-05-10T04:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/affs 2023-05-10T04:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/affs/affs.ko 2023-05-10T04:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/befs 2023-05-10T04:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/befs/befs.ko 2023-05-10T04:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/binfmt_misc.ko 2023-05-10T04:00:31.595 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/btrfs 2023-05-10T04:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/btrfs/btrfs.ko 2023-05-10T04:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cachefiles 2023-05-10T04:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cachefiles/cachefiles.ko 2023-05-10T04:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ceph 2023-05-10T04:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ceph/ceph.ko 2023-05-10T04:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cifs 2023-05-10T04:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cifs/cifs.ko 2023-05-10T04:00:31.596 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/coda 2023-05-10T04:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/coda/coda.ko 2023-05-10T04:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cramfs 2023-05-10T04:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cramfs/cramfs.ko 2023-05-10T04:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/dlm 2023-05-10T04:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/dlm/dlm.ko 2023-05-10T04:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ecryptfs 2023-05-10T04:00:31.597 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/f2fs 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/f2fs/f2fs.ko 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fat 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fat/fat.ko 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fat/msdos.ko 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fat/vfat.ko 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fscache 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fscache/fscache.ko 2023-05-10T04:00:31.598 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fuse 2023-05-10T04:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fuse/cuse.ko 2023-05-10T04:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fuse/fuse.ko 2023-05-10T04:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/gfs2 2023-05-10T04:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/gfs2/gfs2.ko 2023-05-10T04:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/hfs 2023-05-10T04:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/hfs/hfs.ko 2023-05-10T04:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/hfsplus 2023-05-10T04:00:31.599 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/hfsplus/hfsplus.ko 2023-05-10T04:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/isofs 2023-05-10T04:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/isofs/isofs.ko 2023-05-10T04:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/jfs 2023-05-10T04:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/jfs/jfs.ko 2023-05-10T04:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/lockd 2023-05-10T04:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/lockd/lockd.ko 2023-05-10T04:00:31.600 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/minix 2023-05-10T04:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/minix/minix.ko 2023-05-10T04:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/netfs 2023-05-10T04:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/netfs/netfs.ko 2023-05-10T04:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs 2023-05-10T04:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/blocklayout 2023-05-10T04:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-10T04:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/filelayout 2023-05-10T04:00:31.601 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-10T04:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/flexfilelayout 2023-05-10T04:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-10T04:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/nfs.ko 2023-05-10T04:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/nfsv3.ko 2023-05-10T04:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/nfsv4.ko 2023-05-10T04:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs_common 2023-05-10T04:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs_common/grace.ko 2023-05-10T04:00:31.602 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs_common/nfs_acl.ko 2023-05-10T04:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfsd 2023-05-10T04:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfsd/nfsd.ko 2023-05-10T04:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nilfs2 2023-05-10T04:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nilfs2/nilfs2.ko 2023-05-10T04:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls 2023-05-10T04:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-celtic.ko 2023-05-10T04:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-centeuro.ko 2023-05-10T04:00:31.603 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-croatian.ko 2023-05-10T04:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-cyrillic.ko 2023-05-10T04:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-gaelic.ko 2023-05-10T04:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-greek.ko 2023-05-10T04:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-iceland.ko 2023-05-10T04:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-inuit.ko 2023-05-10T04:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-roman.ko 2023-05-10T04:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-romanian.ko 2023-05-10T04:00:31.604 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-turkish.ko 2023-05-10T04:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp1250.ko 2023-05-10T04:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp1251.ko 2023-05-10T04:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp1255.ko 2023-05-10T04:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp737.ko 2023-05-10T04:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp775.ko 2023-05-10T04:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp850.ko 2023-05-10T04:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp852.ko 2023-05-10T04:00:31.605 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp855.ko 2023-05-10T04:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp857.ko 2023-05-10T04:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp860.ko 2023-05-10T04:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp861.ko 2023-05-10T04:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp862.ko 2023-05-10T04:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp863.ko 2023-05-10T04:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp864.ko 2023-05-10T04:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp865.ko 2023-05-10T04:00:31.606 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp866.ko 2023-05-10T04:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp869.ko 2023-05-10T04:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp874.ko 2023-05-10T04:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp932.ko 2023-05-10T04:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp936.ko 2023-05-10T04:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp949.ko 2023-05-10T04:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp950.ko 2023-05-10T04:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_euc-jp.ko 2023-05-10T04:00:31.607 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-1.ko 2023-05-10T04:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-13.ko 2023-05-10T04:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-14.ko 2023-05-10T04:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-15.ko 2023-05-10T04:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-2.ko 2023-05-10T04:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-3.ko 2023-05-10T04:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-4.ko 2023-05-10T04:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-5.ko 2023-05-10T04:00:31.608 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-6.ko 2023-05-10T04:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-7.ko 2023-05-10T04:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-9.ko 2023-05-10T04:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_koi8-r.ko 2023-05-10T04:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_koi8-ru.ko 2023-05-10T04:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_koi8-u.ko 2023-05-10T04:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_utf8.ko 2023-05-10T04:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2 2023-05-10T04:00:31.609 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/cluster 2023-05-10T04:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-10T04:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/dlm 2023-05-10T04:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-10T04:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/dlmfs 2023-05-10T04:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-10T04:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/ocfs2.ko 2023-05-10T04:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-10T04:00:31.610 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-10T04:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-10T04:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/overlayfs 2023-05-10T04:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/overlayfs/overlay.ko 2023-05-10T04:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/pstore 2023-05-10T04:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/pstore/ramoops.ko 2023-05-10T04:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/reiserfs 2023-05-10T04:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/reiserfs/reiserfs.ko 2023-05-10T04:00:31.611 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/romfs 2023-05-10T04:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/romfs/romfs.ko 2023-05-10T04:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/smbfs_common 2023-05-10T04:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-10T04:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-10T04:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/squashfs 2023-05-10T04:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/squashfs/squashfs.ko 2023-05-10T04:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/sysv 2023-05-10T04:00:31.612 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/sysv/sysv.ko 2023-05-10T04:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/udf 2023-05-10T04:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/udf/udf.ko 2023-05-10T04:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ufs 2023-05-10T04:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ufs/ufs.ko 2023-05-10T04:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/xfs 2023-05-10T04:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/xfs/xfs.ko 2023-05-10T04:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel 2023-05-10T04:00:31.613 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/rcu 2023-05-10T04:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/rcu/rcutorture.ko 2023-05-10T04:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/torture.ko 2023-05-10T04:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/trace 2023-05-10T04:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-10T04:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib 2023-05-10T04:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/asn1_encoder.ko 2023-05-10T04:00:31.614 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crc-itu-t.ko 2023-05-10T04:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crc8.ko 2023-05-10T04:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crypto 2023-05-10T04:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crypto/libarc4.ko 2023-05-10T04:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crypto/libdes.ko 2023-05-10T04:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/libcrc32c.ko 2023-05-10T04:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/lru_cache.ko 2023-05-10T04:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/lz4 2023-05-10T04:00:31.615 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/lz4/lz4_compress.ko 2023-05-10T04:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/lz4/lz4hc_compress.ko 2023-05-10T04:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/math 2023-05-10T04:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/math/cordic.ko 2023-05-10T04:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/raid6 2023-05-10T04:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/raid6/raid6_pq.ko 2023-05-10T04:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/reed_solomon 2023-05-10T04:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-10T04:00:31.616 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/ts_bm.ko 2023-05-10T04:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/ts_fsm.ko 2023-05-10T04:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/ts_kmp.ko 2023-05-10T04:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/zstd 2023-05-10T04:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/zstd/zstd_compress.ko 2023-05-10T04:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/mm 2023-05-10T04:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/mm/hwpoison-inject.ko 2023-05-10T04:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net 2023-05-10T04:00:31.617 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan 2023-05-10T04:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/6lowpan.ko 2023-05-10T04:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_dest.ko 2023-05-10T04:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_fragment.ko 2023-05-10T04:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_hop.ko 2023-05-10T04:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-10T04:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_mobility.ko 2023-05-10T04:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_routing.ko 2023-05-10T04:00:31.618 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_udp.ko 2023-05-10T04:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802 2023-05-10T04:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/garp.ko 2023-05-10T04:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/mrp.ko 2023-05-10T04:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/p8022.ko 2023-05-10T04:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/psnap.ko 2023-05-10T04:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/stp.ko 2023-05-10T04:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/8021q 2023-05-10T04:00:31.619 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/8021q/8021q.ko 2023-05-10T04:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p 2023-05-10T04:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p/9pnet.ko 2023-05-10T04:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p/9pnet_fd.ko 2023-05-10T04:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p/9pnet_rdma.ko 2023-05-10T04:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p/9pnet_virtio.ko 2023-05-10T04:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/batman-adv 2023-05-10T04:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/batman-adv/batman-adv.ko 2023-05-10T04:00:31.620 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge 2023-05-10T04:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/br_netfilter.ko 2023-05-10T04:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/bridge.ko 2023-05-10T04:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter 2023-05-10T04:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-10T04:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-10T04:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-10T04:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-10T04:00:31.621 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-10T04:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-10T04:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-10T04:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-10T04:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-10T04:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-10T04:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-10T04:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-10T04:00:31.622 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-10T04:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-10T04:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-10T04:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-10T04:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-10T04:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-10T04:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-10T04:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-10T04:00:31.623 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebtables.ko 2023-05-10T04:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-10T04:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-10T04:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-10T04:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ceph 2023-05-10T04:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ceph/libceph.ko 2023-05-10T04:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/core 2023-05-10T04:00:31.624 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/core/failover.ko 2023-05-10T04:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/core/pktgen.ko 2023-05-10T04:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp 2023-05-10T04:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp/dccp.ko 2023-05-10T04:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp/dccp_diag.ko 2023-05-10T04:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp/dccp_ipv4.ko 2023-05-10T04:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp/dccp_ipv6.ko 2023-05-10T04:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dns_resolver 2023-05-10T04:00:31.625 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dns_resolver/dns_resolver.ko 2023-05-10T04:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa 2023-05-10T04:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/dsa_core.ko 2023-05-10T04:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/tag_brcm.ko 2023-05-10T04:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/tag_dsa.ko 2023-05-10T04:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/tag_none.ko 2023-05-10T04:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/tag_trailer.ko 2023-05-10T04:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154 2023-05-10T04:00:31.626 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154/6lowpan 2023-05-10T04:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-10T04:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154/ieee802154.ko 2023-05-10T04:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-10T04:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4 2023-05-10T04:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ah4.ko 2023-05-10T04:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/esp4.ko 2023-05-10T04:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/fou.ko 2023-05-10T04:00:31.627 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/gre.ko 2023-05-10T04:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/inet_diag.ko 2023-05-10T04:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ip_gre.ko 2023-05-10T04:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ip_tunnel.ko 2023-05-10T04:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ip_vti.ko 2023-05-10T04:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ipcomp.ko 2023-05-10T04:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ipip.ko 2023-05-10T04:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter 2023-05-10T04:00:31.628 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-10T04:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-10T04:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-10T04:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-10T04:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-10T04:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-10T04:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-10T04:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-10T04:00:31.629 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-10T04:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-10T04:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-10T04:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-10T04:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-10T04:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-10T04:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-10T04:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-10T04:00:31.630 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-10T04:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-10T04:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-10T04:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-10T04:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-10T04:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_bic.ko 2023-05-10T04:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_dctcp.ko 2023-05-10T04:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_diag.ko 2023-05-10T04:00:31.631 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_highspeed.ko 2023-05-10T04:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_htcp.ko 2023-05-10T04:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_hybla.ko 2023-05-10T04:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_illinois.ko 2023-05-10T04:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_lp.ko 2023-05-10T04:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_scalable.ko 2023-05-10T04:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_vegas.ko 2023-05-10T04:00:31.632 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_veno.ko 2023-05-10T04:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_westwood.ko 2023-05-10T04:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_yeah.ko 2023-05-10T04:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tunnel4.ko 2023-05-10T04:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/udp_diag.ko 2023-05-10T04:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/udp_tunnel.ko 2023-05-10T04:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-10T04:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6 2023-05-10T04:00:31.633 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ah6.ko 2023-05-10T04:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/esp6.ko 2023-05-10T04:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/fou6.ko 2023-05-10T04:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ip6_tunnel.ko 2023-05-10T04:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-10T04:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ip6_vti.ko 2023-05-10T04:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ipcomp6.ko 2023-05-10T04:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter 2023-05-10T04:00:31.634 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-10T04:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-10T04:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-10T04:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-10T04:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-10T04:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-10T04:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-10T04:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-10T04:00:31.635 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-10T04:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-10T04:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-10T04:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-10T04:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-10T04:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-10T04:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-10T04:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-10T04:00:31.636 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-10T04:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-10T04:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-10T04:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-10T04:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-10T04:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-10T04:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-10T04:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-10T04:00:31.637 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/sit.ko 2023-05-10T04:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/tunnel6.ko 2023-05-10T04:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-10T04:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/key 2023-05-10T04:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/key/af_key.ko 2023-05-10T04:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp 2023-05-10T04:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_core.ko 2023-05-10T04:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-10T04:00:31.638 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_eth.ko 2023-05-10T04:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_ip.ko 2023-05-10T04:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_ip6.ko 2023-05-10T04:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_netlink.ko 2023-05-10T04:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_ppp.ko 2023-05-10T04:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/llc 2023-05-10T04:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/llc/llc.ko 2023-05-10T04:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/mac802154 2023-05-10T04:00:31.639 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/mac802154/mac802154.ko 2023-05-10T04:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/mpls 2023-05-10T04:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/mpls/mpls_gso.ko 2023-05-10T04:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter 2023-05-10T04:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset 2023-05-10T04:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set.ko 2023-05-10T04:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-10T04:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-10T04:00:31.640 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-10T04:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-10T04:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-10T04:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-10T04:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-10T04:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-10T04:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-10T04:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-10T04:00:31.641 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-10T04:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-10T04:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-10T04:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-10T04:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-10T04:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs 2023-05-10T04:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-10T04:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-10T04:00:31.642 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-10T04:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-10T04:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-10T04:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-10T04:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-10T04:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-10T04:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-10T04:00:31.643 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-10T04:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-10T04:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-10T04:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-10T04:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-10T04:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conncount.ko 2023-05-10T04:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack.ko 2023-05-10T04:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-10T04:00:31.644 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-10T04:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-10T04:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-10T04:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-10T04:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-10T04:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-10T04:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-10T04:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-10T04:00:31.645 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-10T04:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-10T04:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-10T04:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-10T04:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_flow_table.ko 2023-05-10T04:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-10T04:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_log_syslog.ko 2023-05-10T04:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat.ko 2023-05-10T04:00:31.646 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-10T04:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-10T04:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_irc.ko 2023-05-10T04:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_sip.ko 2023-05-10T04:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-10T04:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-10T04:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_tables.ko 2023-05-10T04:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink.ko 2023-05-10T04:00:31.647 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-10T04:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink_log.ko 2023-05-10T04:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-10T04:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-10T04:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_chain_nat.ko 2023-05-10T04:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_compat.ko 2023-05-10T04:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_ct.ko 2023-05-10T04:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-10T04:00:31.648 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_fib.ko 2023-05-10T04:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-10T04:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_hash.ko 2023-05-10T04:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_limit.ko 2023-05-10T04:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_log.ko 2023-05-10T04:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_masq.ko 2023-05-10T04:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_nat.ko 2023-05-10T04:00:31.649 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_numgen.ko 2023-05-10T04:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_queue.ko 2023-05-10T04:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_quota.ko 2023-05-10T04:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_redir.ko 2023-05-10T04:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_reject.ko 2023-05-10T04:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_reject_inet.ko 2023-05-10T04:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_socket.ko 2023-05-10T04:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_tunnel.ko 2023-05-10T04:00:31.650 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_AUDIT.ko 2023-05-10T04:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-10T04:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-10T04:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-10T04:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_CT.ko 2023-05-10T04:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_DSCP.ko 2023-05-10T04:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_HL.ko 2023-05-10T04:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_HMARK.ko 2023-05-10T04:00:31.651 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-10T04:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_LED.ko 2023-05-10T04:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_LOG.ko 2023-05-10T04:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-10T04:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_NETMAP.ko 2023-05-10T04:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_NFLOG.ko 2023-05-10T04:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-10T04:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_RATEEST.ko 2023-05-10T04:00:31.652 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-10T04:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_SECMARK.ko 2023-05-10T04:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-10T04:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-10T04:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TEE.ko 2023-05-10T04:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TPROXY.ko 2023-05-10T04:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TRACE.ko 2023-05-10T04:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_addrtype.ko 2023-05-10T04:00:31.653 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_bpf.ko 2023-05-10T04:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_cgroup.ko 2023-05-10T04:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_cluster.ko 2023-05-10T04:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_comment.ko 2023-05-10T04:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_connbytes.ko 2023-05-10T04:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_connlabel.ko 2023-05-10T04:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_connlimit.ko 2023-05-10T04:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_connmark.ko 2023-05-10T04:00:31.654 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_conntrack.ko 2023-05-10T04:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_cpu.ko 2023-05-10T04:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_dccp.ko 2023-05-10T04:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_devgroup.ko 2023-05-10T04:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_dscp.ko 2023-05-10T04:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_ecn.ko 2023-05-10T04:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_esp.ko 2023-05-10T04:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_hashlimit.ko 2023-05-10T04:00:31.655 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_helper.ko 2023-05-10T04:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_hl.ko 2023-05-10T04:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_ipcomp.ko 2023-05-10T04:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_iprange.ko 2023-05-10T04:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_ipvs.ko 2023-05-10T04:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_l2tp.ko 2023-05-10T04:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_length.ko 2023-05-10T04:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_limit.ko 2023-05-10T04:00:31.656 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_mac.ko 2023-05-10T04:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_mark.ko 2023-05-10T04:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_multiport.ko 2023-05-10T04:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_nat.ko 2023-05-10T04:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_nfacct.ko 2023-05-10T04:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_osf.ko 2023-05-10T04:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_owner.ko 2023-05-10T04:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_physdev.ko 2023-05-10T04:00:31.657 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_pkttype.ko 2023-05-10T04:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_policy.ko 2023-05-10T04:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_quota.ko 2023-05-10T04:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_rateest.ko 2023-05-10T04:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_realm.ko 2023-05-10T04:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_recent.ko 2023-05-10T04:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_sctp.ko 2023-05-10T04:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_set.ko 2023-05-10T04:00:31.658 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_socket.ko 2023-05-10T04:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_state.ko 2023-05-10T04:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_statistic.ko 2023-05-10T04:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_string.ko 2023-05-10T04:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_tcpmss.ko 2023-05-10T04:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_time.ko 2023-05-10T04:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_u32.ko 2023-05-10T04:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netlink 2023-05-10T04:00:31.659 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netlink/netlink_diag.ko 2023-05-10T04:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/nsh 2023-05-10T04:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/nsh/nsh.ko 2023-05-10T04:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch 2023-05-10T04:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch/openvswitch.ko 2023-05-10T04:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch/vport-geneve.ko 2023-05-10T04:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch/vport-gre.ko 2023-05-10T04:00:31.660 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch/vport-vxlan.ko 2023-05-10T04:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/packet 2023-05-10T04:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/packet/af_packet_diag.ko 2023-05-10T04:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/rds 2023-05-10T04:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/rds/rds.ko 2023-05-10T04:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/rds/rds_rdma.ko 2023-05-10T04:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/rds/rds_tcp.ko 2023-05-10T04:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched 2023-05-10T04:00:31.661 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_csum.ko 2023-05-10T04:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_gact.ko 2023-05-10T04:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_ipt.ko 2023-05-10T04:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_mirred.ko 2023-05-10T04:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_nat.ko 2023-05-10T04:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_pedit.ko 2023-05-10T04:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_police.ko 2023-05-10T04:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_simple.ko 2023-05-10T04:00:31.662 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_skbedit.ko 2023-05-10T04:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_vlan.ko 2023-05-10T04:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_basic.ko 2023-05-10T04:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_bpf.ko 2023-05-10T04:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_flow.ko 2023-05-10T04:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_fw.ko 2023-05-10T04:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_route.ko 2023-05-10T04:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_u32.ko 2023-05-10T04:00:31.663 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_cmp.ko 2023-05-10T04:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_ipset.ko 2023-05-10T04:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_meta.ko 2023-05-10T04:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_nbyte.ko 2023-05-10T04:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_text.ko 2023-05-10T04:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_u32.ko 2023-05-10T04:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_choke.ko 2023-05-10T04:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_codel.ko 2023-05-10T04:00:31.664 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_drr.ko 2023-05-10T04:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_fq.ko 2023-05-10T04:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_gred.ko 2023-05-10T04:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_hfsc.ko 2023-05-10T04:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_hhf.ko 2023-05-10T04:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_htb.ko 2023-05-10T04:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_ingress.ko 2023-05-10T04:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_mqprio.ko 2023-05-10T04:00:31.665 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_mqprio_lib.ko 2023-05-10T04:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_multiq.ko 2023-05-10T04:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_netem.ko 2023-05-10T04:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_pie.ko 2023-05-10T04:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_plug.ko 2023-05-10T04:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_prio.ko 2023-05-10T04:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_qfq.ko 2023-05-10T04:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_red.ko 2023-05-10T04:00:31.666 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_sfb.ko 2023-05-10T04:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_sfq.ko 2023-05-10T04:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_tbf.ko 2023-05-10T04:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_teql.ko 2023-05-10T04:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sctp 2023-05-10T04:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sctp/sctp.ko 2023-05-10T04:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sctp/sctp_diag.ko 2023-05-10T04:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc 2023-05-10T04:00:31.667 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/auth_gss 2023-05-10T04:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-10T04:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-10T04:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/sunrpc.ko 2023-05-10T04:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/xprtrdma 2023-05-10T04:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-10T04:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/tipc 2023-05-10T04:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/tipc/diag.ko 2023-05-10T04:00:31.668 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/tipc/tipc.ko 2023-05-10T04:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/unix 2023-05-10T04:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/unix/unix_diag.ko 2023-05-10T04:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock 2023-05-10T04:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-10T04:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-10T04:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vsock.ko 2023-05-10T04:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-10T04:00:31.669 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-10T04:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/xfrm 2023-05-10T04:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-10T04:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security 2023-05-10T04:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys 2023-05-10T04:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys/encrypted-keys 2023-05-10T04:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-10T04:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys/trusted-keys 2023-05-10T04:00:31.670 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys/trusted-keys/trusted.ko 2023-05-10T04:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/virt 2023-05-10T04:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/virt/lib 2023-05-10T04:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/virt/lib/irqbypass.ko 2023-05-10T04:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.alias 2023-05-10T04:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.alias.bin 2023-05-10T04:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.builtin 2023-05-10T04:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.builtin.bin 2023-05-10T04:00:31.671 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.builtin.modinfo 2023-05-10T04:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.dep 2023-05-10T04:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.dep.bin 2023-05-10T04:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.devname 2023-05-10T04:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.order 2023-05-10T04:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.softdep 2023-05-10T04:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.symbols 2023-05-10T04:00:31.672 INFO:teuthology.orchestra.run.smithi154.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.symbols.bin 2023-05-10T04:00:31.673 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.673 DEBUG:teuthology.orchestra.run.smithi154:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-10T04:00:31.702 INFO:teuthology.orchestra.run.smithi154.stdout:postinstall scriptlet (using /bin/sh): 2023-05-10T04:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-gf1e69e4d3654 -a -r /boot/System.map-6.3.0-gf1e69e4d3654 ]; then 2023-05-10T04:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:cp /boot/vmlinuz-6.3.0-gf1e69e4d3654 /boot/.vmlinuz-6.3.0-gf1e69e4d3654-rpm 2023-05-10T04:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:cp /boot/System.map-6.3.0-gf1e69e4d3654 /boot/.System.map-6.3.0-gf1e69e4d3654-rpm 2023-05-10T04:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:rm -f /boot/vmlinuz-6.3.0-gf1e69e4d3654 /boot/System.map-6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:/sbin/installkernel 6.3.0-gf1e69e4d3654 /boot/.vmlinuz-6.3.0-gf1e69e4d3654-rpm /boot/.System.map-6.3.0-gf1e69e4d3654-rpm 2023-05-10T04:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:rm -f /boot/.vmlinuz-6.3.0-gf1e69e4d3654-rpm /boot/.System.map-6.3.0-gf1e69e4d3654-rpm 2023-05-10T04:00:31.703 INFO:teuthology.orchestra.run.smithi154.stdout:fi 2023-05-10T04:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-10T04:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-10T04:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:new-kernel-pkg --remove 6.3.0-gf1e69e4d3654 --rminitrd --initrdfile=/boot/initramfs-6.3.0-gf1e69e4d3654.img 2023-05-10T04:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-10T04:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:kernel-install remove 6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:fi 2023-05-10T04:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-10T04:00:31.704 INFO:teuthology.orchestra.run.smithi154.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-10T04:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout:/sbin/update-bootloader --remove 6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.705 INFO:teuthology.orchestra.run.smithi154.stdout:fi 2023-05-10T04:00:31.705 DEBUG:teuthology.orchestra.run.smithi154:> sudo rpm -qi grub2-tools 2023-05-10T04:00:31.781 INFO:teuthology.orchestra.run.smithi154.stdout:Name : grub2-tools 2023-05-10T04:00:31.782 INFO:teuthology.orchestra.run.smithi154.stdout:Epoch : 1 2023-05-10T04:00:31.782 INFO:teuthology.orchestra.run.smithi154.stdout:Version : 2.02 2023-05-10T04:00:31.782 INFO:teuthology.orchestra.run.smithi154.stdout:Release : 123.el8 2023-05-10T04:00:31.782 INFO:teuthology.orchestra.run.smithi154.stdout:Architecture: x86_64 2023-05-10T04:00:31.782 INFO:teuthology.orchestra.run.smithi154.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-05-10T04:00:31.782 INFO:teuthology.orchestra.run.smithi154.stdout:Group : System Environment/Base 2023-05-10T04:00:31.782 INFO:teuthology.orchestra.run.smithi154.stdout:Size : 9265450 2023-05-10T04:00:31.783 INFO:teuthology.orchestra.run.smithi154.stdout:License : GPLv3+ 2023-05-10T04:00:31.783 INFO:teuthology.orchestra.run.smithi154.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-05-10T04:00:31.783 INFO:teuthology.orchestra.run.smithi154.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-05-10T04:00:31.783 INFO:teuthology.orchestra.run.smithi154.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-05-10T04:00:31.783 INFO:teuthology.orchestra.run.smithi154.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-05-10T04:00:31.783 INFO:teuthology.orchestra.run.smithi154.stdout:Relocations : (not relocatable) 2023-05-10T04:00:31.784 INFO:teuthology.orchestra.run.smithi154.stdout:Packager : Red Hat, Inc. 2023-05-10T04:00:31.784 INFO:teuthology.orchestra.run.smithi154.stdout:Vendor : Red Hat, Inc. 2023-05-10T04:00:31.784 INFO:teuthology.orchestra.run.smithi154.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-10T04:00:31.784 INFO:teuthology.orchestra.run.smithi154.stdout:Summary : Support tools for GRUB. 2023-05-10T04:00:31.784 INFO:teuthology.orchestra.run.smithi154.stdout:Description : 2023-05-10T04:00:31.784 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:00:31.784 INFO:teuthology.orchestra.run.smithi154.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-10T04:00:31.785 INFO:teuthology.orchestra.run.smithi154.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-10T04:00:31.785 INFO:teuthology.orchestra.run.smithi154.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-10T04:00:31.785 INFO:teuthology.orchestra.run.smithi154.stdout:hardware devices. 2023-05-10T04:00:31.785 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:00:31.785 INFO:teuthology.orchestra.run.smithi154.stdout:This subpackage provides tools for support of all platforms. 2023-05-10T04:00:31.786 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-10T04:00:31.786 INFO:teuthology.task.kernel:Updating grub on smithi154 to boot 6.3.0-gf1e69e4d3654 2023-05-10T04:00:31.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-10T04:00:34.250 INFO:teuthology.orchestra.run.smithi154.stderr:Generating grub configuration file ... 2023-05-10T04:00:34.462 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-05-10T04:00:34.462 DEBUG:teuthology.orchestra.run.smithi132:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-05-10T04:00:34.510 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/System.map-6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.511 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/config-6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.511 INFO:teuthology.orchestra.run.smithi132.stdout:/boot/vmlinuz-6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.511 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.511 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel 2023-05-10T04:00:34.511 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch 2023-05-10T04:00:34.512 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86 2023-05-10T04:00:34.512 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto 2023-05-10T04:00:34.512 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-10T04:00:34.512 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-10T04:00:34.512 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-10T04:00:34.512 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-10T04:00:34.512 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-10T04:00:34.513 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-10T04:00:34.513 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-10T04:00:34.513 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/crc32c-intel.ko 2023-05-10T04:00:34.513 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-10T04:00:34.513 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-10T04:00:34.513 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-10T04:00:34.513 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-10T04:00:34.513 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-10T04:00:34.514 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-10T04:00:34.514 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-10T04:00:34.514 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-10T04:00:34.514 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-10T04:00:34.514 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-10T04:00:34.514 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-10T04:00:34.514 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-10T04:00:34.515 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kernel 2023-05-10T04:00:34.515 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kernel/cpu 2023-05-10T04:00:34.515 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kernel/cpu/mce 2023-05-10T04:00:34.515 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-10T04:00:34.515 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kvm 2023-05-10T04:00:34.515 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-10T04:00:34.516 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-10T04:00:34.516 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/arch/x86/kvm/kvm.ko 2023-05-10T04:00:34.516 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto 2023-05-10T04:00:34.516 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/ansi_cprng.ko 2023-05-10T04:00:34.516 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/anubis.ko 2023-05-10T04:00:34.517 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/arc4.ko 2023-05-10T04:00:34.517 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx 2023-05-10T04:00:34.517 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_memcpy.ko 2023-05-10T04:00:34.517 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_pq.ko 2023-05-10T04:00:34.517 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-10T04:00:34.517 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_tx.ko 2023-05-10T04:00:34.518 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/async_xor.ko 2023-05-10T04:00:34.518 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/async_tx/raid6test.ko 2023-05-10T04:00:34.518 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/authenc.ko 2023-05-10T04:00:34.518 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/authencesn.ko 2023-05-10T04:00:34.518 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/blake2b_generic.ko 2023-05-10T04:00:34.518 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/blowfish_common.ko 2023-05-10T04:00:34.518 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/blowfish_generic.ko 2023-05-10T04:00:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/camellia_generic.ko 2023-05-10T04:00:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cast5_generic.ko 2023-05-10T04:00:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cast6_generic.ko 2023-05-10T04:00:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cast_common.ko 2023-05-10T04:00:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/ccm.ko 2023-05-10T04:00:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cmac.ko 2023-05-10T04:00:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/crc32_generic.ko 2023-05-10T04:00:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/crypto_engine.ko 2023-05-10T04:00:34.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/crypto_user.ko 2023-05-10T04:00:34.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/cts.ko 2023-05-10T04:00:34.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/des_generic.ko 2023-05-10T04:00:34.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/dh_generic.ko 2023-05-10T04:00:34.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/echainiv.ko 2023-05-10T04:00:34.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/essiv.ko 2023-05-10T04:00:34.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/fcrypt.ko 2023-05-10T04:00:34.520 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/khazad.ko 2023-05-10T04:00:34.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/lz4.ko 2023-05-10T04:00:34.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/lz4hc.ko 2023-05-10T04:00:34.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/md4.ko 2023-05-10T04:00:34.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/michael_mic.ko 2023-05-10T04:00:34.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/pcbc.ko 2023-05-10T04:00:34.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/pcrypt.ko 2023-05-10T04:00:34.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/rmd160.ko 2023-05-10T04:00:34.521 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/seed.ko 2023-05-10T04:00:34.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/serpent_generic.ko 2023-05-10T04:00:34.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/tcrypt.ko 2023-05-10T04:00:34.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/tea.ko 2023-05-10T04:00:34.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/twofish_common.ko 2023-05-10T04:00:34.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/twofish_generic.ko 2023-05-10T04:00:34.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/vmac.ko 2023-05-10T04:00:34.522 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/wp512.ko 2023-05-10T04:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/xcbc.ko 2023-05-10T04:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/xor.ko 2023-05-10T04:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/crypto/xxhash_generic.ko 2023-05-10T04:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers 2023-05-10T04:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi 2023-05-10T04:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-10T04:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/acpi_pad.ko 2023-05-10T04:00:34.523 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/custom_method.ko 2023-05-10T04:00:34.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/ec_sys.ko 2023-05-10T04:00:34.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/platform_profile.ko 2023-05-10T04:00:34.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/sbs.ko 2023-05-10T04:00:34.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/sbshc.ko 2023-05-10T04:00:34.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/acpi/video.ko 2023-05-10T04:00:34.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata 2023-05-10T04:00:34.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/acard-ahci.ko 2023-05-10T04:00:34.524 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/ahci_platform.ko 2023-05-10T04:00:34.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/ata_generic.ko 2023-05-10T04:00:34.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/libahci_platform.ko 2023-05-10T04:00:34.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_acpi.ko 2023-05-10T04:00:34.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_ali.ko 2023-05-10T04:00:34.525 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_amd.ko 2023-05-10T04:00:34.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_artop.ko 2023-05-10T04:00:34.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_atiixp.ko 2023-05-10T04:00:34.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_atp867x.ko 2023-05-10T04:00:34.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_cmd640.ko 2023-05-10T04:00:34.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_cmd64x.ko 2023-05-10T04:00:34.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_cypress.ko 2023-05-10T04:00:34.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_efar.ko 2023-05-10T04:00:34.526 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_hpt366.ko 2023-05-10T04:00:34.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_hpt37x.ko 2023-05-10T04:00:34.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-10T04:00:34.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-10T04:00:34.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_it8213.ko 2023-05-10T04:00:34.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_it821x.ko 2023-05-10T04:00:34.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_jmicron.ko 2023-05-10T04:00:34.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_marvell.ko 2023-05-10T04:00:34.527 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_mpiix.ko 2023-05-10T04:00:34.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_netcell.ko 2023-05-10T04:00:34.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_ninja32.ko 2023-05-10T04:00:34.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_ns87410.ko 2023-05-10T04:00:34.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_ns87415.ko 2023-05-10T04:00:34.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_oldpiix.ko 2023-05-10T04:00:34.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_opti.ko 2023-05-10T04:00:34.528 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_optidma.ko 2023-05-10T04:00:34.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_pcmcia.ko 2023-05-10T04:00:34.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-10T04:00:34.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-10T04:00:34.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_piccolo.ko 2023-05-10T04:00:34.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_rdc.ko 2023-05-10T04:00:34.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_sch.ko 2023-05-10T04:00:34.529 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_serverworks.ko 2023-05-10T04:00:34.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_sil680.ko 2023-05-10T04:00:34.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_sis.ko 2023-05-10T04:00:34.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_sl82c105.ko 2023-05-10T04:00:34.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_triflex.ko 2023-05-10T04:00:34.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pata_via.ko 2023-05-10T04:00:34.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/pdc_adma.ko 2023-05-10T04:00:34.530 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_inic162x.ko 2023-05-10T04:00:34.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_mv.ko 2023-05-10T04:00:34.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_nv.ko 2023-05-10T04:00:34.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_promise.ko 2023-05-10T04:00:34.531 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_qstor.ko 2023-05-10T04:00:34.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_sil.ko 2023-05-10T04:00:34.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_sil24.ko 2023-05-10T04:00:34.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_sis.ko 2023-05-10T04:00:34.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_svw.ko 2023-05-10T04:00:34.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_sx4.ko 2023-05-10T04:00:34.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_uli.ko 2023-05-10T04:00:34.532 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_via.ko 2023-05-10T04:00:34.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ata/sata_vsc.ko 2023-05-10T04:00:34.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/auxdisplay 2023-05-10T04:00:34.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/auxdisplay/ks0108.ko 2023-05-10T04:00:34.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/base 2023-05-10T04:00:34.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/base/regmap 2023-05-10T04:00:34.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/base/regmap/regmap-i2c.ko 2023-05-10T04:00:34.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/bcma 2023-05-10T04:00:34.533 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/bcma/bcma.ko 2023-05-10T04:00:34.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block 2023-05-10T04:00:34.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/aoe 2023-05-10T04:00:34.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/aoe/aoe.ko 2023-05-10T04:00:34.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/brd.ko 2023-05-10T04:00:34.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/drbd 2023-05-10T04:00:34.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/drbd/drbd.ko 2023-05-10T04:00:34.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/floppy.ko 2023-05-10T04:00:34.534 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/loop.ko 2023-05-10T04:00:34.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/mtip32xx 2023-05-10T04:00:34.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-10T04:00:34.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/nbd.ko 2023-05-10T04:00:34.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/null_blk 2023-05-10T04:00:34.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/null_blk/null_blk.ko 2023-05-10T04:00:34.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/pktcdvd.ko 2023-05-10T04:00:34.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/rbd.ko 2023-05-10T04:00:34.535 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/virtio_blk.ko 2023-05-10T04:00:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/xen-blkback 2023-05-10T04:00:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-10T04:00:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/xen-blkfront.ko 2023-05-10T04:00:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/zram 2023-05-10T04:00:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/block/zram/zram.ko 2023-05-10T04:00:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char 2023-05-10T04:00:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hangcheck-timer.ko 2023-05-10T04:00:34.536 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random 2023-05-10T04:00:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-10T04:00:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-10T04:00:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-10T04:00:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/via-rng.ko 2023-05-10T04:00:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-10T04:00:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi 2023-05-10T04:00:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-10T04:00:34.537 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-10T04:00:34.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-10T04:00:34.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-10T04:00:34.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-10T04:00:34.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-10T04:00:34.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/lp.ko 2023-05-10T04:00:34.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/mwave 2023-05-10T04:00:34.538 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/mwave/mwave.ko 2023-05-10T04:00:34.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/pcmcia 2023-05-10T04:00:34.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-10T04:00:34.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-10T04:00:34.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/ppdev.ko 2023-05-10T04:00:34.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tlclk.ko 2023-05-10T04:00:34.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm 2023-05-10T04:00:34.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm.ko 2023-05-10T04:00:34.539 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-10T04:00:34.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-10T04:00:34.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-10T04:00:34.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_tis.ko 2023-05-10T04:00:34.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-05-10T04:00:34.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/uv_mmtimer.ko 2023-05-10T04:00:34.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/char/virtio_console.ko 2023-05-10T04:00:34.540 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq 2023-05-10T04:00:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-05-10T04:00:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-10T04:00:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-10T04:00:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-05-10T04:00:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/powernow-k8.ko 2023-05-10T04:00:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-10T04:00:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto 2023-05-10T04:00:34.541 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/ccp 2023-05-10T04:00:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-10T04:00:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/ccp/ccp.ko 2023-05-10T04:00:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/padlock-aes.ko 2023-05-10T04:00:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/padlock-sha.ko 2023-05-10T04:00:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat 2023-05-10T04:00:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat/qat_common 2023-05-10T04:00:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-10T04:00:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat/qat_dh895xcc 2023-05-10T04:00:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-10T04:00:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/virtio 2023-05-10T04:00:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-10T04:00:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dca 2023-05-10T04:00:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dca/dca.ko 2023-05-10T04:00:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/devfreq 2023-05-10T04:00:34.543 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-05-10T04:00:34.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma 2023-05-10T04:00:34.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma/dw 2023-05-10T04:00:34.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-10T04:00:34.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma/ioat 2023-05-10T04:00:34.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-10T04:00:34.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac 2023-05-10T04:00:34.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/amd64_edac.ko 2023-05-10T04:00:34.544 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/e752x_edac.ko 2023-05-10T04:00:34.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/edac_mce_amd.ko 2023-05-10T04:00:34.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i3000_edac.ko 2023-05-10T04:00:34.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i3200_edac.ko 2023-05-10T04:00:34.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i5100_edac.ko 2023-05-10T04:00:34.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i5400_edac.ko 2023-05-10T04:00:34.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i7300_edac.ko 2023-05-10T04:00:34.545 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i7core_edac.ko 2023-05-10T04:00:34.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/i82975x_edac.ko 2023-05-10T04:00:34.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/ie31200_edac.ko 2023-05-10T04:00:34.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/sb_edac.ko 2023-05-10T04:00:34.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/edac/x38_edac.ko 2023-05-10T04:00:34.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/firmware 2023-05-10T04:00:34.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/firmware/edd.ko 2023-05-10T04:00:34.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-10T04:00:34.546 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/gpio 2023-05-10T04:00:34.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/gpio/gpio-ich.ko 2023-05-10T04:00:34.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-10T04:00:34.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid 2023-05-10T04:00:34.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-appleir.ko 2023-05-10T04:00:34.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-aureal.ko 2023-05-10T04:00:34.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-axff.ko 2023-05-10T04:00:34.547 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-dr.ko 2023-05-10T04:00:34.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-elecom.ko 2023-05-10T04:00:34.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-elo.ko 2023-05-10T04:00:34.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-emsff.ko 2023-05-10T04:00:34.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-gaff.ko 2023-05-10T04:00:34.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-gt683r.ko 2023-05-10T04:00:34.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-gyration.ko 2023-05-10T04:00:34.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-10T04:00:34.548 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-10T04:00:34.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-holtekff.ko 2023-05-10T04:00:34.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-hyperv.ko 2023-05-10T04:00:34.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-icade.ko 2023-05-10T04:00:34.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-keytouch.ko 2023-05-10T04:00:34.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-kye.ko 2023-05-10T04:00:34.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-lcpower.ko 2023-05-10T04:00:34.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-led.ko 2023-05-10T04:00:34.549 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-lenovo.ko 2023-05-10T04:00:34.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-10T04:00:34.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-10T04:00:34.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-multitouch.ko 2023-05-10T04:00:34.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-ortek.ko 2023-05-10T04:00:34.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-penmount.ko 2023-05-10T04:00:34.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-petalynx.ko 2023-05-10T04:00:34.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-picolcd.ko 2023-05-10T04:00:34.550 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-pl.ko 2023-05-10T04:00:34.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-plantronics.ko 2023-05-10T04:00:34.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-primax.ko 2023-05-10T04:00:34.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-rmi.ko 2023-05-10T04:00:34.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-10T04:00:34.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-common.ko 2023-05-10T04:00:34.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-10T04:00:34.551 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-10T04:00:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-10T04:00:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-10T04:00:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-10T04:00:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-10T04:00:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-10T04:00:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-10T04:00:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-10T04:00:34.552 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-roccat.ko 2023-05-10T04:00:34.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-saitek.ko 2023-05-10T04:00:34.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-samsung.ko 2023-05-10T04:00:34.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-10T04:00:34.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-sjoy.ko 2023-05-10T04:00:34.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-sony.ko 2023-05-10T04:00:34.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-speedlink.ko 2023-05-10T04:00:34.553 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-steelseries.ko 2023-05-10T04:00:34.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-sunplus.ko 2023-05-10T04:00:34.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-10T04:00:34.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-tivo.ko 2023-05-10T04:00:34.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-tmff.ko 2023-05-10T04:00:34.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-topseed.ko 2023-05-10T04:00:34.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-twinhan.ko 2023-05-10T04:00:34.554 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-uclogic.ko 2023-05-10T04:00:34.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-waltop.ko 2023-05-10T04:00:34.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-wiimote.ko 2023-05-10T04:00:34.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-xinmo.ko 2023-05-10T04:00:34.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-zpff.ko 2023-05-10T04:00:34.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/hid-zydacron.ko 2023-05-10T04:00:34.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/uhid.ko 2023-05-10T04:00:34.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hid/wacom.ko 2023-05-10T04:00:34.555 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hv 2023-05-10T04:00:34.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hv/hv_balloon.ko 2023-05-10T04:00:34.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hv/hv_utils.ko 2023-05-10T04:00:34.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hv/hv_vmbus.ko 2023-05-10T04:00:34.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon 2023-05-10T04:00:34.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/abituguru.ko 2023-05-10T04:00:34.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/abituguru3.ko 2023-05-10T04:00:34.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-10T04:00:34.556 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ad7414.ko 2023-05-10T04:00:34.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ad7418.ko 2023-05-10T04:00:34.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adc128d818.ko 2023-05-10T04:00:34.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm1025.ko 2023-05-10T04:00:34.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm1026.ko 2023-05-10T04:00:34.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm1029.ko 2023-05-10T04:00:34.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm1031.ko 2023-05-10T04:00:34.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adm9240.ko 2023-05-10T04:00:34.557 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ads7828.ko 2023-05-10T04:00:34.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7410.ko 2023-05-10T04:00:34.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7411.ko 2023-05-10T04:00:34.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7462.ko 2023-05-10T04:00:34.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7470.ko 2023-05-10T04:00:34.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7475.ko 2023-05-10T04:00:34.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/adt7x10.ko 2023-05-10T04:00:34.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/amc6821.ko 2023-05-10T04:00:34.558 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/applesmc.ko 2023-05-10T04:00:34.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/asb100.ko 2023-05-10T04:00:34.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/asc7621.ko 2023-05-10T04:00:34.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-10T04:00:34.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/atxp1.ko 2023-05-10T04:00:34.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/coretemp.ko 2023-05-10T04:00:34.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-10T04:00:34.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/dme1737.ko 2023-05-10T04:00:34.559 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ds1621.ko 2023-05-10T04:00:34.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ds620.ko 2023-05-10T04:00:34.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/emc1403.ko 2023-05-10T04:00:34.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/emc6w201.ko 2023-05-10T04:00:34.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/f71805f.ko 2023-05-10T04:00:34.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/f71882fg.ko 2023-05-10T04:00:34.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/f75375s.ko 2023-05-10T04:00:34.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/fam15h_power.ko 2023-05-10T04:00:34.560 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/fschmd.ko 2023-05-10T04:00:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/g760a.ko 2023-05-10T04:00:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/g762.ko 2023-05-10T04:00:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/gl518sm.ko 2023-05-10T04:00:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/gl520sm.ko 2023-05-10T04:00:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-10T04:00:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/i5500_temp.ko 2023-05-10T04:00:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/i5k_amb.ko 2023-05-10T04:00:34.561 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ibmaem.ko 2023-05-10T04:00:34.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ibmpex.ko 2023-05-10T04:00:34.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ina209.ko 2023-05-10T04:00:34.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ina2xx.ko 2023-05-10T04:00:34.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/it87.ko 2023-05-10T04:00:34.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/k10temp.ko 2023-05-10T04:00:34.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/k8temp.ko 2023-05-10T04:00:34.562 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lineage-pem.ko 2023-05-10T04:00:34.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm63.ko 2023-05-10T04:00:34.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm73.ko 2023-05-10T04:00:34.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm75.ko 2023-05-10T04:00:34.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm77.ko 2023-05-10T04:00:34.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm78.ko 2023-05-10T04:00:34.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm80.ko 2023-05-10T04:00:34.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm83.ko 2023-05-10T04:00:34.563 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm85.ko 2023-05-10T04:00:34.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm87.ko 2023-05-10T04:00:34.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm90.ko 2023-05-10T04:00:34.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm92.ko 2023-05-10T04:00:34.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm93.ko 2023-05-10T04:00:34.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm95234.ko 2023-05-10T04:00:34.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm95241.ko 2023-05-10T04:00:34.564 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/lm95245.ko 2023-05-10T04:00:34.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc2945.ko 2023-05-10T04:00:34.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4151.ko 2023-05-10T04:00:34.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4215.ko 2023-05-10T04:00:34.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4222.ko 2023-05-10T04:00:34.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4245.ko 2023-05-10T04:00:34.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4260.ko 2023-05-10T04:00:34.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/ltc4261.ko 2023-05-10T04:00:34.565 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max16065.ko 2023-05-10T04:00:34.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max1619.ko 2023-05-10T04:00:34.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max1668.ko 2023-05-10T04:00:34.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max197.ko 2023-05-10T04:00:34.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max6639.ko 2023-05-10T04:00:34.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max6650.ko 2023-05-10T04:00:34.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/max6697.ko 2023-05-10T04:00:34.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/mcp3021.ko 2023-05-10T04:00:34.566 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/nct6683.ko 2023-05-10T04:00:34.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/nct6775-core.ko 2023-05-10T04:00:34.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/nct6775.ko 2023-05-10T04:00:34.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/nct7802.ko 2023-05-10T04:00:34.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pc87360.ko 2023-05-10T04:00:34.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pc87427.ko 2023-05-10T04:00:34.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pcf8591.ko 2023-05-10T04:00:34.567 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus 2023-05-10T04:00:34.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-10T04:00:34.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-10T04:00:34.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-10T04:00:34.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-10T04:00:34.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-10T04:00:34.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-10T04:00:34.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-10T04:00:34.568 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-10T04:00:34.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-10T04:00:34.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-10T04:00:34.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-10T04:00:34.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-10T04:00:34.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/powr1220.ko 2023-05-10T04:00:34.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sch5627.ko 2023-05-10T04:00:34.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sch5636.ko 2023-05-10T04:00:34.569 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-10T04:00:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sht15.ko 2023-05-10T04:00:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sht21.ko 2023-05-10T04:00:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/shtc1.ko 2023-05-10T04:00:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/sis5595.ko 2023-05-10T04:00:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/smsc47b397.ko 2023-05-10T04:00:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/smsc47m1.ko 2023-05-10T04:00:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/smsc47m192.ko 2023-05-10T04:00:34.570 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/thmc50.ko 2023-05-10T04:00:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/tmp102.ko 2023-05-10T04:00:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/tmp103.ko 2023-05-10T04:00:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/tmp401.ko 2023-05-10T04:00:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/tmp421.ko 2023-05-10T04:00:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/via-cputemp.ko 2023-05-10T04:00:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/via686a.ko 2023-05-10T04:00:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/vt1211.ko 2023-05-10T04:00:34.571 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/vt8231.ko 2023-05-10T04:00:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83627ehf.ko 2023-05-10T04:00:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83627hf.ko 2023-05-10T04:00:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83781d.ko 2023-05-10T04:00:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83791d.ko 2023-05-10T04:00:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83792d.ko 2023-05-10T04:00:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83793.ko 2023-05-10T04:00:34.572 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83795.ko 2023-05-10T04:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83l785ts.ko 2023-05-10T04:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/hwmon/w83l786ng.ko 2023-05-10T04:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c 2023-05-10T04:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/algos 2023-05-10T04:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-10T04:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-10T04:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses 2023-05-10T04:00:34.573 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-10T04:00:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-10T04:00:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-10T04:00:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-10T04:00:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-10T04:00:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-10T04:00:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-10T04:00:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-10T04:00:34.574 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-10T04:00:34.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-10T04:00:34.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-10T04:00:34.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-10T04:00:34.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-10T04:00:34.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-10T04:00:34.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-10T04:00:34.575 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-10T04:00:34.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-10T04:00:34.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-10T04:00:34.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-10T04:00:34.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-10T04:00:34.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-10T04:00:34.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-10T04:00:34.576 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-10T04:00:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-dev.ko 2023-05-10T04:00:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-mux.ko 2023-05-10T04:00:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-05-10T04:00:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-smbus.ko 2023-05-10T04:00:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/i2c/i2c-stub.ko 2023-05-10T04:00:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband 2023-05-10T04:00:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core 2023-05-10T04:00:34.577 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-10T04:00:34.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/ib_core.ko 2023-05-10T04:00:34.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-10T04:00:34.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-10T04:00:34.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-10T04:00:34.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-10T04:00:34.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-10T04:00:34.578 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw 2023-05-10T04:00:34.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/cxgb4 2023-05-10T04:00:34.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-10T04:00:34.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mlx4 2023-05-10T04:00:34.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-10T04:00:34.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mlx5 2023-05-10T04:00:34.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-10T04:00:34.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mthca 2023-05-10T04:00:34.579 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-10T04:00:34.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp 2023-05-10T04:00:34.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/ipoib 2023-05-10T04:00:34.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-10T04:00:34.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/iser 2023-05-10T04:00:34.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-10T04:00:34.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/isert 2023-05-10T04:00:34.580 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-10T04:00:34.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/srp 2023-05-10T04:00:34.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-10T04:00:34.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/srpt 2023-05-10T04:00:34.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-10T04:00:34.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input 2023-05-10T04:00:34.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport 2023-05-10T04:00:34.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-10T04:00:34.581 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-10T04:00:34.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/gameport.ko 2023-05-10T04:00:34.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/lightning.ko 2023-05-10T04:00:34.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/gameport/ns558.ko 2023-05-10T04:00:34.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/joydev.ko 2023-05-10T04:00:34.582 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/keyboard 2023-05-10T04:00:34.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-10T04:00:34.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse 2023-05-10T04:00:34.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/appletouch.ko 2023-05-10T04:00:34.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/bcm5974.ko 2023-05-10T04:00:34.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/cyapatp.ko 2023-05-10T04:00:34.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-10T04:00:34.583 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/sermouse.ko 2023-05-10T04:00:34.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-10T04:00:34.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-10T04:00:34.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-10T04:00:34.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/rmi4 2023-05-10T04:00:34.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-10T04:00:34.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio 2023-05-10T04:00:34.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio/altera_ps2.ko 2023-05-10T04:00:34.584 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio/arc_ps2.ko 2023-05-10T04:00:34.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-10T04:00:34.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/serio/serio_raw.ko 2023-05-10T04:00:34.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/input/sparse-keymap.ko 2023-05-10T04:00:34.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/iommu 2023-05-10T04:00:34.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/iommu/amd 2023-05-10T04:00:34.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-10T04:00:34.585 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds 2023-05-10T04:00:34.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/leds-blinkm.ko 2023-05-10T04:00:34.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/leds-lm3530.ko 2023-05-10T04:00:34.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/leds-lp3944.ko 2023-05-10T04:00:34.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/leds-ss4200.ko 2023-05-10T04:00:34.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger 2023-05-10T04:00:34.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-10T04:00:34.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-10T04:00:34.586 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-10T04:00:34.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-10T04:00:34.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-10T04:00:34.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-10T04:00:34.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-10T04:00:34.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-10T04:00:34.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-10T04:00:34.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md 2023-05-10T04:00:34.587 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/bcache 2023-05-10T04:00:34.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/bcache/bcache.ko 2023-05-10T04:00:34.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-bio-prison.ko 2023-05-10T04:00:34.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-cache-smq.ko 2023-05-10T04:00:34.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-cache.ko 2023-05-10T04:00:34.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-crypt.ko 2023-05-10T04:00:34.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-delay.ko 2023-05-10T04:00:34.588 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-flakey.ko 2023-05-10T04:00:34.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-log-userspace.ko 2023-05-10T04:00:34.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-multipath.ko 2023-05-10T04:00:34.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-queue-length.ko 2023-05-10T04:00:34.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-raid.ko 2023-05-10T04:00:34.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-round-robin.ko 2023-05-10T04:00:34.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-service-time.ko 2023-05-10T04:00:34.589 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-switch.ko 2023-05-10T04:00:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-thin-pool.ko 2023-05-10T04:00:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/dm-verity.ko 2023-05-10T04:00:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/faulty.ko 2023-05-10T04:00:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/linear.ko 2023-05-10T04:00:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/multipath.ko 2023-05-10T04:00:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/persistent-data 2023-05-10T04:00:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-10T04:00:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/raid0.ko 2023-05-10T04:00:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/raid1.ko 2023-05-10T04:00:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/raid10.ko 2023-05-10T04:00:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/md/raid456.ko 2023-05-10T04:00:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message 2023-05-10T04:00:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion 2023-05-10T04:00:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptbase.ko 2023-05-10T04:00:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptctl.ko 2023-05-10T04:00:34.591 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptfc.ko 2023-05-10T04:00:34.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptlan.ko 2023-05-10T04:00:34.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptsas.ko 2023-05-10T04:00:34.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptscsih.ko 2023-05-10T04:00:34.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/message/fusion/mptspi.ko 2023-05-10T04:00:34.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd 2023-05-10T04:00:34.592 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/lpc_ich.ko 2023-05-10T04:00:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/lpc_sch.ko 2023-05-10T04:00:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/mfd-core.ko 2023-05-10T04:00:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/sm501.ko 2023-05-10T04:00:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/viperboard.ko 2023-05-10T04:00:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/vx855.ko 2023-05-10T04:00:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/mfd/wl1273-core.ko 2023-05-10T04:00:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc 2023-05-10T04:00:34.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/altera-stapl 2023-05-10T04:00:34.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-10T04:00:34.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/apds9802als.ko 2023-05-10T04:00:34.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/apds990x.ko 2023-05-10T04:00:34.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/bh1770glc.ko 2023-05-10T04:00:34.594 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/cb710 2023-05-10T04:00:34.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/cb710/cb710.ko 2023-05-10T04:00:34.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom 2023-05-10T04:00:34.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom/at24.ko 2023-05-10T04:00:34.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-10T04:00:34.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-10T04:00:34.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/eeprom/max6875.ko 2023-05-10T04:00:34.595 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/enclosure.ko 2023-05-10T04:00:34.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/hpilo.ko 2023-05-10T04:00:34.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/isl29003.ko 2023-05-10T04:00:34.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/isl29020.ko 2023-05-10T04:00:34.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/lis3lv02d 2023-05-10T04:00:34.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-10T04:00:34.596 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-10T04:00:34.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/mei 2023-05-10T04:00:34.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/mei/mei-me.ko 2023-05-10T04:00:34.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/mei/mei-txe.ko 2023-05-10T04:00:34.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/mei/mei.ko 2023-05-10T04:00:34.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-gru 2023-05-10T04:00:34.597 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-gru/gru.ko 2023-05-10T04:00:34.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-xp 2023-05-10T04:00:34.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-xp/xp.ko 2023-05-10T04:00:34.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-xp/xpc.ko 2023-05-10T04:00:34.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-05-10T04:00:34.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/tifm_7xx1.ko 2023-05-10T04:00:34.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/tifm_core.ko 2023-05-10T04:00:34.598 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/tsl2550.ko 2023-05-10T04:00:34.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/vmw_balloon.ko 2023-05-10T04:00:34.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/vmw_vmci 2023-05-10T04:00:34.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-10T04:00:34.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net 2023-05-10T04:00:34.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/bonding 2023-05-10T04:00:34.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/bonding/bonding.ko 2023-05-10T04:00:34.599 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa 2023-05-10T04:00:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/b53 2023-05-10T04:00:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-10T04:00:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-10T04:00:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-10T04:00:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/mv88e6xxx 2023-05-10T04:00:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-10T04:00:34.600 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/dummy.ko 2023-05-10T04:00:34.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/eql.ko 2023-05-10T04:00:34.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet 2023-05-10T04:00:34.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com 2023-05-10T04:00:34.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-10T04:00:34.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-10T04:00:34.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-10T04:00:34.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-10T04:00:34.601 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390 2023-05-10T04:00:34.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-10T04:00:34.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-10T04:00:34.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-10T04:00:34.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-10T04:00:34.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/adaptec 2023-05-10T04:00:34.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-10T04:00:34.602 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/agere 2023-05-10T04:00:34.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-10T04:00:34.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/alteon 2023-05-10T04:00:34.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-10T04:00:34.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/altera 2023-05-10T04:00:34.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-10T04:00:34.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/amd 2023-05-10T04:00:34.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-10T04:00:34.603 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-10T04:00:34.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-10T04:00:34.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros 2023-05-10T04:00:34.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/alx 2023-05-10T04:00:34.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-10T04:00:34.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atl1c 2023-05-10T04:00:34.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-10T04:00:34.604 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atl1e 2023-05-10T04:00:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-10T04:00:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atlx 2023-05-10T04:00:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-10T04:00:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-10T04:00:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom 2023-05-10T04:00:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-10T04:00:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-10T04:00:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-05-10T04:00:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-10T04:00:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-10T04:00:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/genet 2023-05-10T04:00:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-10T04:00:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-10T04:00:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/brocade 2023-05-10T04:00:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/brocade/bna 2023-05-10T04:00:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-10T04:00:34.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio 2023-05-10T04:00:34.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb 2023-05-10T04:00:34.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-10T04:00:34.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-05-10T04:00:34.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-10T04:00:34.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-05-10T04:00:34.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-10T04:00:34.607 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-05-10T04:00:34.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-10T04:00:34.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-05-10T04:00:34.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-10T04:00:34.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/cisco 2023-05-10T04:00:34.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/cisco/enic 2023-05-10T04:00:34.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-10T04:00:34.608 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec 2023-05-10T04:00:34.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip 2023-05-10T04:00:34.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-10T04:00:34.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-10T04:00:34.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-10T04:00:34.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-10T04:00:34.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-10T04:00:34.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-10T04:00:34.609 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dlink 2023-05-10T04:00:34.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-10T04:00:34.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-10T04:00:34.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/dnet.ko 2023-05-10T04:00:34.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/emulex 2023-05-10T04:00:34.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/emulex/benet 2023-05-10T04:00:34.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-10T04:00:34.610 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/ethoc.ko 2023-05-10T04:00:34.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/fealnx.ko 2023-05-10T04:00:34.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel 2023-05-10T04:00:34.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-10T04:00:34.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e1000 2023-05-10T04:00:34.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-10T04:00:34.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e1000e 2023-05-10T04:00:34.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-10T04:00:34.611 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/fm10k 2023-05-10T04:00:34.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-10T04:00:34.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/i40e 2023-05-10T04:00:34.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-10T04:00:34.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/iavf 2023-05-10T04:00:34.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-10T04:00:34.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/igb 2023-05-10T04:00:34.612 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-10T04:00:34.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/igbvf 2023-05-10T04:00:34.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-10T04:00:34.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgb 2023-05-10T04:00:34.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-10T04:00:34.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgbe 2023-05-10T04:00:34.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-10T04:00:34.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgbevf 2023-05-10T04:00:34.613 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-10T04:00:34.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/jme.ko 2023-05-10T04:00:34.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/marvell 2023-05-10T04:00:34.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-10T04:00:34.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-10T04:00:34.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-10T04:00:34.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox 2023-05-10T04:00:34.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx4 2023-05-10T04:00:34.614 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-10T04:00:34.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-10T04:00:34.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx5 2023-05-10T04:00:34.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-05-10T04:00:34.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-10T04:00:34.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/micrel 2023-05-10T04:00:34.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-10T04:00:34.615 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/myricom 2023-05-10T04:00:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/myricom/myri10ge 2023-05-10T04:00:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-10T04:00:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/natsemi 2023-05-10T04:00:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-10T04:00:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-10T04:00:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/neterion 2023-05-10T04:00:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-10T04:00:34.616 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/nvidia 2023-05-10T04:00:34.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-10T04:00:34.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/packetengines 2023-05-10T04:00:34.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-10T04:00:34.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-10T04:00:34.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic 2023-05-10T04:00:34.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/netxen 2023-05-10T04:00:34.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-10T04:00:34.617 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-10T04:00:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-05-10T04:00:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-10T04:00:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/rdc 2023-05-10T04:00:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-10T04:00:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek 2023-05-10T04:00:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-10T04:00:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-10T04:00:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-10T04:00:34.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-10T04:00:34.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/rocker 2023-05-10T04:00:34.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-05-10T04:00:34.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sfc 2023-05-10T04:00:34.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-10T04:00:34.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/silan 2023-05-10T04:00:34.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-10T04:00:34.619 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sis 2023-05-10T04:00:34.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-10T04:00:34.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-10T04:00:34.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc 2023-05-10T04:00:34.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-10T04:00:34.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-10T04:00:34.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-10T04:00:34.620 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-10T04:00:34.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/stmicro 2023-05-10T04:00:34.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/stmicro/stmmac 2023-05-10T04:00:34.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-10T04:00:34.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-10T04:00:34.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun 2023-05-10T04:00:34.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-10T04:00:34.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-10T04:00:34.621 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-10T04:00:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-10T04:00:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/tehuti 2023-05-10T04:00:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-10T04:00:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/ti 2023-05-10T04:00:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-10T04:00:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/via 2023-05-10T04:00:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-10T04:00:34.622 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-10T04:00:34.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/wiznet 2023-05-10T04:00:34.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-10T04:00:34.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-10T04:00:34.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/xircom 2023-05-10T04:00:34.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-10T04:00:34.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/geneve.ko 2023-05-10T04:00:34.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/hyperv 2023-05-10T04:00:34.623 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-10T04:00:34.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ieee802154 2023-05-10T04:00:34.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-10T04:00:34.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ifb.ko 2023-05-10T04:00:34.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ipvlan 2023-05-10T04:00:34.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-10T04:00:34.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/macvlan.ko 2023-05-10T04:00:34.624 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/macvtap.ko 2023-05-10T04:00:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mdio 2023-05-10T04:00:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mdio.ko 2023-05-10T04:00:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-10T04:00:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-10T04:00:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/mii.ko 2023-05-10T04:00:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/net_failover.ko 2023-05-10T04:00:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/netconsole.ko 2023-05-10T04:00:34.625 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/nlmon.ko 2023-05-10T04:00:34.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/pcs 2023-05-10T04:00:34.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-10T04:00:34.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-10T04:00:34.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy 2023-05-10T04:00:34.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/amd.ko 2023-05-10T04:00:34.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-10T04:00:34.626 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-05-10T04:00:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-10T04:00:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/bcm87xx.ko 2023-05-10T04:00:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/broadcom.ko 2023-05-10T04:00:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/cicada.ko 2023-05-10T04:00:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/davicom.ko 2023-05-10T04:00:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/dp83640.ko 2023-05-10T04:00:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/et1011c.ko 2023-05-10T04:00:34.627 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/icplus.ko 2023-05-10T04:00:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/lxt.ko 2023-05-10T04:00:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/marvell.ko 2023-05-10T04:00:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/micrel.ko 2023-05-10T04:00:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/national.ko 2023-05-10T04:00:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/phylink.ko 2023-05-10T04:00:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/qsemi.ko 2023-05-10T04:00:34.628 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/realtek.ko 2023-05-10T04:00:34.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/smsc.ko 2023-05-10T04:00:34.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/ste10Xp.ko 2023-05-10T04:00:34.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/phy/vitesse.ko 2023-05-10T04:00:34.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp 2023-05-10T04:00:34.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-10T04:00:34.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_async.ko 2023-05-10T04:00:34.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-10T04:00:34.629 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_generic.ko 2023-05-10T04:00:34.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-10T04:00:34.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-10T04:00:34.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/pppoe.ko 2023-05-10T04:00:34.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/pppox.ko 2023-05-10T04:00:34.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/ppp/pptp.ko 2023-05-10T04:00:34.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/slip 2023-05-10T04:00:34.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/slip/slhc.ko 2023-05-10T04:00:34.630 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/slip/slip.ko 2023-05-10T04:00:34.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/sungem_phy.ko 2023-05-10T04:00:34.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/tap.ko 2023-05-10T04:00:34.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team 2023-05-10T04:00:34.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team.ko 2023-05-10T04:00:34.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-10T04:00:34.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-10T04:00:34.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-10T04:00:34.631 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_random.ko 2023-05-10T04:00:34.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-10T04:00:34.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/tun.ko 2023-05-10T04:00:34.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/veth.ko 2023-05-10T04:00:34.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/virtio_net.ko 2023-05-10T04:00:34.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/vmxnet3 2023-05-10T04:00:34.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-10T04:00:34.632 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/vxlan 2023-05-10T04:00:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/vxlan/vxlan.ko 2023-05-10T04:00:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/xen-netback 2023-05-10T04:00:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-10T04:00:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/net/xen-netfront.ko 2023-05-10T04:00:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ntb 2023-05-10T04:00:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ntb/ntb.ko 2023-05-10T04:00:34.633 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/nvme 2023-05-10T04:00:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/nvme/host 2023-05-10T04:00:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/nvme/host/nvme-core.ko 2023-05-10T04:00:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/nvme/host/nvme.ko 2023-05-10T04:00:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport 2023-05-10T04:00:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport/parport.ko 2023-05-10T04:00:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport/parport_cs.ko 2023-05-10T04:00:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport/parport_pc.ko 2023-05-10T04:00:34.634 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/parport/parport_serial.ko 2023-05-10T04:00:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci 2023-05-10T04:00:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/hotplug 2023-05-10T04:00:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-10T04:00:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/pcie 2023-05-10T04:00:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/pcie/aer_inject.ko 2023-05-10T04:00:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pci/xen-pcifront.ko 2023-05-10T04:00:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pcmcia 2023-05-10T04:00:34.635 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pcmcia/i82092.ko 2023-05-10T04:00:34.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pcmcia/pd6729.ko 2023-05-10T04:00:34.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-10T04:00:34.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pinctrl 2023-05-10T04:00:34.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pinctrl/intel 2023-05-10T04:00:34.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-10T04:00:34.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform 2023-05-10T04:00:34.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86 2023-05-10T04:00:34.636 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-10T04:00:34.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/acerhdf.ko 2023-05-10T04:00:34.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-10T04:00:34.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-10T04:00:34.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-10T04:00:34.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-10T04:00:34.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-10T04:00:34.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-10T04:00:34.637 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-10T04:00:34.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-10T04:00:34.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-10T04:00:34.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/hdaps.ko 2023-05-10T04:00:34.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/intel 2023-05-10T04:00:34.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-10T04:00:34.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/intel_ips.ko 2023-05-10T04:00:34.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-10T04:00:34.638 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-10T04:00:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-10T04:00:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-10T04:00:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-10T04:00:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-10T04:00:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-10T04:00:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-10T04:00:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-10T04:00:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/platform/x86/wmi.ko 2023-05-10T04:00:34.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/powercap 2023-05-10T04:00:34.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-10T04:00:34.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-10T04:00:34.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps 2023-05-10T04:00:34.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/clients 2023-05-10T04:00:34.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-10T04:00:34.640 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-10T04:00:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/clients/pps_parport.ko 2023-05-10T04:00:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/pps/pps_core.ko 2023-05-10T04:00:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ptp 2023-05-10T04:00:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ptp/ptp.ko 2023-05-10T04:00:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ptp/ptp_kvm.ko 2023-05-10T04:00:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc 2023-05-10T04:00:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-10T04:00:34.641 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-10T04:00:34.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-10T04:00:34.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-10T04:00:34.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-10T04:00:34.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-10T04:00:34.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-10T04:00:34.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-10T04:00:34.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-10T04:00:34.642 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-10T04:00:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-10T04:00:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-em3027.ko 2023-05-10T04:00:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-10T04:00:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-10T04:00:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-10T04:00:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-10T04:00:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-10T04:00:34.643 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-10T04:00:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-max6900.ko 2023-05-10T04:00:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-10T04:00:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-10T04:00:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-10T04:00:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-10T04:00:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-10T04:00:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-10T04:00:34.644 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-10T04:00:34.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-10T04:00:34.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-10T04:00:34.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-10T04:00:34.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-10T04:00:34.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-10T04:00:34.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/rtc/rtc-x1205.ko 2023-05-10T04:00:34.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi 2023-05-10T04:00:34.645 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/3w-9xxx.ko 2023-05-10T04:00:34.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/3w-sas.ko 2023-05-10T04:00:34.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/3w-xxxx.ko 2023-05-10T04:00:34.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/BusLogic.ko 2023-05-10T04:00:34.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/a100u2w.ko 2023-05-10T04:00:34.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aacraid 2023-05-10T04:00:34.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-10T04:00:34.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/advansys.ko 2023-05-10T04:00:34.646 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aic7xxx 2023-05-10T04:00:34.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-10T04:00:34.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-10T04:00:34.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/am53c974.ko 2023-05-10T04:00:34.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/arcmsr 2023-05-10T04:00:34.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-10T04:00:34.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/atp870u.ko 2023-05-10T04:00:34.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/be2iscsi 2023-05-10T04:00:34.647 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-10T04:00:34.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bfa 2023-05-10T04:00:34.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bfa/bfa.ko 2023-05-10T04:00:34.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bnx2fc 2023-05-10T04:00:34.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-10T04:00:34.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bnx2i 2023-05-10T04:00:34.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-10T04:00:34.648 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/ch.ko 2023-05-10T04:00:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/csiostor 2023-05-10T04:00:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-10T04:00:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi 2023-05-10T04:00:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/cxgb3i 2023-05-10T04:00:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-10T04:00:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/cxgb4i 2023-05-10T04:00:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-10T04:00:34.649 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-10T04:00:34.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/dc395x.ko 2023-05-10T04:00:34.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler 2023-05-10T04:00:34.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-05-10T04:00:34.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-05-10T04:00:34.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-05-10T04:00:34.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-05-10T04:00:34.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/dmx3191d.ko 2023-05-10T04:00:34.650 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/esas2r 2023-05-10T04:00:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-10T04:00:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/esp_scsi.ko 2023-05-10T04:00:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fcoe 2023-05-10T04:00:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-10T04:00:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-10T04:00:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fnic 2023-05-10T04:00:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/fnic/fnic.ko 2023-05-10T04:00:34.651 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/hpsa.ko 2023-05-10T04:00:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/hptiop.ko 2023-05-10T04:00:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/hv_storvsc.ko 2023-05-10T04:00:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/initio.ko 2023-05-10T04:00:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/ipr.ko 2023-05-10T04:00:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/ips.ko 2023-05-10T04:00:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/isci 2023-05-10T04:00:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/isci/isci.ko 2023-05-10T04:00:34.652 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-10T04:00:34.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-10T04:00:34.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libfc 2023-05-10T04:00:34.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libfc/libfc.ko 2023-05-10T04:00:34.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libiscsi.ko 2023-05-10T04:00:34.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-10T04:00:34.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libsas 2023-05-10T04:00:34.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/libsas/libsas.ko 2023-05-10T04:00:34.653 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/lpfc 2023-05-10T04:00:34.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-10T04:00:34.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid 2023-05-10T04:00:34.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid.ko 2023-05-10T04:00:34.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-10T04:00:34.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-10T04:00:34.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-10T04:00:34.654 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mpt3sas 2023-05-10T04:00:34.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-10T04:00:34.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mvsas 2023-05-10T04:00:34.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-10T04:00:34.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/mvumi.ko 2023-05-10T04:00:34.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/pm8001 2023-05-10T04:00:34.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-10T04:00:34.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/pmcraid.ko 2023-05-10T04:00:34.655 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla1280.ko 2023-05-10T04:00:34.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla2xxx 2023-05-10T04:00:34.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-10T04:00:34.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-10T04:00:34.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla4xxx 2023-05-10T04:00:34.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-10T04:00:34.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/raid_class.ko 2023-05-10T04:00:34.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_debug.ko 2023-05-10T04:00:34.656 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-10T04:00:34.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-10T04:00:34.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-10T04:00:34.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-10T04:00:34.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-10T04:00:34.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/ses.ko 2023-05-10T04:00:34.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/st.ko 2023-05-10T04:00:34.657 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/stex.ko 2023-05-10T04:00:34.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/sym53c8xx_2 2023-05-10T04:00:34.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-10T04:00:34.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/virtio_scsi.ko 2023-05-10T04:00:34.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-10T04:00:34.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/scsi/wd719x.ko 2023-05-10T04:00:34.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ssb 2023-05-10T04:00:34.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ssb/ssb.ko 2023-05-10T04:00:34.658 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target 2023-05-10T04:00:34.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/iscsi 2023-05-10T04:00:34.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-10T04:00:34.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/loopback 2023-05-10T04:00:34.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-10T04:00:34.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_file.ko 2023-05-10T04:00:34.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_iblock.ko 2023-05-10T04:00:34.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_mod.ko 2023-05-10T04:00:34.659 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_pscsi.ko 2023-05-10T04:00:34.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/target_core_user.ko 2023-05-10T04:00:34.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/tcm_fc 2023-05-10T04:00:34.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-10T04:00:34.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal 2023-05-10T04:00:34.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel 2023-05-10T04:00:34.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal 2023-05-10T04:00:34.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-10T04:00:34.660 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-10T04:00:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-10T04:00:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-10T04:00:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-10T04:00:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-10T04:00:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-10T04:00:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-10T04:00:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-10T04:00:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-10T04:00:34.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-10T04:00:34.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-10T04:00:34.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-10T04:00:34.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-10T04:00:34.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-10T04:00:34.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty 2023-05-10T04:00:34.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/ipwireless 2023-05-10T04:00:34.662 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-10T04:00:34.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/n_gsm.ko 2023-05-10T04:00:34.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/n_hdlc.ko 2023-05-10T04:00:34.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/nozomi.ko 2023-05-10T04:00:34.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial 2023-05-10T04:00:34.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/8250 2023-05-10T04:00:34.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-10T04:00:34.663 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/arc_uart.ko 2023-05-10T04:00:34.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/jsm 2023-05-10T04:00:34.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-10T04:00:34.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/tty/synclink_gt.ko 2023-05-10T04:00:34.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs 2023-05-10T04:00:34.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs/core 2023-05-10T04:00:34.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-10T04:00:34.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs/host 2023-05-10T04:00:34.664 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-10T04:00:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio 2023-05-10T04:00:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio.ko 2023-05-10T04:00:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio_aec.ko 2023-05-10T04:00:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio_cif.ko 2023-05-10T04:00:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio_pci_generic.ko 2023-05-10T04:00:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/uio/uio_sercos3.ko 2023-05-10T04:00:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb 2023-05-10T04:00:34.665 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class 2023-05-10T04:00:34.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class/cdc-acm.ko 2023-05-10T04:00:34.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-10T04:00:34.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class/usblp.ko 2023-05-10T04:00:34.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/class/usbtmc.ko 2023-05-10T04:00:34.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/host 2023-05-10T04:00:34.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-10T04:00:34.666 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/host/u132-hcd.ko 2023-05-10T04:00:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/image 2023-05-10T04:00:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/image/mdc800.ko 2023-05-10T04:00:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/image/microtek.ko 2023-05-10T04:00:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc 2023-05-10T04:00:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/adutux.ko 2023-05-10T04:00:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/appledisplay.ko 2023-05-10T04:00:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/emi26.ko 2023-05-10T04:00:34.667 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/emi62.ko 2023-05-10T04:00:34.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/ezusb.ko 2023-05-10T04:00:34.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-10T04:00:34.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/idmouse.ko 2023-05-10T04:00:34.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/iowarrior.ko 2023-05-10T04:00:34.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-10T04:00:34.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/ldusb.ko 2023-05-10T04:00:34.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/legousbtower.ko 2023-05-10T04:00:34.668 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/sisusbvga 2023-05-10T04:00:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-10T04:00:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-10T04:00:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/usb3503.ko 2023-05-10T04:00:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/usblcd.ko 2023-05-10T04:00:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-10T04:00:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/uss720.ko 2023-05-10T04:00:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/misc/yurex.ko 2023-05-10T04:00:34.669 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/phy 2023-05-10T04:00:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/phy/phy-generic.ko 2023-05-10T04:00:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial 2023-05-10T04:00:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/aircable.ko 2023-05-10T04:00:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ark3116.ko 2023-05-10T04:00:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-10T04:00:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ch341.ko 2023-05-10T04:00:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/cp210x.ko 2023-05-10T04:00:34.670 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/cyberjack.ko 2023-05-10T04:00:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-10T04:00:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-10T04:00:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/empeg.ko 2023-05-10T04:00:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-10T04:00:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-10T04:00:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-10T04:00:34.671 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/io_ti.ko 2023-05-10T04:00:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ipaq.ko 2023-05-10T04:00:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ipw.ko 2023-05-10T04:00:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ir-usb.ko 2023-05-10T04:00:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-10T04:00:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/keyspan.ko 2023-05-10T04:00:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-10T04:00:34.672 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-10T04:00:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-10T04:00:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/mct_u232.ko 2023-05-10T04:00:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/mos7720.ko 2023-05-10T04:00:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/mos7840.ko 2023-05-10T04:00:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/navman.ko 2023-05-10T04:00:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/omninet.ko 2023-05-10T04:00:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/opticon.ko 2023-05-10T04:00:34.673 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/option.ko 2023-05-10T04:00:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/oti6858.ko 2023-05-10T04:00:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/pl2303.ko 2023-05-10T04:00:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/qcaux.ko 2023-05-10T04:00:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/qcserial.ko 2023-05-10T04:00:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/quatech2.ko 2023-05-10T04:00:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/safe_serial.ko 2023-05-10T04:00:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/sierra.ko 2023-05-10T04:00:34.674 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-10T04:00:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ssu100.ko 2023-05-10T04:00:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/symbolserial.ko 2023-05-10T04:00:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-10T04:00:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-10T04:00:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/usb_debug.ko 2023-05-10T04:00:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-10T04:00:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/visor.ko 2023-05-10T04:00:34.675 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/whiteheat.ko 2023-05-10T04:00:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-10T04:00:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage 2023-05-10T04:00:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/uas.ko 2023-05-10T04:00:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-10T04:00:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-10T04:00:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-10T04:00:34.676 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-10T04:00:34.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-10T04:00:34.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-10T04:00:34.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-10T04:00:34.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-karma.ko 2023-05-10T04:00:34.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-10T04:00:34.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-10T04:00:34.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-10T04:00:34.677 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-10T04:00:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-10T04:00:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/storage/usb-storage.ko 2023-05-10T04:00:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/usbip 2023-05-10T04:00:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-10T04:00:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-10T04:00:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-10T04:00:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio 2023-05-10T04:00:34.678 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/pci 2023-05-10T04:00:34.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-10T04:00:34.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-10T04:00:34.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/vfio.ko 2023-05-10T04:00:34.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-10T04:00:34.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost 2023-05-10T04:00:34.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost/vhost.ko 2023-05-10T04:00:34.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-10T04:00:34.679 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost/vhost_net.ko 2023-05-10T04:00:34.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/vhost/vhost_scsi.ko 2023-05-10T04:00:34.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video 2023-05-10T04:00:34.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video/backlight 2023-05-10T04:00:34.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video/backlight/apple_bl.ko 2023-05-10T04:00:34.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video/backlight/lcd.ko 2023-05-10T04:00:34.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-10T04:00:34.680 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio 2023-05-10T04:00:34.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio.ko 2023-05-10T04:00:34.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_balloon.ko 2023-05-10T04:00:34.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_mmio.ko 2023-05-10T04:00:34.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_pci.ko 2023-05-10T04:00:34.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-05-10T04:00:34.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-05-10T04:00:34.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/virtio/virtio_ring.ko 2023-05-10T04:00:34.681 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1 2023-05-10T04:00:34.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/masters 2023-05-10T04:00:34.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/masters/ds2482.ko 2023-05-10T04:00:34.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/masters/ds2490.ko 2023-05-10T04:00:34.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves 2023-05-10T04:00:34.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-10T04:00:34.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-10T04:00:34.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-10T04:00:34.682 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-10T04:00:34.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-10T04:00:34.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-10T04:00:34.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-10T04:00:34.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-10T04:00:34.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-10T04:00:34.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-10T04:00:34.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-10T04:00:34.683 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/w1/wire.ko 2023-05-10T04:00:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog 2023-05-10T04:00:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-10T04:00:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-10T04:00:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-10T04:00:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/hpwdt.ko 2023-05-10T04:00:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/i6300esb.ko 2023-05-10T04:00:34.684 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-10T04:00:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-10T04:00:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/ib700wdt.ko 2023-05-10T04:00:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/ibmasr.ko 2023-05-10T04:00:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-10T04:00:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-10T04:00:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/it87_wdt.ko 2023-05-10T04:00:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/machzwd.ko 2023-05-10T04:00:34.685 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/nv_tco.ko 2023-05-10T04:00:34.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-10T04:00:34.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-10T04:00:34.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-10T04:00:34.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-10T04:00:34.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/softdog.ko 2023-05-10T04:00:34.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-10T04:00:34.686 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/via_wdt.ko 2023-05-10T04:00:34.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-10T04:00:34.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-10T04:00:34.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-10T04:00:34.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/wdt_pci.ko 2023-05-10T04:00:34.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/watchdog/xen_wdt.ko 2023-05-10T04:00:34.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen 2023-05-10T04:00:34.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-acpi-processor.ko 2023-05-10T04:00:34.687 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-evtchn.ko 2023-05-10T04:00:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-gntalloc.ko 2023-05-10T04:00:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-gntdev.ko 2023-05-10T04:00:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-pciback 2023-05-10T04:00:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-10T04:00:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xen-privcmd.ko 2023-05-10T04:00:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xenfs 2023-05-10T04:00:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-10T04:00:34.688 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs 2023-05-10T04:00:34.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/9p 2023-05-10T04:00:34.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/9p/9p.ko 2023-05-10T04:00:34.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/affs 2023-05-10T04:00:34.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/affs/affs.ko 2023-05-10T04:00:34.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/befs 2023-05-10T04:00:34.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/befs/befs.ko 2023-05-10T04:00:34.689 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/binfmt_misc.ko 2023-05-10T04:00:34.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/btrfs 2023-05-10T04:00:34.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/btrfs/btrfs.ko 2023-05-10T04:00:34.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cachefiles 2023-05-10T04:00:34.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cachefiles/cachefiles.ko 2023-05-10T04:00:34.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ceph 2023-05-10T04:00:34.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ceph/ceph.ko 2023-05-10T04:00:34.690 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cifs 2023-05-10T04:00:34.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cifs/cifs.ko 2023-05-10T04:00:34.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/coda 2023-05-10T04:00:34.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/coda/coda.ko 2023-05-10T04:00:34.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cramfs 2023-05-10T04:00:34.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/cramfs/cramfs.ko 2023-05-10T04:00:34.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/dlm 2023-05-10T04:00:34.691 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/dlm/dlm.ko 2023-05-10T04:00:34.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ecryptfs 2023-05-10T04:00:34.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ecryptfs/ecryptfs.ko 2023-05-10T04:00:34.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/f2fs 2023-05-10T04:00:34.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/f2fs/f2fs.ko 2023-05-10T04:00:34.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fat 2023-05-10T04:00:34.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fat/fat.ko 2023-05-10T04:00:34.692 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fat/msdos.ko 2023-05-10T04:00:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fat/vfat.ko 2023-05-10T04:00:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fscache 2023-05-10T04:00:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fscache/fscache.ko 2023-05-10T04:00:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fuse 2023-05-10T04:00:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fuse/cuse.ko 2023-05-10T04:00:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/fuse/fuse.ko 2023-05-10T04:00:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/gfs2 2023-05-10T04:00:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/gfs2/gfs2.ko 2023-05-10T04:00:34.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/hfs 2023-05-10T04:00:34.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/hfs/hfs.ko 2023-05-10T04:00:34.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/hfsplus 2023-05-10T04:00:34.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/hfsplus/hfsplus.ko 2023-05-10T04:00:34.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/isofs 2023-05-10T04:00:34.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/isofs/isofs.ko 2023-05-10T04:00:34.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/jfs 2023-05-10T04:00:34.694 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/jfs/jfs.ko 2023-05-10T04:00:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/lockd 2023-05-10T04:00:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/lockd/lockd.ko 2023-05-10T04:00:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/minix 2023-05-10T04:00:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/minix/minix.ko 2023-05-10T04:00:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/netfs 2023-05-10T04:00:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/netfs/netfs.ko 2023-05-10T04:00:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs 2023-05-10T04:00:34.695 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/blocklayout 2023-05-10T04:00:34.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-10T04:00:34.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/filelayout 2023-05-10T04:00:34.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-10T04:00:34.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/flexfilelayout 2023-05-10T04:00:34.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-10T04:00:34.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/nfs.ko 2023-05-10T04:00:34.696 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/nfsv3.ko 2023-05-10T04:00:34.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs/nfsv4.ko 2023-05-10T04:00:34.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs_common 2023-05-10T04:00:34.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs_common/grace.ko 2023-05-10T04:00:34.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfs_common/nfs_acl.ko 2023-05-10T04:00:34.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfsd 2023-05-10T04:00:34.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nfsd/nfsd.ko 2023-05-10T04:00:34.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nilfs2 2023-05-10T04:00:34.697 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nilfs2/nilfs2.ko 2023-05-10T04:00:34.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls 2023-05-10T04:00:34.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-celtic.ko 2023-05-10T04:00:34.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-centeuro.ko 2023-05-10T04:00:34.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-croatian.ko 2023-05-10T04:00:34.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-cyrillic.ko 2023-05-10T04:00:34.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-gaelic.ko 2023-05-10T04:00:34.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-greek.ko 2023-05-10T04:00:34.698 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-iceland.ko 2023-05-10T04:00:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-inuit.ko 2023-05-10T04:00:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-roman.ko 2023-05-10T04:00:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-romanian.ko 2023-05-10T04:00:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/mac-turkish.ko 2023-05-10T04:00:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp1250.ko 2023-05-10T04:00:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp1251.ko 2023-05-10T04:00:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp1255.ko 2023-05-10T04:00:34.699 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp737.ko 2023-05-10T04:00:34.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp775.ko 2023-05-10T04:00:34.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp850.ko 2023-05-10T04:00:34.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp852.ko 2023-05-10T04:00:34.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp855.ko 2023-05-10T04:00:34.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp857.ko 2023-05-10T04:00:34.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp860.ko 2023-05-10T04:00:34.700 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp861.ko 2023-05-10T04:00:34.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp862.ko 2023-05-10T04:00:34.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp863.ko 2023-05-10T04:00:34.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp864.ko 2023-05-10T04:00:34.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp865.ko 2023-05-10T04:00:34.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp866.ko 2023-05-10T04:00:34.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp869.ko 2023-05-10T04:00:34.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp874.ko 2023-05-10T04:00:34.701 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp932.ko 2023-05-10T04:00:34.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp936.ko 2023-05-10T04:00:34.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp949.ko 2023-05-10T04:00:34.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_cp950.ko 2023-05-10T04:00:34.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_euc-jp.ko 2023-05-10T04:00:34.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-1.ko 2023-05-10T04:00:34.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-13.ko 2023-05-10T04:00:34.702 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-14.ko 2023-05-10T04:00:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-15.ko 2023-05-10T04:00:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-2.ko 2023-05-10T04:00:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-3.ko 2023-05-10T04:00:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-4.ko 2023-05-10T04:00:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-5.ko 2023-05-10T04:00:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-6.ko 2023-05-10T04:00:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-7.ko 2023-05-10T04:00:34.703 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_iso8859-9.ko 2023-05-10T04:00:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_koi8-r.ko 2023-05-10T04:00:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_koi8-ru.ko 2023-05-10T04:00:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_koi8-u.ko 2023-05-10T04:00:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/nls/nls_utf8.ko 2023-05-10T04:00:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2 2023-05-10T04:00:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/cluster 2023-05-10T04:00:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-10T04:00:34.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/dlm 2023-05-10T04:00:34.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-10T04:00:34.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/dlmfs 2023-05-10T04:00:34.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-10T04:00:34.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/ocfs2.ko 2023-05-10T04:00:34.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-10T04:00:34.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-10T04:00:34.705 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-10T04:00:34.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/overlayfs 2023-05-10T04:00:34.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/overlayfs/overlay.ko 2023-05-10T04:00:34.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/pstore 2023-05-10T04:00:34.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/pstore/ramoops.ko 2023-05-10T04:00:34.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/reiserfs 2023-05-10T04:00:34.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/reiserfs/reiserfs.ko 2023-05-10T04:00:34.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/romfs 2023-05-10T04:00:34.706 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/romfs/romfs.ko 2023-05-10T04:00:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/smbfs_common 2023-05-10T04:00:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-10T04:00:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-10T04:00:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/squashfs 2023-05-10T04:00:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/squashfs/squashfs.ko 2023-05-10T04:00:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/sysv 2023-05-10T04:00:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/sysv/sysv.ko 2023-05-10T04:00:34.707 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/udf 2023-05-10T04:00:34.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/udf/udf.ko 2023-05-10T04:00:34.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ufs 2023-05-10T04:00:34.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/ufs/ufs.ko 2023-05-10T04:00:34.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/xfs 2023-05-10T04:00:34.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/fs/xfs/xfs.ko 2023-05-10T04:00:34.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel 2023-05-10T04:00:34.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/rcu 2023-05-10T04:00:34.708 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/rcu/rcutorture.ko 2023-05-10T04:00:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/torture.ko 2023-05-10T04:00:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/trace 2023-05-10T04:00:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-05-10T04:00:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib 2023-05-10T04:00:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/asn1_encoder.ko 2023-05-10T04:00:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crc-itu-t.ko 2023-05-10T04:00:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crc8.ko 2023-05-10T04:00:34.709 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crypto 2023-05-10T04:00:34.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crypto/libarc4.ko 2023-05-10T04:00:34.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/crypto/libdes.ko 2023-05-10T04:00:34.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/libcrc32c.ko 2023-05-10T04:00:34.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/lru_cache.ko 2023-05-10T04:00:34.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/lz4 2023-05-10T04:00:34.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/lz4/lz4_compress.ko 2023-05-10T04:00:34.710 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/lz4/lz4hc_compress.ko 2023-05-10T04:00:34.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/math 2023-05-10T04:00:34.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/math/cordic.ko 2023-05-10T04:00:34.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/raid6 2023-05-10T04:00:34.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/raid6/raid6_pq.ko 2023-05-10T04:00:34.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/reed_solomon 2023-05-10T04:00:34.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-10T04:00:34.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/ts_bm.ko 2023-05-10T04:00:34.711 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/ts_fsm.ko 2023-05-10T04:00:34.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/ts_kmp.ko 2023-05-10T04:00:34.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/zstd 2023-05-10T04:00:34.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/lib/zstd/zstd_compress.ko 2023-05-10T04:00:34.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/mm 2023-05-10T04:00:34.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/mm/hwpoison-inject.ko 2023-05-10T04:00:34.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net 2023-05-10T04:00:34.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan 2023-05-10T04:00:34.712 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/6lowpan.ko 2023-05-10T04:00:34.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_dest.ko 2023-05-10T04:00:34.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_fragment.ko 2023-05-10T04:00:34.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_hop.ko 2023-05-10T04:00:34.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-10T04:00:34.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_mobility.ko 2023-05-10T04:00:34.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_routing.ko 2023-05-10T04:00:34.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/6lowpan/nhc_udp.ko 2023-05-10T04:00:34.713 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802 2023-05-10T04:00:34.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/garp.ko 2023-05-10T04:00:34.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/mrp.ko 2023-05-10T04:00:34.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/p8022.ko 2023-05-10T04:00:34.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/psnap.ko 2023-05-10T04:00:34.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/802/stp.ko 2023-05-10T04:00:34.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/8021q 2023-05-10T04:00:34.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/8021q/8021q.ko 2023-05-10T04:00:34.714 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p 2023-05-10T04:00:34.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p/9pnet.ko 2023-05-10T04:00:34.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p/9pnet_fd.ko 2023-05-10T04:00:34.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p/9pnet_rdma.ko 2023-05-10T04:00:34.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/9p/9pnet_virtio.ko 2023-05-10T04:00:34.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/batman-adv 2023-05-10T04:00:34.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/batman-adv/batman-adv.ko 2023-05-10T04:00:34.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge 2023-05-10T04:00:34.715 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/br_netfilter.ko 2023-05-10T04:00:34.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/bridge.ko 2023-05-10T04:00:34.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter 2023-05-10T04:00:34.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-10T04:00:34.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-10T04:00:34.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-10T04:00:34.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-10T04:00:34.716 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-10T04:00:34.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-10T04:00:34.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-10T04:00:34.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-10T04:00:34.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-10T04:00:34.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-10T04:00:34.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-10T04:00:34.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-10T04:00:34.717 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-10T04:00:34.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-10T04:00:34.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-10T04:00:34.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-10T04:00:34.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-10T04:00:34.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-10T04:00:34.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-10T04:00:34.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-10T04:00:34.718 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/ebtables.ko 2023-05-10T04:00:34.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-05-10T04:00:34.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-10T04:00:34.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-10T04:00:34.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ceph 2023-05-10T04:00:34.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ceph/libceph.ko 2023-05-10T04:00:34.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/core 2023-05-10T04:00:34.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/core/failover.ko 2023-05-10T04:00:34.719 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/core/pktgen.ko 2023-05-10T04:00:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp 2023-05-10T04:00:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp/dccp.ko 2023-05-10T04:00:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp/dccp_diag.ko 2023-05-10T04:00:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp/dccp_ipv4.ko 2023-05-10T04:00:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dccp/dccp_ipv6.ko 2023-05-10T04:00:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dns_resolver 2023-05-10T04:00:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dns_resolver/dns_resolver.ko 2023-05-10T04:00:34.720 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa 2023-05-10T04:00:34.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/dsa_core.ko 2023-05-10T04:00:34.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/tag_brcm.ko 2023-05-10T04:00:34.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/tag_dsa.ko 2023-05-10T04:00:34.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/tag_none.ko 2023-05-10T04:00:34.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/dsa/tag_trailer.ko 2023-05-10T04:00:34.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154 2023-05-10T04:00:34.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154/6lowpan 2023-05-10T04:00:34.721 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-10T04:00:34.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154/ieee802154.ko 2023-05-10T04:00:34.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-10T04:00:34.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4 2023-05-10T04:00:34.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ah4.ko 2023-05-10T04:00:34.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/esp4.ko 2023-05-10T04:00:34.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/fou.ko 2023-05-10T04:00:34.722 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/gre.ko 2023-05-10T04:00:34.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/inet_diag.ko 2023-05-10T04:00:34.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ip_gre.ko 2023-05-10T04:00:34.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ip_tunnel.ko 2023-05-10T04:00:34.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ip_vti.ko 2023-05-10T04:00:34.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ipcomp.ko 2023-05-10T04:00:34.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/ipip.ko 2023-05-10T04:00:34.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter 2023-05-10T04:00:34.723 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-10T04:00:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-10T04:00:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-10T04:00:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-10T04:00:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-10T04:00:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-10T04:00:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-10T04:00:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-10T04:00:34.724 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-10T04:00:34.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-10T04:00:34.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-10T04:00:34.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-10T04:00:34.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-10T04:00:34.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-10T04:00:34.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-10T04:00:34.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-10T04:00:34.725 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-10T04:00:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-10T04:00:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-10T04:00:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-10T04:00:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-10T04:00:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_bic.ko 2023-05-10T04:00:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_dctcp.ko 2023-05-10T04:00:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_diag.ko 2023-05-10T04:00:34.726 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_highspeed.ko 2023-05-10T04:00:34.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_htcp.ko 2023-05-10T04:00:34.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_hybla.ko 2023-05-10T04:00:34.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_illinois.ko 2023-05-10T04:00:34.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_lp.ko 2023-05-10T04:00:34.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_scalable.ko 2023-05-10T04:00:34.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_vegas.ko 2023-05-10T04:00:34.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_veno.ko 2023-05-10T04:00:34.727 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_westwood.ko 2023-05-10T04:00:34.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tcp_yeah.ko 2023-05-10T04:00:34.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/tunnel4.ko 2023-05-10T04:00:34.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/udp_diag.ko 2023-05-10T04:00:34.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/udp_tunnel.ko 2023-05-10T04:00:34.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-10T04:00:34.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6 2023-05-10T04:00:34.728 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ah6.ko 2023-05-10T04:00:34.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/esp6.ko 2023-05-10T04:00:34.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/fou6.ko 2023-05-10T04:00:34.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ip6_tunnel.ko 2023-05-10T04:00:34.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-10T04:00:34.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ip6_vti.ko 2023-05-10T04:00:34.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/ipcomp6.ko 2023-05-10T04:00:34.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter 2023-05-10T04:00:34.729 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-10T04:00:34.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-10T04:00:34.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-10T04:00:34.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-10T04:00:34.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-10T04:00:34.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-10T04:00:34.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-10T04:00:34.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-10T04:00:34.730 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-10T04:00:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-10T04:00:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-10T04:00:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-10T04:00:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-10T04:00:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-10T04:00:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-10T04:00:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-10T04:00:34.731 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-10T04:00:34.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-10T04:00:34.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-10T04:00:34.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-10T04:00:34.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-10T04:00:34.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-10T04:00:34.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-10T04:00:34.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-10T04:00:34.732 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/sit.ko 2023-05-10T04:00:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/tunnel6.ko 2023-05-10T04:00:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-10T04:00:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/key 2023-05-10T04:00:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/key/af_key.ko 2023-05-10T04:00:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp 2023-05-10T04:00:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_core.ko 2023-05-10T04:00:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-10T04:00:34.733 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_eth.ko 2023-05-10T04:00:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_ip.ko 2023-05-10T04:00:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_ip6.ko 2023-05-10T04:00:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_netlink.ko 2023-05-10T04:00:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/l2tp/l2tp_ppp.ko 2023-05-10T04:00:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/llc 2023-05-10T04:00:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/llc/llc.ko 2023-05-10T04:00:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/mac802154 2023-05-10T04:00:34.734 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/mac802154/mac802154.ko 2023-05-10T04:00:34.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/mpls 2023-05-10T04:00:34.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/mpls/mpls_gso.ko 2023-05-10T04:00:34.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter 2023-05-10T04:00:34.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset 2023-05-10T04:00:34.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set.ko 2023-05-10T04:00:34.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-10T04:00:34.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-10T04:00:34.735 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-10T04:00:34.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-10T04:00:34.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-10T04:00:34.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-10T04:00:34.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-10T04:00:34.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-10T04:00:34.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-10T04:00:34.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-10T04:00:34.736 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-10T04:00:34.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-10T04:00:34.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-10T04:00:34.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-10T04:00:34.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-10T04:00:34.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs 2023-05-10T04:00:34.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-10T04:00:34.737 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-10T04:00:34.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-10T04:00:34.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-10T04:00:34.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-10T04:00:34.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-10T04:00:34.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-10T04:00:34.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-10T04:00:34.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-10T04:00:34.738 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-10T04:00:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-10T04:00:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-10T04:00:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-10T04:00:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-10T04:00:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conncount.ko 2023-05-10T04:00:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack.ko 2023-05-10T04:00:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-10T04:00:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-10T04:00:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-10T04:00:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-10T04:00:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-10T04:00:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-10T04:00:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-10T04:00:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-10T04:00:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-10T04:00:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-10T04:00:34.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-10T04:00:34.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-10T04:00:34.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-10T04:00:34.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_flow_table.ko 2023-05-10T04:00:34.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-10T04:00:34.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_log_syslog.ko 2023-05-10T04:00:34.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat.ko 2023-05-10T04:00:34.741 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-10T04:00:34.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-10T04:00:34.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_irc.ko 2023-05-10T04:00:34.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_sip.ko 2023-05-10T04:00:34.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-10T04:00:34.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-10T04:00:34.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nf_tables.ko 2023-05-10T04:00:34.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink.ko 2023-05-10T04:00:34.742 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-10T04:00:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink_log.ko 2023-05-10T04:00:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-10T04:00:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-10T04:00:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_chain_nat.ko 2023-05-10T04:00:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_compat.ko 2023-05-10T04:00:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_ct.ko 2023-05-10T04:00:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-10T04:00:34.743 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_fib.ko 2023-05-10T04:00:34.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-10T04:00:34.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_hash.ko 2023-05-10T04:00:34.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_limit.ko 2023-05-10T04:00:34.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_log.ko 2023-05-10T04:00:34.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_masq.ko 2023-05-10T04:00:34.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_nat.ko 2023-05-10T04:00:34.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_numgen.ko 2023-05-10T04:00:34.744 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_queue.ko 2023-05-10T04:00:34.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_quota.ko 2023-05-10T04:00:34.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_redir.ko 2023-05-10T04:00:34.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_reject.ko 2023-05-10T04:00:34.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_reject_inet.ko 2023-05-10T04:00:34.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_socket.ko 2023-05-10T04:00:34.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/nft_tunnel.ko 2023-05-10T04:00:34.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_AUDIT.ko 2023-05-10T04:00:34.745 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-10T04:00:34.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-10T04:00:34.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-10T04:00:34.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_CT.ko 2023-05-10T04:00:34.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_DSCP.ko 2023-05-10T04:00:34.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_HL.ko 2023-05-10T04:00:34.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_HMARK.ko 2023-05-10T04:00:34.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-10T04:00:34.746 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_LED.ko 2023-05-10T04:00:34.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_LOG.ko 2023-05-10T04:00:34.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-10T04:00:34.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_NETMAP.ko 2023-05-10T04:00:34.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_NFLOG.ko 2023-05-10T04:00:34.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-10T04:00:34.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_RATEEST.ko 2023-05-10T04:00:34.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-10T04:00:34.747 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_SECMARK.ko 2023-05-10T04:00:34.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-10T04:00:34.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-10T04:00:34.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TEE.ko 2023-05-10T04:00:34.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TPROXY.ko 2023-05-10T04:00:34.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_TRACE.ko 2023-05-10T04:00:34.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_addrtype.ko 2023-05-10T04:00:34.748 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_bpf.ko 2023-05-10T04:00:34.749 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_cgroup.ko 2023-05-10T04:00:34.749 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_cluster.ko 2023-05-10T04:00:34.749 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_comment.ko 2023-05-10T04:00:34.749 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_connbytes.ko 2023-05-10T04:00:34.749 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_connlabel.ko 2023-05-10T04:00:34.749 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_connlimit.ko 2023-05-10T04:00:34.749 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_connmark.ko 2023-05-10T04:00:34.749 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_conntrack.ko 2023-05-10T04:00:34.750 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_cpu.ko 2023-05-10T04:00:34.750 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_dccp.ko 2023-05-10T04:00:34.750 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_devgroup.ko 2023-05-10T04:00:34.750 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_dscp.ko 2023-05-10T04:00:34.750 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_ecn.ko 2023-05-10T04:00:34.750 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_esp.ko 2023-05-10T04:00:34.750 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_hashlimit.ko 2023-05-10T04:00:34.750 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_helper.ko 2023-05-10T04:00:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_hl.ko 2023-05-10T04:00:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_ipcomp.ko 2023-05-10T04:00:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_iprange.ko 2023-05-10T04:00:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_ipvs.ko 2023-05-10T04:00:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_l2tp.ko 2023-05-10T04:00:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_length.ko 2023-05-10T04:00:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_limit.ko 2023-05-10T04:00:34.751 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_mac.ko 2023-05-10T04:00:34.752 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_mark.ko 2023-05-10T04:00:34.752 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_multiport.ko 2023-05-10T04:00:34.752 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_nat.ko 2023-05-10T04:00:34.752 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_nfacct.ko 2023-05-10T04:00:34.752 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_osf.ko 2023-05-10T04:00:34.752 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_owner.ko 2023-05-10T04:00:34.752 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_physdev.ko 2023-05-10T04:00:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_pkttype.ko 2023-05-10T04:00:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_policy.ko 2023-05-10T04:00:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_quota.ko 2023-05-10T04:00:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_rateest.ko 2023-05-10T04:00:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_realm.ko 2023-05-10T04:00:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_recent.ko 2023-05-10T04:00:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_sctp.ko 2023-05-10T04:00:34.753 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_set.ko 2023-05-10T04:00:34.754 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_socket.ko 2023-05-10T04:00:34.754 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_state.ko 2023-05-10T04:00:34.754 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_statistic.ko 2023-05-10T04:00:34.754 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_string.ko 2023-05-10T04:00:34.754 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_tcpmss.ko 2023-05-10T04:00:34.754 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_time.ko 2023-05-10T04:00:34.754 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netfilter/xt_u32.ko 2023-05-10T04:00:34.755 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netlink 2023-05-10T04:00:34.755 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/netlink/netlink_diag.ko 2023-05-10T04:00:34.755 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/nsh 2023-05-10T04:00:34.755 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/nsh/nsh.ko 2023-05-10T04:00:34.755 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch 2023-05-10T04:00:34.755 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch/openvswitch.ko 2023-05-10T04:00:34.755 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch/vport-geneve.ko 2023-05-10T04:00:34.755 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch/vport-gre.ko 2023-05-10T04:00:34.756 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/openvswitch/vport-vxlan.ko 2023-05-10T04:00:34.756 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/packet 2023-05-10T04:00:34.756 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/packet/af_packet_diag.ko 2023-05-10T04:00:34.756 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/rds 2023-05-10T04:00:34.756 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/rds/rds.ko 2023-05-10T04:00:34.756 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/rds/rds_rdma.ko 2023-05-10T04:00:34.756 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/rds/rds_tcp.ko 2023-05-10T04:00:34.757 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched 2023-05-10T04:00:34.757 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_csum.ko 2023-05-10T04:00:34.757 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_gact.ko 2023-05-10T04:00:34.757 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_ipt.ko 2023-05-10T04:00:34.757 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_mirred.ko 2023-05-10T04:00:34.757 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_nat.ko 2023-05-10T04:00:34.757 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_pedit.ko 2023-05-10T04:00:34.757 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_police.ko 2023-05-10T04:00:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_simple.ko 2023-05-10T04:00:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_skbedit.ko 2023-05-10T04:00:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/act_vlan.ko 2023-05-10T04:00:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_basic.ko 2023-05-10T04:00:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_bpf.ko 2023-05-10T04:00:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_flow.ko 2023-05-10T04:00:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_fw.ko 2023-05-10T04:00:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_route.ko 2023-05-10T04:00:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/cls_u32.ko 2023-05-10T04:00:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_cmp.ko 2023-05-10T04:00:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_ipset.ko 2023-05-10T04:00:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_meta.ko 2023-05-10T04:00:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_nbyte.ko 2023-05-10T04:00:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_text.ko 2023-05-10T04:00:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/em_u32.ko 2023-05-10T04:00:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_choke.ko 2023-05-10T04:00:34.760 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_codel.ko 2023-05-10T04:00:34.760 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_drr.ko 2023-05-10T04:00:34.760 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_fq.ko 2023-05-10T04:00:34.760 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_gred.ko 2023-05-10T04:00:34.760 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_hfsc.ko 2023-05-10T04:00:34.760 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_hhf.ko 2023-05-10T04:00:34.760 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_htb.ko 2023-05-10T04:00:34.760 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_ingress.ko 2023-05-10T04:00:34.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_mqprio.ko 2023-05-10T04:00:34.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_mqprio_lib.ko 2023-05-10T04:00:34.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_multiq.ko 2023-05-10T04:00:34.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_netem.ko 2023-05-10T04:00:34.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_pie.ko 2023-05-10T04:00:34.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_plug.ko 2023-05-10T04:00:34.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_prio.ko 2023-05-10T04:00:34.761 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_qfq.ko 2023-05-10T04:00:34.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_red.ko 2023-05-10T04:00:34.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_sfb.ko 2023-05-10T04:00:34.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_sfq.ko 2023-05-10T04:00:34.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_tbf.ko 2023-05-10T04:00:34.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sched/sch_teql.ko 2023-05-10T04:00:34.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sctp 2023-05-10T04:00:34.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sctp/sctp.ko 2023-05-10T04:00:34.762 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sctp/sctp_diag.ko 2023-05-10T04:00:34.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc 2023-05-10T04:00:34.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/auth_gss 2023-05-10T04:00:34.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-10T04:00:34.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-10T04:00:34.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/sunrpc.ko 2023-05-10T04:00:34.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/xprtrdma 2023-05-10T04:00:34.763 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-10T04:00:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/tipc 2023-05-10T04:00:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/tipc/diag.ko 2023-05-10T04:00:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/tipc/tipc.ko 2023-05-10T04:00:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/unix 2023-05-10T04:00:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/unix/unix_diag.ko 2023-05-10T04:00:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock 2023-05-10T04:00:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-10T04:00:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-10T04:00:34.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vsock.ko 2023-05-10T04:00:34.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-10T04:00:34.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-10T04:00:34.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/xfrm 2023-05-10T04:00:34.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-10T04:00:34.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security 2023-05-10T04:00:34.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys 2023-05-10T04:00:34.765 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys/encrypted-keys 2023-05-10T04:00:34.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-05-10T04:00:34.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys/trusted-keys 2023-05-10T04:00:34.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/security/keys/trusted-keys/trusted.ko 2023-05-10T04:00:34.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/virt 2023-05-10T04:00:34.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/virt/lib 2023-05-10T04:00:34.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/kernel/virt/lib/irqbypass.ko 2023-05-10T04:00:34.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.alias 2023-05-10T04:00:34.766 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.alias.bin 2023-05-10T04:00:34.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.builtin 2023-05-10T04:00:34.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.builtin.bin 2023-05-10T04:00:34.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.builtin.modinfo 2023-05-10T04:00:34.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.dep 2023-05-10T04:00:34.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.dep.bin 2023-05-10T04:00:34.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.devname 2023-05-10T04:00:34.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.order 2023-05-10T04:00:34.767 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.softdep 2023-05-10T04:00:34.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.symbols 2023-05-10T04:00:34.768 INFO:teuthology.orchestra.run.smithi132.stdout:/lib/modules/6.3.0-gf1e69e4d3654/modules.symbols.bin 2023-05-10T04:00:34.768 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.769 DEBUG:teuthology.orchestra.run.smithi132:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-05-10T04:00:34.794 INFO:teuthology.orchestra.run.smithi132.stdout:postinstall scriptlet (using /bin/sh): 2023-05-10T04:00:34.795 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.3.0-gf1e69e4d3654 -a -r /boot/System.map-6.3.0-gf1e69e4d3654 ]; then 2023-05-10T04:00:34.795 INFO:teuthology.orchestra.run.smithi132.stdout:cp /boot/vmlinuz-6.3.0-gf1e69e4d3654 /boot/.vmlinuz-6.3.0-gf1e69e4d3654-rpm 2023-05-10T04:00:34.795 INFO:teuthology.orchestra.run.smithi132.stdout:cp /boot/System.map-6.3.0-gf1e69e4d3654 /boot/.System.map-6.3.0-gf1e69e4d3654-rpm 2023-05-10T04:00:34.795 INFO:teuthology.orchestra.run.smithi132.stdout:rm -f /boot/vmlinuz-6.3.0-gf1e69e4d3654 /boot/System.map-6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.795 INFO:teuthology.orchestra.run.smithi132.stdout:/sbin/installkernel 6.3.0-gf1e69e4d3654 /boot/.vmlinuz-6.3.0-gf1e69e4d3654-rpm /boot/.System.map-6.3.0-gf1e69e4d3654-rpm 2023-05-10T04:00:34.796 INFO:teuthology.orchestra.run.smithi132.stdout:rm -f /boot/.vmlinuz-6.3.0-gf1e69e4d3654-rpm /boot/.System.map-6.3.0-gf1e69e4d3654-rpm 2023-05-10T04:00:34.796 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-05-10T04:00:34.796 INFO:teuthology.orchestra.run.smithi132.stdout:preuninstall scriptlet (using /bin/sh): 2023-05-10T04:00:34.796 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-05-10T04:00:34.796 INFO:teuthology.orchestra.run.smithi132.stdout:new-kernel-pkg --remove 6.3.0-gf1e69e4d3654 --rminitrd --initrdfile=/boot/initramfs-6.3.0-gf1e69e4d3654.img 2023-05-10T04:00:34.796 INFO:teuthology.orchestra.run.smithi132.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-05-10T04:00:34.796 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-install remove 6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.797 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-05-10T04:00:34.797 INFO:teuthology.orchestra.run.smithi132.stdout:postuninstall scriptlet (using /bin/sh): 2023-05-10T04:00:34.797 INFO:teuthology.orchestra.run.smithi132.stdout:if [ -x /sbin/update-bootloader ]; then 2023-05-10T04:00:34.797 INFO:teuthology.orchestra.run.smithi132.stdout:/sbin/update-bootloader --remove 6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.797 INFO:teuthology.orchestra.run.smithi132.stdout:fi 2023-05-10T04:00:34.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2023-05-10T04:00:34.874 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2023-05-10T04:00:34.874 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2023-05-10T04:00:34.874 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.02 2023-05-10T04:00:34.874 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 123.el8 2023-05-10T04:00:34.875 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2023-05-10T04:00:34.875 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-05-10T04:00:34.875 INFO:teuthology.orchestra.run.smithi132.stdout:Group : System Environment/Base 2023-05-10T04:00:34.875 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 9265450 2023-05-10T04:00:34.875 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2023-05-10T04:00:34.875 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-05-10T04:00:34.876 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-05-10T04:00:34.876 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-05-10T04:00:34.876 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-05-10T04:00:34.876 INFO:teuthology.orchestra.run.smithi132.stdout:Relocations : (not relocatable) 2023-05-10T04:00:34.876 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : Red Hat, Inc. 2023-05-10T04:00:34.876 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : Red Hat, Inc. 2023-05-10T04:00:34.877 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2023-05-10T04:00:34.877 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2023-05-10T04:00:34.877 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2023-05-10T04:00:34.877 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:00:34.877 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-05-10T04:00:34.877 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2023-05-10T04:00:34.877 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2023-05-10T04:00:34.877 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2023-05-10T04:00:34.878 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:00:34.878 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2023-05-10T04:00:34.879 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-05-10T04:00:34.879 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 6.3.0-gf1e69e4d3654 2023-05-10T04:00:34.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-05-10T04:00:36.071 INFO:teuthology.orchestra.run.smithi154.stderr:done 2023-05-10T04:00:36.073 DEBUG:teuthology.orchestra.run.smithi154:> mktemp 2023-05-10T04:00:36.090 INFO:teuthology.orchestra.run.smithi154.stdout:/tmp/tmp.7ERvibsaZt 2023-05-10T04:00:36.090 DEBUG:teuthology.orchestra.run.smithi154:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.7ERvibsaZt 2023-05-10T04:00:36.164 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0666 /tmp/tmp.7ERvibsaZt 2023-05-10T04:00:36.313 DEBUG:teuthology.orchestra.remote:smithi154:/tmp/tmp.7ERvibsaZt is 6KB 2023-05-10T04:00:36.360 DEBUG:teuthology.orchestra.run.smithi154:> rm -fr /tmp/tmp.7ERvibsaZt 2023-05-10T04:00:36.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo /bin/ls /boot/loader/entries || true 2023-05-10T04:00:36.447 INFO:teuthology.orchestra.run.smithi154.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-05-10T04:00:36.447 INFO:teuthology.orchestra.run.smithi154.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-05-10T04:00:36.448 INFO:teuthology.orchestra.run.smithi154.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.3.0-gf1e69e4d3654.conf 2023-05-10T04:00:36.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.3.0-gf1e69e4d3654 2023-05-10T04:00:36.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo shutdown -r now 2023-05-10T04:00:39.596 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2023-05-10T04:00:41.654 INFO:teuthology.orchestra.run.smithi132.stderr:done 2023-05-10T04:00:41.656 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-05-10T04:00:41.673 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.r3kvEfY257 2023-05-10T04:00:41.673 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.r3kvEfY257 2023-05-10T04:00:41.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.r3kvEfY257 2023-05-10T04:00:41.890 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.r3kvEfY257 is 6KB 2023-05-10T04:00:41.939 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.r3kvEfY257 2023-05-10T04:00:41.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2023-05-10T04:00:42.026 INFO:teuthology.orchestra.run.smithi132.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-05-10T04:00:42.026 INFO:teuthology.orchestra.run.smithi132.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-05-10T04:00:42.026 INFO:teuthology.orchestra.run.smithi132.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.3.0-gf1e69e4d3654.conf 2023-05-10T04:00:42.027 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.3.0-gf1e69e4d3654 2023-05-10T04:00:42.191 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2023-05-10T04:01:06.624 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-05-10T04:01:06.625 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-05-10T04:01:06.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T04:01:12.200 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-05-10T04:01:12.200 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-05-10T04:01:12.201 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T04:01:25.105 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-05-10T04:01:30.736 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-05-10T04:01:55.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-05-10T04:01:55.129 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T04:01:58.196 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.154 2023-05-10T04:02:00.739 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-05-10T04:02:00.740 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T04:02:19.120 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-05-10T04:02:28.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-05-10T04:02:28.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T04:02:28.565 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-05-10T04:02:29.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-05-10T04:02:29.034 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.3.0-gf1e69e4d3654"... 2023-05-10T04:02:29.035 DEBUG:teuthology.orchestra.run.smithi154:> uname -r 2023-05-10T04:02:29.073 INFO:teuthology.orchestra.run.smithi154.stdout:6.3.0-gf1e69e4d3654 2023-05-10T04:02:29.073 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-gf1e69e4d3654 vs 6.3.0-gf1e69e4d3654 2023-05-10T04:02:29.073 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-10T04:02:29.073 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-05-10T04:02:30.075 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-05-10T04:02:30.076 DEBUG:teuthology.orchestra.run.smithi154:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-10T04:02:30.252 INFO:teuthology.orchestra.run.smithi154.stdout:ttyS1 2023-05-10T04:02:30.276 DEBUG:teuthology.parallel:result is None 2023-05-10T04:02:49.121 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-05-10T04:02:49.122 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T04:02:49.631 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-05-10T04:02:50.013 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-05-10T04:02:50.013 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.3.0-gf1e69e4d3654"... 2023-05-10T04:02:50.014 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-05-10T04:02:50.053 INFO:teuthology.orchestra.run.smithi132.stdout:6.3.0-gf1e69e4d3654 2023-05-10T04:02:50.053 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-gf1e69e4d3654 vs 6.3.0-gf1e69e4d3654 2023-05-10T04:02:50.053 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-10T04:02:50.053 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-05-10T04:02:51.054 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-05-10T04:02:51.054 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-05-10T04:02:51.480 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2023-05-10T04:02:51.503 DEBUG:teuthology.parallel:result is None 2023-05-10T04:02:51.504 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-10T04:02:51.513 INFO:teuthology.task.internal:Creating test directory... 2023-05-10T04:02:51.513 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-10T04:02:51.517 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-10T04:02:51.561 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-10T04:02:51.567 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-10T04:02:51.576 INFO:teuthology.task.internal:Creating archive directory... 2023-05-10T04:02:51.577 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-10T04:02:51.597 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-10T04:02:51.730 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-10T04:02:51.738 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-10T04:02:51.738 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-10T04:02:51.742 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-10T04:02:51.835 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-10T04:02:51.852 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-10T04:02:51.860 INFO:teuthology.orchestra.run.smithi154.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-10T04:02:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-10T04:02:51.880 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-10T04:02:51.887 INFO:teuthology.task.internal:Configuring sudo... 2023-05-10T04:02:51.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-10T04:02:51.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-10T04:02:51.953 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-10T04:02:51.962 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-10T04:02:51.963 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-10T04:02:51.967 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-10T04:02:52.005 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-10T04:02:52.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-10T04:02:52.184 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-10T04:02:52.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-10T04:02:52.327 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:02:52.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-10T04:02:52.388 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-10T04:02:52.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-10T04:02:52.549 DEBUG:teuthology.orchestra.run.smithi154:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-10T04:02:52.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-10T04:02:52.691 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:02:52.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-10T04:02:52.752 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2023-05-10T04:02:52.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo service rsyslog restart 2023-05-10T04:02:52.857 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-10T04:02:52.895 INFO:teuthology.orchestra.run.smithi154.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-05-10T04:02:53.357 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-10T04:02:53.369 INFO:teuthology.task.internal:Starting timer... 2023-05-10T04:02:53.369 INFO:teuthology.run_tasks:Running task pcp... 2023-05-10T04:02:53.379 INFO:teuthology.run_tasks:Running task selinux... 2023-05-10T04:02:53.388 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-05-10T04:02:53.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2023-05-10T04:02:53.494 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2023-05-10T04:02:53.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo service auditd rotate 2023-05-10T04:02:53.604 INFO:teuthology.orchestra.run.smithi154.stdout:Rotating logs: 2023-05-10T04:02:53.607 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-10T04:02:53.608 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2023-05-10T04:02:53.662 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2023-05-10T04:02:53.662 DEBUG:teuthology.orchestra.run.smithi154:> /usr/sbin/getenforce 2023-05-10T04:02:53.710 INFO:teuthology.orchestra.run.smithi154.stdout:Permissive 2023-05-10T04:02:53.710 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi154.front.sepia.ceph.com': 'permissive'} 2023-05-10T04:02:53.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-10T04:02:53.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T04:02:53.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-05-10T04:02:53.836 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T04:02:53.837 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-10T04:02:53.837 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2023-05-10T04:02:53.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo /usr/sbin/setenforce permissive 2023-05-10T04:02:53.970 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-10T04:02:53.979 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-05-10T04:02:53.986 INFO:teuthology.repo_utils:Fetching main from origin 2023-05-10T04:02:54.142 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-10T04:02:54.171 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-10T04:02:54.173 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi154.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-10T04:15:30.584 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi154.front.sepia.ceph.com')] 2023-05-10T04:15:30.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-05-10T04:15:30.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T04:15:30.700 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-05-10T04:15:30.807 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi154.front.sepia.ceph.com' 2023-05-10T04:15:30.808 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi154.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-10T04:15:30.893 DEBUG:teuthology.orchestra.run.smithi154:> true 2023-05-10T04:15:30.998 INFO:teuthology.run_tasks:Running task clock... 2023-05-10T04:15:31.014 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-10T04:15:31.015 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-10T04:15:31.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-10T04:15:31.019 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-10T04:15:31.020 DEBUG:teuthology.orchestra.run.smithi154:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-10T04:15:31.083 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-10T04:15:31.106 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-05-10T04:15:31.114 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-10T04:15:31.138 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-05-10T04:15:31.202 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2023-05-10T04:15:31.222 INFO:teuthology.orchestra.run.smithi154.stderr:sudo: ntpd: command not found 2023-05-10T04:15:31.227 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2023-05-10T04:15:31.248 INFO:teuthology.orchestra.run.smithi154.stdout:506 Cannot talk to daemon 2023-05-10T04:15:31.260 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-10T04:15:31.279 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-05-10T04:15:31.289 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-10T04:15:31.310 INFO:teuthology.orchestra.run.smithi154.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-05-10T04:15:31.371 INFO:teuthology.orchestra.run.smithi132.stderr:bash: ntpq: command not found 2023-05-10T04:15:31.378 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-10T04:15:31.379 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2023-05-10T04:15:31.379 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T04:15:31.379 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T04:15:31.380 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T04:15:31.380 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T04:15:31.397 INFO:teuthology.orchestra.run.smithi154.stderr:bash: ntpq: command not found 2023-05-10T04:15:31.404 INFO:teuthology.orchestra.run.smithi154.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-05-10T04:15:31.405 INFO:teuthology.orchestra.run.smithi154.stdout:=============================================================================== 2023-05-10T04:15:31.405 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T04:15:31.405 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T04:15:31.405 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T04:15:31.406 INFO:teuthology.orchestra.run.smithi154.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-05-10T04:15:31.407 INFO:teuthology.run_tasks:Running task install... 2023-05-10T04:15:31.415 DEBUG:teuthology.task.install:project ceph 2023-05-10T04:15:31.416 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2ef5137fbb6e28908d2161218e7b594628c1b6d3'}} 2023-05-10T04:15:31.416 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2ef5137fbb6e28908d2161218e7b594628c1b6d3'} 2023-05-10T04:15:31.416 INFO:teuthology.task.install:Using flavor: default 2023-05-10T04:15:31.422 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-10T04:15:31.423 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-10T04:15:31.423 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2ef5137fbb6e28908d2161218e7b594628c1b6d3', 'tag': None, 'wait_for_package': False} 2023-05-10T04:15:31.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2ef5137fbb6e28908d2161218e7b594628c1b6d3 2023-05-10T04:15:31.426 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2ef5137fbb6e28908d2161218e7b594628c1b6d3', 'tag': None, 'wait_for_package': False} 2023-05-10T04:15:31.426 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2ef5137fbb6e28908d2161218e7b594628c1b6d3 2023-05-10T04:15:31.575 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.054005/2ef5137fbb6e28908d2161218e7b594628c1b6d3/centos/8/flavors/default/ 2023-05-10T04:15:31.576 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3851.g2ef5137f 2023-05-10T04:15:31.582 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.054005/2ef5137fbb6e28908d2161218e7b594628c1b6d3/centos/8/flavors/default/ 2023-05-10T04:15:31.583 INFO:teuthology.task.install.rpm:Package version is 18.0.0-3851.g2ef5137f 2023-05-10T04:15:31.684 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.054005/2ef5137fbb6e28908d2161218e7b594628c1b6d3/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.054005/2ef5137fbb6e28908d2161218e7b594628c1b6d3/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.054005/2ef5137fbb6e28908d2161218e7b594628c1b6d3/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-10T04:15:31.685 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:15:31.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-10T04:15:31.689 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.054005/2ef5137fbb6e28908d2161218e7b594628c1b6d3/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.054005/2ef5137fbb6e28908d2161218e7b594628c1b6d3/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20230509.054005/2ef5137fbb6e28908d2161218e7b594628c1b6d3/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-05-10T04:15:31.689 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:15:31.689 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-05-10T04:15:31.747 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-10T04:15:31.748 DEBUG:teuthology.orchestra.run.smithi154:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2ef5137fbb6e28908d2161218e7b594628c1b6d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-10T04:15:31.752 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-05-10T04:15:31.753 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2ef5137fbb6e28908d2161218e7b594628c1b6d3/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-05-10T04:15:31.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-10T04:15:31.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-05-10T04:15:31.936 DEBUG:teuthology.orchestra.run.smithi154:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-10T04:15:31.940 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-05-10T04:15:31.997 INFO:teuthology.orchestra.run.smithi154.stdout:check_obsoletes = 1 2023-05-10T04:15:32.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum clean all 2023-05-10T04:15:32.001 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2023-05-10T04:15:32.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2023-05-10T04:15:32.434 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2023-05-10T04:15:32.436 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-05-10T04:15:32.768 INFO:teuthology.orchestra.run.smithi132.stdout:44 files removed 2023-05-10T04:15:32.777 INFO:teuthology.orchestra.run.smithi154.stdout:44 files removed 2023-05-10T04:15:32.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-10T04:15:32.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-05-10T04:15:33.258 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2023-05-10T04:15:33.344 INFO:teuthology.orchestra.run.smithi154.stdout:Updating Subscription Management repositories. 2023-05-10T04:15:33.973 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 310 kB/s | 80 kB 00:00 2023-05-10T04:15:33.993 INFO:teuthology.orchestra.run.smithi154.stdout:ceph packages for x86_64 315 kB/s | 80 kB 00:00 2023-05-10T04:15:34.232 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 42 kB/s | 9.4 kB 00:00 2023-05-10T04:15:34.244 INFO:teuthology.orchestra.run.smithi154.stdout:ceph noarch packages 43 kB/s | 9.4 kB 00:00 2023-05-10T04:15:34.483 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-05-10T04:15:34.496 INFO:teuthology.orchestra.run.smithi154.stdout:ceph source packages 6.5 kB/s | 1.5 kB 00:00 2023-05-10T04:15:36.959 INFO:teuthology.orchestra.run.smithi132.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-10T04:15:37.012 INFO:teuthology.orchestra.run.smithi154.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2023-05-10T04:15:37.931 INFO:teuthology.orchestra.run.smithi154.stdout:Extra Packages for Enterprise Linux 15 MB/s | 14 MB 00:00 2023-05-10T04:15:41.563 INFO:teuthology.orchestra.run.smithi154.stdout:lab-extras 356 kB/s | 24 kB 00:00 2023-05-10T04:15:41.603 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 3.0 MB/s | 14 MB 00:04 2023-05-10T04:15:42.615 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 48 MB/s | 47 MB 00:00 2023-05-10T04:15:45.201 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 506 kB/s | 24 kB 00:00 2023-05-10T04:15:46.353 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-05-10T04:15:51.124 INFO:teuthology.orchestra.run.smithi154.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-05-10T04:15:55.171 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 38 MB/s | 47 MB 00:01 2023-05-10T04:16:02.649 INFO:teuthology.orchestra.run.smithi154.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-10T04:16:02.650 INFO:teuthology.orchestra.run.smithi154.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-10T04:16:02.665 INFO:teuthology.orchestra.run.smithi154.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-05-10T04:16:02.666 INFO:teuthology.orchestra.run.smithi154.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-05-10T04:16:02.667 INFO:teuthology.orchestra.run.smithi154.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-05-10T04:16:02.668 INFO:teuthology.orchestra.run.smithi154.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-10T04:16:02.671 INFO:teuthology.orchestra.run.smithi154.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-10T04:16:02.674 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-10T04:16:02.675 INFO:teuthology.orchestra.run.smithi154.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-10T04:16:02.814 INFO:teuthology.orchestra.run.smithi154.stdout:Dependencies resolved. 2023-05-10T04:16:02.826 INFO:teuthology.orchestra.run.smithi154.stdout:=========================================================================================================================== 2023-05-10T04:16:02.827 INFO:teuthology.orchestra.run.smithi154.stdout: Package Arch Version Repository Size 2023-05-10T04:16:02.827 INFO:teuthology.orchestra.run.smithi154.stdout:=========================================================================================================================== 2023-05-10T04:16:02.827 INFO:teuthology.orchestra.run.smithi154.stdout:Installing: 2023-05-10T04:16:02.827 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-05-10T04:16:02.827 INFO:teuthology.orchestra.run.smithi154.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-10T04:16:02.827 INFO:teuthology.orchestra.run.smithi154.stdout: ceph x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 6.4 k 2023-05-10T04:16:02.828 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 5.3 M 2023-05-10T04:16:02.828 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 848 k 2023-05-10T04:16:02.828 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 165 k 2023-05-10T04:16:02.828 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 1.5 M 2023-05-10T04:16:02.828 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 127 k 2023-05-10T04:16:02.828 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 1.7 M 2023-05-10T04:16:02.828 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 7.4 M 2023-05-10T04:16:02.829 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 47 k 2023-05-10T04:16:02.829 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 13 M 2023-05-10T04:16:02.829 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 41 M 2023-05-10T04:16:02.829 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 265 k 2023-05-10T04:16:02.829 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 83 k 2023-05-10T04:16:02.829 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 258 k 2023-05-10T04:16:02.829 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 18 k 2023-05-10T04:16:02.829 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-05-10T04:16:02.830 INFO:teuthology.orchestra.run.smithi154.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-10T04:16:02.830 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-10T04:16:02.830 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 31 k 2023-05-10T04:16:02.830 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 771 k 2023-05-10T04:16:02.830 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 139 k 2023-05-10T04:16:02.830 INFO:teuthology.orchestra.run.smithi154.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-10T04:16:02.830 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-05-10T04:16:02.831 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-10T04:16:02.831 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-05-10T04:16:02.831 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-05-10T04:16:02.831 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-05-10T04:16:02.831 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 198 k 2023-05-10T04:16:02.831 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 369 k 2023-05-10T04:16:02.831 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 365 k 2023-05-10T04:16:02.832 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 106 k 2023-05-10T04:16:02.832 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 94 k 2023-05-10T04:16:02.832 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 3.4 M 2023-05-10T04:16:02.832 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 179 k 2023-05-10T04:16:02.832 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-05-10T04:16:02.832 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrading: 2023-05-10T04:16:02.832 INFO:teuthology.orchestra.run.smithi154.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-05-10T04:16:02.833 INFO:teuthology.orchestra.run.smithi154.stdout: librados2 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 3.7 M 2023-05-10T04:16:02.833 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 3.6 M 2023-05-10T04:16:02.833 INFO:teuthology.orchestra.run.smithi154.stdout:Installing dependencies: 2023-05-10T04:16:02.833 INFO:teuthology.orchestra.run.smithi154.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-10T04:16:02.833 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 22 M 2023-05-10T04:16:02.833 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 23 k 2023-05-10T04:16:02.833 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 2.3 M 2023-05-10T04:16:02.834 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 240 k 2023-05-10T04:16:02.834 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 4.6 M 2023-05-10T04:16:02.834 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 18 M 2023-05-10T04:16:02.834 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 15 k 2023-05-10T04:16:02.834 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 24 k 2023-05-10T04:16:02.834 INFO:teuthology.orchestra.run.smithi154.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-10T04:16:02.835 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-10T04:16:02.835 INFO:teuthology.orchestra.run.smithi154.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-05-10T04:16:02.835 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-10T04:16:02.835 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-05-10T04:16:02.835 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 137 k 2023-05-10T04:16:02.835 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-05-10T04:16:02.835 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-05-10T04:16:02.835 INFO:teuthology.orchestra.run.smithi154.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-10T04:16:02.836 INFO:teuthology.orchestra.run.smithi154.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-05-10T04:16:02.836 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-05-10T04:16:02.836 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-10T04:16:02.836 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 474 k 2023-05-10T04:16:02.836 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-05-10T04:16:02.836 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 6.5 M 2023-05-10T04:16:02.837 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-10T04:16:02.837 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-05-10T04:16:02.837 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-10T04:16:02.837 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-10T04:16:02.837 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-10T04:16:02.837 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-10T04:16:02.837 INFO:teuthology.orchestra.run.smithi154.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-10T04:16:02.837 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-05-10T04:16:02.838 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-10T04:16:02.838 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-10T04:16:02.838 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-10T04:16:02.838 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-10T04:16:02.838 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-10T04:16:02.838 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-10T04:16:02.838 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-10T04:16:02.838 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-10T04:16:02.839 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 45 k 2023-05-10T04:16:02.839 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 119 k 2023-05-10T04:16:02.839 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-10T04:16:02.839 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-05-10T04:16:02.839 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-10T04:16:02.839 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-10T04:16:02.839 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-10T04:16:02.840 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-10T04:16:02.840 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-10T04:16:02.840 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-10T04:16:02.840 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-10T04:16:02.840 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-10T04:16:02.840 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-10T04:16:02.840 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-10T04:16:02.841 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-10T04:16:02.841 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-10T04:16:02.841 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-10T04:16:02.841 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-10T04:16:02.841 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-10T04:16:02.841 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-10T04:16:02.841 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-10T04:16:02.842 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-10T04:16:02.842 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-10T04:16:02.842 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-10T04:16:02.842 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-10T04:16:02.842 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-10T04:16:02.842 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-05-10T04:16:02.842 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-10T04:16:02.843 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-10T04:16:02.843 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-05-10T04:16:02.843 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-10T04:16:02.843 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-10T04:16:02.843 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-10T04:16:02.843 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-10T04:16:02.843 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-10T04:16:02.843 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-05-10T04:16:02.844 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-10T04:16:02.844 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-10T04:16:02.844 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-10T04:16:02.844 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-10T04:16:02.844 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-10T04:16:02.845 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-10T04:16:02.845 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-10T04:16:02.845 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-10T04:16:02.845 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-10T04:16:02.845 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-10T04:16:02.845 INFO:teuthology.orchestra.run.smithi154.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-05-10T04:16:02.845 INFO:teuthology.orchestra.run.smithi154.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-10T04:16:02.846 INFO:teuthology.orchestra.run.smithi154.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-05-10T04:16:02.846 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-10T04:16:02.846 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-10T04:16:02.846 INFO:teuthology.orchestra.run.smithi154.stdout:Enabling module streams: 2023-05-10T04:16:02.846 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql 10 2023-05-10T04:16:02.846 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:16:02.846 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction Summary 2023-05-10T04:16:02.847 INFO:teuthology.orchestra.run.smithi154.stdout:=========================================================================================================================== 2023-05-10T04:16:02.847 INFO:teuthology.orchestra.run.smithi154.stdout:Install 128 Packages 2023-05-10T04:16:02.847 INFO:teuthology.orchestra.run.smithi154.stdout:Upgrade 3 Packages 2023-05-10T04:16:02.847 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:16:02.848 INFO:teuthology.orchestra.run.smithi154.stdout:Total download size: 197 M 2023-05-10T04:16:02.848 INFO:teuthology.orchestra.run.smithi154.stdout:Downloading Packages: 2023-05-10T04:16:03.032 INFO:teuthology.orchestra.run.smithi154.stdout:(1/131): ceph-18.0.0-3851.g2ef5137f.el8.x86_64. 56 kB/s | 6.4 kB 00:00 2023-05-10T04:16:03.249 INFO:teuthology.orchestra.run.smithi154.stdout:(2/131): ceph-fuse-18.0.0-3851.g2ef5137f.el8.x8 3.8 MB/s | 848 kB 00:00 2023-05-10T04:16:03.341 INFO:teuthology.orchestra.run.smithi154.stdout:(3/131): ceph-immutable-object-cache-18.0.0-385 1.8 MB/s | 165 kB 00:00 2023-05-10T04:16:03.616 INFO:teuthology.orchestra.run.smithi154.stdout:(4/131): ceph-base-18.0.0-3851.g2ef5137f.el8.x8 7.6 MB/s | 5.3 MB 00:00 2023-05-10T04:16:03.683 INFO:teuthology.orchestra.run.smithi154.stdout:(5/131): ceph-mds-18.0.0-3851.g2ef5137f.el8.x86 6.7 MB/s | 2.3 MB 00:00 2023-05-10T04:16:03.958 INFO:teuthology.orchestra.run.smithi154.stdout:(6/131): ceph-mgr-18.0.0-3851.g2ef5137f.el8.x86 4.5 MB/s | 1.5 MB 00:00 2023-05-10T04:16:04.233 INFO:teuthology.orchestra.run.smithi154.stdout:(7/131): ceph-mon-18.0.0-3851.g2ef5137f.el8.x86 8.4 MB/s | 4.6 MB 00:00 2023-05-10T04:16:04.992 INFO:teuthology.orchestra.run.smithi154.stdout:(8/131): ceph-common-18.0.0-3851.g2ef5137f.el8. 10 MB/s | 22 MB 00:02 2023-05-10T04:16:05.059 INFO:teuthology.orchestra.run.smithi154.stdout:(9/131): ceph-selinux-18.0.0-3851.g2ef5137f.el8 367 kB/s | 24 kB 00:00 2023-05-10T04:16:05.617 INFO:teuthology.orchestra.run.smithi154.stdout:(10/131): ceph-radosgw-18.0.0-3851.g2ef5137f.el 9.4 MB/s | 13 MB 00:01 2023-05-10T04:16:05.693 INFO:teuthology.orchestra.run.smithi154.stdout:(11/131): cephfs-mirror-18.0.0-3851.g2ef5137f.e 3.4 MB/s | 258 kB 00:00 2023-05-10T04:16:05.768 INFO:teuthology.orchestra.run.smithi154.stdout:(12/131): libcephfs-devel-18.0.0-3851.g2ef5137f 415 kB/s | 31 kB 00:00 2023-05-10T04:16:05.918 INFO:teuthology.orchestra.run.smithi154.stdout:(13/131): libcephfs2-18.0.0-3851.g2ef5137f.el8. 5.0 MB/s | 771 kB 00:00 2023-05-10T04:16:05.994 INFO:teuthology.orchestra.run.smithi154.stdout:(14/131): libcephsqlite-18.0.0-3851.g2ef5137f.e 1.8 MB/s | 137 kB 00:00 2023-05-10T04:16:06.069 INFO:teuthology.orchestra.run.smithi154.stdout:(15/131): librados-devel-18.0.0-3851.g2ef5137f. 1.8 MB/s | 139 kB 00:00 2023-05-10T04:16:06.252 INFO:teuthology.orchestra.run.smithi154.stdout:(16/131): ceph-osd-18.0.0-3851.g2ef5137f.el8.x8 7.7 MB/s | 18 MB 00:02 2023-05-10T04:16:06.286 INFO:teuthology.orchestra.run.smithi154.stdout:(17/131): libradosstriper1-18.0.0-3851.g2ef5137 2.1 MB/s | 474 kB 00:00 2023-05-10T04:16:06.353 INFO:teuthology.orchestra.run.smithi154.stdout:(18/131): python3-ceph-argparse-18.0.0-3851.g2e 673 kB/s | 45 kB 00:00 2023-05-10T04:16:06.428 INFO:teuthology.orchestra.run.smithi154.stdout:(19/131): python3-ceph-common-18.0.0-3851.g2ef5 1.6 MB/s | 119 kB 00:00 2023-05-10T04:16:06.512 INFO:teuthology.orchestra.run.smithi154.stdout:(20/131): python3-cephfs-18.0.0-3851.g2ef5137f. 2.3 MB/s | 198 kB 00:00 2023-05-10T04:16:06.579 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-10T04:16:06.580 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-05-10T04:16:06.595 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-05-10T04:16:06.596 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-05-10T04:16:06.597 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-05-10T04:16:06.599 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-10T04:16:06.601 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-10T04:16:06.603 INFO:teuthology.orchestra.run.smithi154.stdout:(21/131): python3-rados-18.0.0-3851.g2ef5137f.e 4.0 MB/s | 369 kB 00:00 2023-05-10T04:16:06.604 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-10T04:16:06.605 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-10T04:16:06.704 INFO:teuthology.orchestra.run.smithi154.stdout:(22/131): python3-rbd-18.0.0-3851.g2ef5137f.el8 3.6 MB/s | 365 kB 00:00 2023-05-10T04:16:06.745 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-05-10T04:16:06.758 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================================================== 2023-05-10T04:16:06.759 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2023-05-10T04:16:06.759 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================================================== 2023-05-10T04:16:06.759 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2023-05-10T04:16:06.759 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-05-10T04:16:06.759 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-05-10T04:16:06.760 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 6.4 k 2023-05-10T04:16:06.760 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 5.3 M 2023-05-10T04:16:06.760 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 848 k 2023-05-10T04:16:06.760 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 165 k 2023-05-10T04:16:06.760 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 1.5 M 2023-05-10T04:16:06.760 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 127 k 2023-05-10T04:16:06.760 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 1.7 M 2023-05-10T04:16:06.761 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 7.4 M 2023-05-10T04:16:06.761 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 47 k 2023-05-10T04:16:06.761 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 13 M 2023-05-10T04:16:06.761 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 41 M 2023-05-10T04:16:06.761 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 265 k 2023-05-10T04:16:06.761 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 83 k 2023-05-10T04:16:06.761 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 258 k 2023-05-10T04:16:06.762 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 18 k 2023-05-10T04:16:06.762 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-05-10T04:16:06.762 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-05-10T04:16:06.762 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-05-10T04:16:06.762 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 31 k 2023-05-10T04:16:06.762 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 771 k 2023-05-10T04:16:06.762 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 139 k 2023-05-10T04:16:06.762 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-05-10T04:16:06.763 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-05-10T04:16:06.763 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-05-10T04:16:06.763 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-05-10T04:16:06.763 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-05-10T04:16:06.763 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-05-10T04:16:06.763 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 198 k 2023-05-10T04:16:06.764 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 369 k 2023-05-10T04:16:06.764 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 365 k 2023-05-10T04:16:06.764 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 106 k 2023-05-10T04:16:06.764 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 94 k 2023-05-10T04:16:06.764 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 3.4 M 2023-05-10T04:16:06.764 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 179 k 2023-05-10T04:16:06.764 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-05-10T04:16:06.764 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2023-05-10T04:16:06.765 INFO:teuthology.orchestra.run.smithi132.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-05-10T04:16:06.765 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 3.7 M 2023-05-10T04:16:06.765 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 3.6 M 2023-05-10T04:16:06.765 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2023-05-10T04:16:06.765 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-05-10T04:16:06.765 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 22 M 2023-05-10T04:16:06.765 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 23 k 2023-05-10T04:16:06.766 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 2.3 M 2023-05-10T04:16:06.766 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 240 k 2023-05-10T04:16:06.766 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 4.6 M 2023-05-10T04:16:06.766 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 18 M 2023-05-10T04:16:06.766 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:18.0.0-3851.g2ef5137f.el8 ceph-noarch 15 k 2023-05-10T04:16:06.766 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 24 k 2023-05-10T04:16:06.766 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-05-10T04:16:06.766 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-05-10T04:16:06.767 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-05-10T04:16:06.767 INFO:teuthology.orchestra.run.smithi132.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-05-10T04:16:06.767 INFO:teuthology.orchestra.run.smithi132.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-05-10T04:16:06.767 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 137 k 2023-05-10T04:16:06.767 INFO:teuthology.orchestra.run.smithi132.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-05-10T04:16:06.767 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-05-10T04:16:06.767 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-05-10T04:16:06.767 INFO:teuthology.orchestra.run.smithi132.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-05-10T04:16:06.768 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-05-10T04:16:06.768 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-05-10T04:16:06.768 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 474 k 2023-05-10T04:16:06.768 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-05-10T04:16:06.768 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 6.5 M 2023-05-10T04:16:06.768 INFO:teuthology.orchestra.run.smithi132.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-05-10T04:16:06.769 INFO:teuthology.orchestra.run.smithi132.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-05-10T04:16:06.769 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-05-10T04:16:06.769 INFO:teuthology.orchestra.run.smithi132.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-05-10T04:16:06.769 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-05-10T04:16:06.769 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-05-10T04:16:06.769 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-05-10T04:16:06.769 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-05-10T04:16:06.769 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-05-10T04:16:06.770 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-05-10T04:16:06.770 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-05-10T04:16:06.770 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-05-10T04:16:06.770 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-05-10T04:16:06.770 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-05-10T04:16:06.770 INFO:teuthology.orchestra.run.smithi132.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-05-10T04:16:06.770 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-05-10T04:16:06.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 45 k 2023-05-10T04:16:06.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:18.0.0-3851.g2ef5137f.el8 ceph 119 k 2023-05-10T04:16:06.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-05-10T04:16:06.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-05-10T04:16:06.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-05-10T04:16:06.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-05-10T04:16:06.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-05-10T04:16:06.771 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-05-10T04:16:06.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-05-10T04:16:06.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-05-10T04:16:06.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-10T04:16:06.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-05-10T04:16:06.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-05-10T04:16:06.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-10T04:16:06.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-05-10T04:16:06.772 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-05-10T04:16:06.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-05-10T04:16:06.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-05-10T04:16:06.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-05-10T04:16:06.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-05-10T04:16:06.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-05-10T04:16:06.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-05-10T04:16:06.773 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-05-10T04:16:06.774 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-05-10T04:16:06.774 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-05-10T04:16:06.774 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-05-10T04:16:06.774 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-05-10T04:16:06.774 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-05-10T04:16:06.774 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-10T04:16:06.774 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-05-10T04:16:06.774 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-05-10T04:16:06.775 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-05-10T04:16:06.775 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-05-10T04:16:06.775 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-05-10T04:16:06.775 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-05-10T04:16:06.775 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-05-10T04:16:06.775 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-05-10T04:16:06.775 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-05-10T04:16:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-05-10T04:16:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-05-10T04:16:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2023-05-10T04:16:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-05-10T04:16:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-05-10T04:16:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-05-10T04:16:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-05-10T04:16:06.776 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-05-10T04:16:06.777 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-05-10T04:16:06.777 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-05-10T04:16:06.777 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-05-10T04:16:06.777 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-05-10T04:16:06.777 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-05-10T04:16:06.777 INFO:teuthology.orchestra.run.smithi132.stdout:Enabling module streams: 2023-05-10T04:16:06.777 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql 10 2023-05-10T04:16:06.778 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:16:06.778 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-05-10T04:16:06.778 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================================================== 2023-05-10T04:16:06.778 INFO:teuthology.orchestra.run.smithi132.stdout:Install 128 Packages 2023-05-10T04:16:06.778 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 3 Packages 2023-05-10T04:16:06.778 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:16:06.779 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 197 M 2023-05-10T04:16:06.779 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-05-10T04:16:06.787 INFO:teuthology.orchestra.run.smithi154.stdout:(23/131): python3-rgw-18.0.0-3851.g2ef5137f.el8 1.3 MB/s | 106 kB 00:00 2023-05-10T04:16:06.871 INFO:teuthology.orchestra.run.smithi154.stdout:(24/131): rbd-fuse-18.0.0-3851.g2ef5137f.el8.x8 1.1 MB/s | 94 kB 00:00 2023-05-10T04:16:06.955 INFO:teuthology.orchestra.run.smithi154.stdout:(25/131): librgw2-18.0.0-3851.g2ef5137f.el8.x86 9.3 MB/s | 6.5 MB 00:00 2023-05-10T04:16:07.038 INFO:teuthology.orchestra.run.smithi154.stdout:(26/131): rbd-nbd-18.0.0-3851.g2ef5137f.el8.x86 2.1 MB/s | 179 kB 00:00 2023-05-10T04:16:07.106 INFO:teuthology.orchestra.run.smithi154.stdout:(27/131): ceph-grafana-dashboards-18.0.0-3851.g 346 kB/s | 23 kB 00:00 2023-05-10T04:16:07.154 INFO:teuthology.orchestra.run.smithi132.stdout:(1/131): ceph-18.0.0-3851.g2ef5137f.el8.x86_64. 27 kB/s | 6.4 kB 00:00 2023-05-10T04:16:07.189 INFO:teuthology.orchestra.run.smithi154.stdout:(28/131): ceph-mgr-cephadm-18.0.0-3851.g2ef5137 1.5 MB/s | 127 kB 00:00 2023-05-10T04:16:07.256 INFO:teuthology.orchestra.run.smithi154.stdout:(29/131): rbd-mirror-18.0.0-3851.g2ef5137f.el8. 9.0 MB/s | 3.4 MB 00:00 2023-05-10T04:16:07.609 INFO:teuthology.orchestra.run.smithi154.stdout:(30/131): ceph-mgr-dashboard-18.0.0-3851.g2ef51 4.1 MB/s | 1.7 MB 00:00 2023-05-10T04:16:07.699 INFO:teuthology.orchestra.run.smithi154.stdout:(31/131): ceph-mgr-modules-core-18.0.0-3851.g2e 2.6 MB/s | 240 kB 00:00 2023-05-10T04:16:07.722 INFO:teuthology.orchestra.run.smithi132.stdout:(2/131): ceph-fuse-18.0.0-3851.g2ef5137f.el8.x8 1.5 MB/s | 848 kB 00:00 2023-05-10T04:16:07.790 INFO:teuthology.orchestra.run.smithi154.stdout:(32/131): ceph-mgr-rook-18.0.0-3851.g2ef5137f.e 520 kB/s | 47 kB 00:00 2023-05-10T04:16:07.838 INFO:teuthology.orchestra.run.smithi132.stdout:(3/131): ceph-immutable-object-cache-18.0.0-385 1.4 MB/s | 165 kB 00:00 2023-05-10T04:16:07.874 INFO:teuthology.orchestra.run.smithi154.stdout:(33/131): ceph-prometheus-alerts-18.0.0-3851.g2 175 kB/s | 15 kB 00:00 2023-05-10T04:16:07.966 INFO:teuthology.orchestra.run.smithi154.stdout:(34/131): ceph-volume-18.0.0-3851.g2ef5137f.el8 2.8 MB/s | 265 kB 00:00 2023-05-10T04:16:08.364 INFO:teuthology.orchestra.run.smithi132.stdout:(4/131): ceph-base-18.0.0-3851.g2ef5137f.el8.x8 3.7 MB/s | 5.3 MB 00:01 2023-05-10T04:16:08.375 INFO:teuthology.orchestra.run.smithi154.stdout:(35/131): ceph-test-18.0.0-3851.g2ef5137f.el8.x 12 MB/s | 41 MB 00:03 2023-05-10T04:16:08.400 INFO:teuthology.orchestra.run.smithi154.stdout:(36/131): cephadm-18.0.0-3851.g2ef5137f.el8.noa 192 kB/s | 83 kB 00:00 2023-05-10T04:16:08.426 INFO:teuthology.orchestra.run.smithi154.stdout:(37/131): cephfs-top-18.0.0-3851.g2ef5137f.el8. 360 kB/s | 18 kB 00:00 2023-05-10T04:16:08.472 INFO:teuthology.orchestra.run.smithi132.stdout:(5/131): ceph-mds-18.0.0-3851.g2ef5137f.el8.x86 3.6 MB/s | 2.3 MB 00:00 2023-05-10T04:16:08.525 INFO:teuthology.orchestra.run.smithi154.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 5.8 MB/s | 7.4 MB 00:01 2023-05-10T04:16:08.589 INFO:teuthology.orchestra.run.smithi132.stdout:(6/131): ceph-mgr-18.0.0-3851.g2ef5137f.el8.x86 6.9 MB/s | 1.5 MB 00:00 2023-05-10T04:16:08.676 INFO:teuthology.orchestra.run.smithi154.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 235 kB/s | 59 kB 00:00 2023-05-10T04:16:08.743 INFO:teuthology.orchestra.run.smithi154.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 361 kB/s | 75 kB 00:00 2023-05-10T04:16:08.801 INFO:teuthology.orchestra.run.smithi154.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 764 kB/s | 306 kB 00:00 2023-05-10T04:16:08.827 INFO:teuthology.orchestra.run.smithi154.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 519 kB/s | 44 kB 00:00 2023-05-10T04:16:08.877 INFO:teuthology.orchestra.run.smithi154.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 661 kB/s | 33 kB 00:00 2023-05-10T04:16:08.903 INFO:teuthology.orchestra.run.smithi154.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-05-10T04:16:08.927 INFO:teuthology.orchestra.run.smithi154.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-05-10T04:16:08.953 INFO:teuthology.orchestra.run.smithi154.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-05-10T04:16:09.012 INFO:teuthology.orchestra.run.smithi154.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.0 MB/s | 173 kB 00:00 2023-05-10T04:16:09.037 INFO:teuthology.orchestra.run.smithi154.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 972 kB/s | 81 kB 00:00 2023-05-10T04:16:09.062 INFO:teuthology.orchestra.run.smithi154.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-05-10T04:16:09.087 INFO:teuthology.orchestra.run.smithi154.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-05-10T04:16:09.112 INFO:teuthology.orchestra.run.smithi154.stdout:(51/131): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-05-10T04:16:09.138 INFO:teuthology.orchestra.run.smithi154.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 976 kB/s | 49 kB 00:00 2023-05-10T04:16:09.163 INFO:teuthology.orchestra.run.smithi154.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-05-10T04:16:09.188 INFO:teuthology.orchestra.run.smithi154.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-05-10T04:16:09.239 INFO:teuthology.orchestra.run.smithi154.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 313 kB/s | 16 kB 00:00 2023-05-10T04:16:09.265 INFO:teuthology.orchestra.run.smithi132.stdout:(7/131): ceph-mon-18.0.0-3851.g2ef5137f.el8.x86 5.8 MB/s | 4.6 MB 00:00 2023-05-10T04:16:09.289 INFO:teuthology.orchestra.run.smithi154.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 674 kB/s | 34 kB 00:00 2023-05-10T04:16:09.323 INFO:teuthology.orchestra.run.smithi154.stdout:(57/131): python3-kubernetes-11.0.0-6.el8.noarc 4.5 MB/s | 1.2 MB 00:00 2023-05-10T04:16:09.348 INFO:teuthology.orchestra.run.smithi154.stdout:(58/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2023-05-10T04:16:09.365 INFO:teuthology.orchestra.run.smithi154.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 1.4 MB/s | 61 kB 00:00 2023-05-10T04:16:09.390 INFO:teuthology.orchestra.run.smithi154.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.9 MB/s | 196 kB 00:00 2023-05-10T04:16:09.407 INFO:teuthology.orchestra.run.smithi154.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 319 kB/s | 19 kB 00:00 2023-05-10T04:16:09.424 INFO:teuthology.orchestra.run.smithi154.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 408 kB/s | 24 kB 00:00 2023-05-10T04:16:09.450 INFO:teuthology.orchestra.run.smithi154.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 497 kB/s | 29 kB 00:00 2023-05-10T04:16:09.466 INFO:teuthology.orchestra.run.smithi154.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 469 kB/s | 27 kB 00:00 2023-05-10T04:16:09.517 INFO:teuthology.orchestra.run.smithi154.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 2.6 MB/s | 241 kB 00:00 2023-05-10T04:16:09.534 INFO:teuthology.orchestra.run.smithi154.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 913 kB/s | 61 kB 00:00 2023-05-10T04:16:09.562 INFO:teuthology.orchestra.run.smithi154.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-05-10T04:16:09.584 INFO:teuthology.orchestra.run.smithi154.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.2 MB/s | 85 kB 00:00 2023-05-10T04:16:09.609 INFO:teuthology.orchestra.run.smithi154.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 305 kB/s | 23 kB 00:00 2023-05-10T04:16:09.635 INFO:teuthology.orchestra.run.smithi154.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-05-10T04:16:09.694 INFO:teuthology.orchestra.run.smithi154.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.0 MB/s | 110 kB 00:00 2023-05-10T04:16:09.735 INFO:teuthology.orchestra.run.smithi154.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-05-10T04:16:09.777 INFO:teuthology.orchestra.run.smithi154.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-05-10T04:16:09.819 INFO:teuthology.orchestra.run.smithi154.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-05-10T04:16:09.853 INFO:teuthology.orchestra.run.smithi154.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-05-10T04:16:09.912 INFO:teuthology.orchestra.run.smithi154.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-05-10T04:16:09.962 INFO:teuthology.orchestra.run.smithi154.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 11 MB/s | 538 kB 00:00 2023-05-10T04:16:10.004 INFO:teuthology.orchestra.run.smithi154.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-05-10T04:16:10.046 INFO:teuthology.orchestra.run.smithi154.stdout:(79/131): thrift-0.13.0-2.el8.x86_64.rpm 3.6 MB/s | 1.7 MB 00:00 2023-05-10T04:16:10.079 INFO:teuthology.orchestra.run.smithi154.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2023-05-10T04:16:10.155 INFO:teuthology.orchestra.run.smithi154.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 6.4 MB/s | 713 kB 00:00 2023-05-10T04:16:10.197 INFO:teuthology.orchestra.run.smithi154.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 641 kB/s | 27 kB 00:00 2023-05-10T04:16:10.239 INFO:teuthology.orchestra.run.smithi154.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-05-10T04:16:10.273 INFO:teuthology.orchestra.run.smithi154.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-05-10T04:16:10.281 INFO:teuthology.orchestra.run.smithi132.stdout:(8/131): ceph-common-18.0.0-3851.g2ef5137f.el8. 6.4 MB/s | 22 MB 00:03 2023-05-10T04:16:10.431 INFO:teuthology.orchestra.run.smithi154.stdout:(85/131): python3-scipy-1.0.0-21.module+el8.5.0 17 MB/s | 14 MB 00:00 2023-05-10T04:16:10.473 INFO:teuthology.orchestra.run.smithi132.stdout:(9/131): ceph-osd-18.0.0-3851.g2ef5137f.el8.x86 9.4 MB/s | 18 MB 00:01 2023-05-10T04:16:10.481 INFO:teuthology.orchestra.run.smithi154.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-05-10T04:16:10.491 INFO:teuthology.orchestra.run.smithi132.stdout:(10/131): ceph-selinux-18.0.0-3851.g2ef5137f.el 116 kB/s | 24 kB 00:00 2023-05-10T04:16:10.548 INFO:teuthology.orchestra.run.smithi154.stdout:(87/131): python3-babel-2.5.1-7.el8.noarch.rpm 10 MB/s | 4.8 MB 00:00 2023-05-10T04:16:10.557 INFO:teuthology.orchestra.run.smithi132.stdout:(11/131): cephfs-mirror-18.0.0-3851.g2ef5137f.e 3.8 MB/s | 258 kB 00:00 2023-05-10T04:16:10.582 INFO:teuthology.orchestra.run.smithi154.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2023-05-10T04:16:10.599 INFO:teuthology.orchestra.run.smithi132.stdout:(12/131): libcephfs-devel-18.0.0-3851.g2ef5137f 750 kB/s | 31 kB 00:00 2023-05-10T04:16:10.607 INFO:teuthology.orchestra.run.smithi154.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2023-05-10T04:16:10.633 INFO:teuthology.orchestra.run.smithi154.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-05-10T04:16:10.658 INFO:teuthology.orchestra.run.smithi154.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 396 kB/s | 20 kB 00:00 2023-05-10T04:16:10.683 INFO:teuthology.orchestra.run.smithi154.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-05-10T04:16:10.725 INFO:teuthology.orchestra.run.smithi132.stdout:(13/131): libcephfs2-18.0.0-3851.g2ef5137f.el8. 6.0 MB/s | 771 kB 00:00 2023-05-10T04:16:10.733 INFO:teuthology.orchestra.run.smithi154.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 9.2 MB/s | 709 kB 00:00 2023-05-10T04:16:10.775 INFO:teuthology.orchestra.run.smithi154.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-05-10T04:16:10.783 INFO:teuthology.orchestra.run.smithi132.stdout:(14/131): libcephsqlite-18.0.0-3851.g2ef5137f.e 2.3 MB/s | 137 kB 00:00 2023-05-10T04:16:10.842 INFO:teuthology.orchestra.run.smithi132.stdout:(15/131): librados-devel-18.0.0-3851.g2ef5137f. 2.3 MB/s | 139 kB 00:00 2023-05-10T04:16:10.851 INFO:teuthology.orchestra.run.smithi154.stdout:(95/131): python3-numpy-1.14.3-10.el8.x86_64.rp 6.5 MB/s | 3.7 MB 00:00 2023-05-10T04:16:10.893 INFO:teuthology.orchestra.run.smithi154.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-05-10T04:16:10.926 INFO:teuthology.orchestra.run.smithi132.stdout:(16/131): libradosstriper1-18.0.0-3851.g2ef5137 5.6 MB/s | 474 kB 00:00 2023-05-10T04:16:10.943 INFO:teuthology.orchestra.run.smithi154.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2023-05-10T04:16:11.044 INFO:teuthology.orchestra.run.smithi154.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 13 MB/s | 4.9 MB 00:00 2023-05-10T04:16:11.136 INFO:teuthology.orchestra.run.smithi154.stdout:(99/131): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-05-10T04:16:11.169 INFO:teuthology.orchestra.run.smithi154.stdout:(100/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-05-10T04:16:11.219 INFO:teuthology.orchestra.run.smithi154.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 941 kB/s | 47 kB 00:00 2023-05-10T04:16:11.261 INFO:teuthology.orchestra.run.smithi154.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-05-10T04:16:11.287 INFO:teuthology.orchestra.run.smithi154.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-05-10T04:16:11.312 INFO:teuthology.orchestra.run.smithi154.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-05-10T04:16:11.345 INFO:teuthology.orchestra.run.smithi154.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-05-10T04:16:11.371 INFO:teuthology.orchestra.run.smithi154.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 826 kB/s | 48 kB 00:00 2023-05-10T04:16:11.396 INFO:teuthology.orchestra.run.smithi154.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-05-10T04:16:11.401 INFO:teuthology.orchestra.run.smithi132.stdout:(17/131): ceph-radosgw-18.0.0-3851.g2ef5137f.el 6.1 MB/s | 13 MB 00:02 2023-05-10T04:16:11.421 INFO:teuthology.orchestra.run.smithi154.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 848 kB/s | 43 kB 00:00 2023-05-10T04:16:11.446 INFO:teuthology.orchestra.run.smithi154.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-05-10T04:16:11.459 INFO:teuthology.orchestra.run.smithi132.stdout:(18/131): python3-ceph-argparse-18.0.0-3851.g2e 773 kB/s | 45 kB 00:00 2023-05-10T04:16:11.472 INFO:teuthology.orchestra.run.smithi154.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-05-10T04:16:11.518 INFO:teuthology.orchestra.run.smithi132.stdout:(19/131): python3-ceph-common-18.0.0-3851.g2ef5 2.0 MB/s | 119 kB 00:00 2023-05-10T04:16:11.539 INFO:teuthology.orchestra.run.smithi154.stdout:(111/131): postgresql-server-10.21-2.module+el8 8.5 MB/s | 5.1 MB 00:00 2023-05-10T04:16:11.564 INFO:teuthology.orchestra.run.smithi154.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 204 kB/s | 19 kB 00:00 2023-05-10T04:16:11.576 INFO:teuthology.orchestra.run.smithi132.stdout:(20/131): python3-cephfs-18.0.0-3851.g2ef5137f. 3.3 MB/s | 198 kB 00:00 2023-05-10T04:16:11.589 INFO:teuthology.orchestra.run.smithi154.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-05-10T04:16:11.623 INFO:teuthology.orchestra.run.smithi154.stdout:(114/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.1 MB/s | 560 kB 00:00 2023-05-10T04:16:11.648 INFO:teuthology.orchestra.run.smithi154.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-05-10T04:16:11.669 INFO:teuthology.orchestra.run.smithi132.stdout:(21/131): python3-rados-18.0.0-3851.g2ef5137f.e 3.9 MB/s | 369 kB 00:00 2023-05-10T04:16:11.757 INFO:teuthology.orchestra.run.smithi154.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 2.8 MB/s | 559 kB 00:00 2023-05-10T04:16:11.769 INFO:teuthology.orchestra.run.smithi132.stdout:(22/131): librgw2-18.0.0-3851.g2ef5137f.el8.x86 7.7 MB/s | 6.5 MB 00:00 2023-05-10T04:16:11.790 INFO:teuthology.orchestra.run.smithi154.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 1.6 MB/s | 238 kB 00:00 2023-05-10T04:16:11.811 INFO:teuthology.orchestra.run.smithi132.stdout:(23/131): python3-rbd-18.0.0-3851.g2ef5137f.el8 2.5 MB/s | 365 kB 00:00 2023-05-10T04:16:11.815 INFO:teuthology.orchestra.run.smithi154.stdout:(118/131): pcre2-devel-10.32-2.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-05-10T04:16:11.836 INFO:teuthology.orchestra.run.smithi132.stdout:(24/131): python3-rgw-18.0.0-3851.g2ef5137f.el8 1.6 MB/s | 106 kB 00:00 2023-05-10T04:16:11.841 INFO:teuthology.orchestra.run.smithi154.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.4 MB/s | 72 kB 00:00 2023-05-10T04:16:11.861 INFO:teuthology.orchestra.run.smithi132.stdout:(25/131): rbd-fuse-18.0.0-3851.g2ef5137f.el8.x8 1.8 MB/s | 94 kB 00:00 2023-05-10T04:16:11.866 INFO:teuthology.orchestra.run.smithi154.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-05-10T04:16:11.891 INFO:teuthology.orchestra.run.smithi154.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-05-10T04:16:11.917 INFO:teuthology.orchestra.run.smithi154.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-05-10T04:16:11.920 INFO:teuthology.orchestra.run.smithi132.stdout:(26/131): rbd-nbd-18.0.0-3851.g2ef5137f.el8.x86 3.0 MB/s | 179 kB 00:00 2023-05-10T04:16:11.942 INFO:teuthology.orchestra.run.smithi154.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-05-10T04:16:11.967 INFO:teuthology.orchestra.run.smithi154.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 770 kB/s | 39 kB 00:00 2023-05-10T04:16:11.979 INFO:teuthology.orchestra.run.smithi132.stdout:(27/131): ceph-grafana-dashboards-18.0.0-3851.g 395 kB/s | 23 kB 00:00 2023-05-10T04:16:12.009 INFO:teuthology.orchestra.run.smithi154.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-05-10T04:16:12.034 INFO:teuthology.orchestra.run.smithi154.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-05-10T04:16:12.037 INFO:teuthology.orchestra.run.smithi132.stdout:(28/131): ceph-mgr-cephadm-18.0.0-3851.g2ef5137 2.1 MB/s | 127 kB 00:00 2023-05-10T04:16:12.060 INFO:teuthology.orchestra.run.smithi154.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.6 MB/s | 138 kB 00:00 2023-05-10T04:16:12.110 INFO:teuthology.orchestra.run.smithi154.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 6.6 MB/s | 2.3 MB 00:00 2023-05-10T04:16:12.177 INFO:teuthology.orchestra.run.smithi154.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-05-10T04:16:12.304 INFO:teuthology.orchestra.run.smithi132.stdout:(29/131): rbd-mirror-18.0.0-3851.g2ef5137f.el8. 7.4 MB/s | 3.4 MB 00:00 2023-05-10T04:16:12.438 INFO:teuthology.orchestra.run.smithi132.stdout:(30/131): ceph-mgr-dashboard-18.0.0-3851.g2ef51 4.3 MB/s | 1.7 MB 00:00 2023-05-10T04:16:12.586 INFO:teuthology.orchestra.run.smithi154.stdout:(130/131): librados2-18.0.0-3851.g2ef5137f.el8. 6.6 MB/s | 3.7 MB 00:00 2023-05-10T04:16:12.597 INFO:teuthology.orchestra.run.smithi132.stdout:(31/131): ceph-mgr-modules-core-18.0.0-3851.g2e 1.5 MB/s | 240 kB 00:00 2023-05-10T04:16:12.653 INFO:teuthology.orchestra.run.smithi154.stdout:(131/131): librbd1-18.0.0-3851.g2ef5137f.el8.x8 6.0 MB/s | 3.6 MB 00:00 2023-05-10T04:16:12.655 INFO:teuthology.orchestra.run.smithi132.stdout:(32/131): ceph-mgr-rook-18.0.0-3851.g2ef5137f.e 816 kB/s | 47 kB 00:00 2023-05-10T04:16:12.656 INFO:teuthology.orchestra.run.smithi154.stdout:-------------------------------------------------------------------------------- 2023-05-10T04:16:12.657 INFO:teuthology.orchestra.run.smithi154.stdout:Total 20 MB/s | 197 MB 00:09 2023-05-10T04:16:12.706 INFO:teuthology.orchestra.run.smithi132.stdout:(33/131): ceph-prometheus-alerts-18.0.0-3851.g2 291 kB/s | 15 kB 00:00 2023-05-10T04:16:12.789 INFO:teuthology.orchestra.run.smithi132.stdout:(34/131): ceph-volume-18.0.0-3851.g2ef5137f.el8 3.1 MB/s | 265 kB 00:00 2023-05-10T04:16:12.848 INFO:teuthology.orchestra.run.smithi132.stdout:(35/131): cephadm-18.0.0-3851.g2ef5137f.el8.noa 1.4 MB/s | 83 kB 00:00 2023-05-10T04:16:12.898 INFO:teuthology.orchestra.run.smithi132.stdout:(36/131): cephfs-top-18.0.0-3851.g2ef5137f.el8. 360 kB/s | 18 kB 00:00 2023-05-10T04:16:13.240 INFO:teuthology.orchestra.run.smithi132.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 7.9 MB/s | 7.4 MB 00:00 2023-05-10T04:16:13.766 INFO:teuthology.orchestra.run.smithi132.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 112 kB/s | 59 kB 00:00 2023-05-10T04:16:13.866 INFO:teuthology.orchestra.run.smithi132.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 317 kB/s | 306 kB 00:00 2023-05-10T04:16:13.974 INFO:teuthology.orchestra.run.smithi132.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 360 kB/s | 75 kB 00:00 2023-05-10T04:16:14.108 INFO:teuthology.orchestra.run.smithi132.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 327 kB/s | 44 kB 00:00 2023-05-10T04:16:14.149 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction check 2023-05-10T04:16:14.284 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction check succeeded. 2023-05-10T04:16:14.285 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction test 2023-05-10T04:16:14.400 INFO:teuthology.orchestra.run.smithi132.stdout:(42/131): python3-beautifulsoup4-4.6.3-2.el8.1. 635 kB/s | 185 kB 00:00 2023-05-10T04:16:14.500 INFO:teuthology.orchestra.run.smithi132.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 330 kB/s | 33 kB 00:00 2023-05-10T04:16:14.567 INFO:teuthology.orchestra.run.smithi132.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 678 kB/s | 476 kB 00:00 2023-05-10T04:16:14.609 INFO:teuthology.orchestra.run.smithi132.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 150 kB/s | 16 kB 00:00 2023-05-10T04:16:14.921 INFO:teuthology.orchestra.run.smithi132.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 487 kB/s | 173 kB 00:00 2023-05-10T04:16:15.452 INFO:teuthology.orchestra.run.smithi132.stdout:(47/131): ceph-test-18.0.0-3851.g2ef5137f.el8.x 8.2 MB/s | 41 MB 00:04 2023-05-10T04:16:15.477 INFO:teuthology.orchestra.run.smithi132.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 146 kB/s | 81 kB 00:00 2023-05-10T04:16:15.502 INFO:teuthology.orchestra.run.smithi132.stdout:(49/131): python3-cherrypy-18.4.0-1.el8.noarch. 431 kB/s | 384 kB 00:00 2023-05-10T04:16:15.561 INFO:teuthology.orchestra.run.smithi132.stdout:(50/131): python3-jaraco-6.2-6.el8.noarch.rpm 102 kB/s | 11 kB 00:00 2023-05-10T04:16:15.678 INFO:teuthology.orchestra.run.smithi132.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 435 kB/s | 49 kB 00:00 2023-05-10T04:16:15.786 INFO:teuthology.orchestra.run.smithi132.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 546 kB/s | 59 kB 00:00 2023-05-10T04:16:15.895 INFO:teuthology.orchestra.run.smithi132.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 555 kB/s | 60 kB 00:00 2023-05-10T04:16:15.954 INFO:teuthology.orchestra.run.smithi132.stdout:(54/131): python3-jaraco-functools-2.0-4.el8.no 37 kB/s | 18 kB 00:00 2023-05-10T04:16:16.004 INFO:teuthology.orchestra.run.smithi154.stdout:Transaction test succeeded. 2023-05-10T04:16:16.009 INFO:teuthology.orchestra.run.smithi154.stdout:Running transaction 2023-05-10T04:16:16.062 INFO:teuthology.orchestra.run.smithi132.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-05-10T04:16:16.255 INFO:teuthology.orchestra.run.smithi132.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 175 kB/s | 34 kB 00:00 2023-05-10T04:16:16.338 INFO:teuthology.orchestra.run.smithi132.stdout:(57/131): python3-pecan-1.3.2-9.el8.noarch.rpm 638 kB/s | 283 kB 00:00 2023-05-10T04:16:16.455 INFO:teuthology.orchestra.run.smithi132.stdout:(58/131): python3-rsa-4.8-1.el8.noarch.rpm 528 kB/s | 61 kB 00:00 2023-05-10T04:16:16.575 INFO:teuthology.orchestra.run.smithi132.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 161 kB/s | 19 kB 00:00 2023-05-10T04:16:16.623 INFO:teuthology.orchestra.run.smithi132.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 534 kB/s | 196 kB 00:00 2023-05-10T04:16:16.698 INFO:teuthology.orchestra.run.smithi132.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 191 kB/s | 24 kB 00:00 2023-05-10T04:16:16.731 INFO:teuthology.orchestra.run.smithi132.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 269 kB/s | 29 kB 00:00 2023-05-10T04:16:16.832 INFO:teuthology.orchestra.run.smithi132.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 206 kB/s | 27 kB 00:00 2023-05-10T04:16:17.032 INFO:teuthology.orchestra.run.smithi132.stdout:(64/131): python3-kubernetes-11.0.0-6.el8.noarc 780 kB/s | 1.2 MB 00:01 2023-05-10T04:16:17.091 INFO:teuthology.orchestra.run.smithi132.stdout:(65/131): python3-waitress-1.2.1-2.el8.1.noarch 671 kB/s | 241 kB 00:00 2023-05-10T04:16:17.141 INFO:teuthology.orchestra.run.smithi132.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 565 kB/s | 61 kB 00:00 2023-05-10T04:16:17.266 INFO:teuthology.orchestra.run.smithi132.stdout:(67/131): python3-webob-1.8.5-1.el8.1.noarch.rp 579 kB/s | 251 kB 00:00 2023-05-10T04:16:17.292 INFO:teuthology.orchestra.run.smithi132.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 426 kB/s | 85 kB 00:00 2023-05-10T04:16:17.317 INFO:teuthology.orchestra.run.smithi132.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 131 kB/s | 23 kB 00:00 2023-05-10T04:16:17.344 INFO:teuthology.orchestra.run.smithi132.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-05-10T04:16:17.392 INFO:teuthology.orchestra.run.smithi132.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-05-10T04:16:17.418 INFO:teuthology.orchestra.run.smithi132.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-05-10T04:16:17.443 INFO:teuthology.orchestra.run.smithi132.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 847 kB/s | 43 kB 00:00 2023-05-10T04:16:17.468 INFO:teuthology.orchestra.run.smithi132.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-05-10T04:16:17.494 INFO:teuthology.orchestra.run.smithi132.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 962 kB/s | 48 kB 00:00 2023-05-10T04:16:17.519 INFO:teuthology.orchestra.run.smithi132.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-05-10T04:16:17.544 INFO:teuthology.orchestra.run.smithi132.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 850 kB/s | 43 kB 00:00 2023-05-10T04:16:17.570 INFO:teuthology.orchestra.run.smithi132.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-05-10T04:16:17.595 INFO:teuthology.orchestra.run.smithi132.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-05-10T04:16:17.637 INFO:teuthology.orchestra.run.smithi132.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-05-10T04:16:17.662 INFO:teuthology.orchestra.run.smithi132.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 280 kB/s | 19 kB 00:00 2023-05-10T04:16:17.687 INFO:teuthology.orchestra.run.smithi132.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.0 MB/s | 155 kB 00:00 2023-05-10T04:16:17.721 INFO:teuthology.orchestra.run.smithi132.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-05-10T04:16:17.746 INFO:teuthology.orchestra.run.smithi132.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 304 kB/s | 18 kB 00:00 2023-05-10T04:16:17.789 INFO:teuthology.orchestra.run.smithi132.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 8.9 MB/s | 605 kB 00:00 2023-05-10T04:16:17.814 INFO:teuthology.orchestra.run.smithi132.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-05-10T04:16:17.856 INFO:teuthology.orchestra.run.smithi132.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-05-10T04:16:17.898 INFO:teuthology.orchestra.run.smithi132.stdout:(88/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-05-10T04:16:17.948 INFO:teuthology.orchestra.run.smithi132.stdout:(89/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 15 MB/s | 2.3 MB 00:00 2023-05-10T04:16:17.973 INFO:teuthology.orchestra.run.smithi132.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 795 kB/s | 60 kB 00:00 2023-05-10T04:16:17.998 INFO:teuthology.orchestra.run.smithi132.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-05-10T04:16:18.024 INFO:teuthology.orchestra.run.smithi132.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-05-10T04:16:18.049 INFO:teuthology.orchestra.run.smithi132.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 769 kB/s | 39 kB 00:00 2023-05-10T04:16:18.083 INFO:teuthology.orchestra.run.smithi132.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-05-10T04:16:18.108 INFO:teuthology.orchestra.run.smithi132.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.9 MB/s | 171 kB 00:00 2023-05-10T04:16:18.133 INFO:teuthology.orchestra.run.smithi132.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-05-10T04:16:18.176 INFO:teuthology.orchestra.run.smithi132.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-05-10T04:16:18.217 INFO:teuthology.orchestra.run.smithi132.stdout:(98/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-05-10T04:16:18.259 INFO:teuthology.orchestra.run.smithi132.stdout:(99/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-05-10T04:16:18.301 INFO:teuthology.orchestra.run.smithi132.stdout:(100/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-05-10T04:16:18.343 INFO:teuthology.orchestra.run.smithi132.stdout:(101/131): python3-markupsafe-0.23-19.el8.x86_6 934 kB/s | 39 kB 00:00 2023-05-10T04:16:18.393 INFO:teuthology.orchestra.run.smithi132.stdout:(102/131): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-05-10T04:16:18.452 INFO:teuthology.orchestra.run.smithi132.stdout:(103/131): python3-jinja2-2.10.1-3.el8.noarch.r 9.0 MB/s | 538 kB 00:00 2023-05-10T04:16:18.494 INFO:teuthology.orchestra.run.smithi132.stdout:(104/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-05-10T04:16:18.536 INFO:teuthology.orchestra.run.smithi132.stdout:(105/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-05-10T04:16:18.595 INFO:teuthology.orchestra.run.smithi132.stdout:(106/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-05-10T04:16:18.745 INFO:teuthology.orchestra.run.smithi132.stdout:(107/131): python3-scipy-1.0.0-21.module+el8.5. 22 MB/s | 14 MB 00:00 2023-05-10T04:16:18.787 INFO:teuthology.orchestra.run.smithi132.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 644 kB/s | 27 kB 00:00 2023-05-10T04:16:18.829 INFO:teuthology.orchestra.run.smithi132.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-05-10T04:16:18.879 INFO:teuthology.orchestra.run.smithi132.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 878 kB/s | 44 kB 00:00 2023-05-10T04:16:18.963 INFO:teuthology.orchestra.run.smithi132.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-05-10T04:16:19.022 INFO:teuthology.orchestra.run.smithi132.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-05-10T04:16:19.064 INFO:teuthology.orchestra.run.smithi132.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-05-10T04:16:19.139 INFO:teuthology.orchestra.run.smithi132.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 14 MB/s | 3.7 MB 00:00 2023-05-10T04:16:19.165 INFO:teuthology.orchestra.run.smithi132.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 638 kB/s | 64 kB 00:00 2023-05-10T04:16:19.190 INFO:teuthology.orchestra.run.smithi132.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-05-10T04:16:19.207 INFO:teuthology.orchestra.run.smithi132.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 474 kB/s | 20 kB 00:00 2023-05-10T04:16:19.232 INFO:teuthology.orchestra.run.smithi132.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-05-10T04:16:19.266 INFO:teuthology.orchestra.run.smithi132.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-05-10T04:16:19.308 INFO:teuthology.orchestra.run.smithi132.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-05-10T04:16:19.433 INFO:teuthology.orchestra.run.smithi132.stdout:(121/131): openblas-threads-0.3.15-3.el8.x86_64 24 MB/s | 4.9 MB 00:00 2023-05-10T04:16:19.475 INFO:teuthology.orchestra.run.smithi132.stdout:(122/131): thrift-0.13.0-2.el8.x86_64.rpm 804 kB/s | 1.7 MB 00:02 2023-05-10T04:16:19.509 INFO:teuthology.orchestra.run.smithi132.stdout:(123/131): jq-1.6-3.el8.x86_64.rpm 2.6 MB/s | 202 kB 00:00 2023-05-10T04:16:19.576 INFO:teuthology.orchestra.run.smithi132.stdout:(124/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.4 MB/s | 354 kB 00:00 2023-05-10T04:16:19.652 INFO:teuthology.orchestra.run.smithi132.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-05-10T04:16:19.702 INFO:teuthology.orchestra.run.smithi132.stdout:(126/131): postgresql-contrib-10.21-2.module+el 6.3 MB/s | 808 kB 00:00 2023-05-10T04:16:19.768 INFO:teuthology.orchestra.run.smithi132.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 13 MB/s | 1.5 MB 00:00 2023-05-10T04:16:19.869 INFO:teuthology.orchestra.run.smithi132.stdout:(128/131): postgresql-server-10.21-2.module+el8 14 MB/s | 5.1 MB 00:00 2023-05-10T04:16:19.919 INFO:teuthology.orchestra.run.smithi132.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-05-10T04:16:20.894 INFO:teuthology.orchestra.run.smithi154.stdout: Preparing : 1/1 2023-05-10T04:16:21.076 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-05-10T04:16:21.144 INFO:teuthology.orchestra.run.smithi132.stdout:(130/131): librbd1-18.0.0-3851.g2ef5137f.el8.x8 2.6 MB/s | 3.6 MB 00:01 2023-05-10T04:16:21.235 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-05-10T04:16:21.378 INFO:teuthology.orchestra.run.smithi132.stdout:(131/131): librados2-18.0.0-3851.g2ef5137f.el8. 2.2 MB/s | 3.7 MB 00:01 2023-05-10T04:16:21.383 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-05-10T04:16:21.383 INFO:teuthology.orchestra.run.smithi132.stdout:Total 13 MB/s | 197 MB 00:14 2023-05-10T04:16:21.429 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-05-10T04:16:21.610 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-05-10T04:16:21.748 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-05-10T04:16:21.952 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-05-10T04:16:22.411 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-05-10T04:16:22.652 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librados2-2:18.0.0-3851.g2ef5137f.el8.x86_64 6/134 2023-05-10T04:16:22.876 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-05-10T04:16:23.010 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-05-10T04:16:23.010 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-05-10T04:16:23.106 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-2:18.0.0-3851.g2ef5137f.el8.x86_64 6/134 2023-05-10T04:16:23.568 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : librbd1-2:18.0.0-3851.g2ef5137f.el8.x86_64 7/134 2023-05-10T04:16:23.727 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-2:18.0.0-3851.g2ef5137f.el8.x86_64 7/134 2023-05-10T04:16:23.918 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs2-2:18.0.0-3851.g2ef5137f.el8.x86_64 8/134 2023-05-10T04:16:24.039 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephfs2-2:18.0.0-3851.g2ef5137f.el8.x86_64 8/134 2023-05-10T04:16:24.257 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rados-2:18.0.0-3851.g2ef5137f.el8.x86_64 9/134 2023-05-10T04:16:24.560 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-05-10T04:16:24.741 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-05-10T04:16:24.745 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-05-10T04:16:24.798 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-05-10T04:16:25.250 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-05-10T04:16:25.498 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-05-10T04:16:25.643 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephsqlite-2:18.0.0-3851.g2ef5137f.el8.x86_64 14/134 2023-05-10T04:16:25.771 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3851.g2ef5137f.el8.x86_64 14/134 2023-05-10T04:16:25.918 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libradosstriper1-2:18.0.0-3851.g2ef5137f.el8.x86 15/134 2023-05-10T04:16:26.022 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3851.g2ef5137f.el8.x86 15/134 2023-05-10T04:16:26.167 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-05-10T04:16:26.333 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-05-10T04:16:26.467 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-05-10T04:16:27.163 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-05-10T04:16:27.318 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-05-10T04:16:27.995 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-05-10T04:16:28.226 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-05-10T04:16:29.054 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-05-10T04:16:29.350 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-05-10T04:16:29.601 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-05-10T04:16:29.824 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-05-10T04:16:29.853 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-05-10T04:16:29.993 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-05-10T04:16:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-05-10T04:16:30.232 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-05-10T04:16:30.325 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-05-10T04:16:30.503 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-05-10T04:16:30.515 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-05-10T04:16:30.639 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-05-10T04:16:30.683 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-common-2:18.0.0-3851.g2ef5137f.el8. 26/134 2023-05-10T04:16:30.822 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-ceph-argparse-2:18.0.0-3851.g2ef5137f.el 27/134 2023-05-10T04:16:30.849 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-05-10T04:16:31.316 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-05-10T04:16:31.540 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:18.0.0-3851.g2ef5137f.el8.x86_64 5/134 2023-05-10T04:16:31.843 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cephfs-2:18.0.0-3851.g2ef5137f.el8.x86_6 28/134 2023-05-10T04:16:31.996 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:18.0.0-3851.g2ef5137f.el8.x86_64 5/134 2023-05-10T04:16:32.173 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:18.0.0-3851.g2ef5137f.el8.x86_64 6/134 2023-05-10T04:16:32.197 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-05-10T04:16:32.319 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:18.0.0-3851.g2ef5137f.el8.x86_64 6/134 2023-05-10T04:16:32.490 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:18.0.0-3851.g2ef5137f.el8.x86_64 7/134 2023-05-10T04:16:32.491 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-05-10T04:16:32.605 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:18.0.0-3851.g2ef5137f.el8.x86_64 7/134 2023-05-10T04:16:32.775 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-05-10T04:16:32.804 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:18.0.0-3851.g2ef5137f.el8.x86_64 8/134 2023-05-10T04:16:32.950 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-05-10T04:16:33.004 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-05-10T04:16:33.264 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-05-10T04:16:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-05-10T04:16:33.964 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-05-10T04:16:34.236 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-05-10T04:16:34.415 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:18.0.0-3851.g2ef5137f.el8.x86_64 14/134 2023-05-10T04:16:34.534 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:18.0.0-3851.g2ef5137f.el8.x86_64 14/134 2023-05-10T04:16:34.706 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:18.0.0-3851.g2ef5137f.el8.x86 15/134 2023-05-10T04:16:34.869 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:18.0.0-3851.g2ef5137f.el8.x86 15/134 2023-05-10T04:16:35.054 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-05-10T04:16:35.056 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-05-10T04:16:35.240 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-05-10T04:16:35.450 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-05-10T04:16:35.652 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-05-10T04:16:35.673 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-05-10T04:16:35.806 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-05-10T04:16:35.847 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-05-10T04:16:35.974 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-05-10T04:16:36.033 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 36/134 2023-05-10T04:16:36.131 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-05-10T04:16:36.214 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librados-devel-2:18.0.0-3851.g2ef5137f.el8.x86_6 37/134 2023-05-10T04:16:36.382 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-05-10T04:16:36.604 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-05-10T04:16:36.794 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-05-10T04:16:36.834 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-05-10T04:16:36.947 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-05-10T04:16:37.047 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-05-10T04:16:37.155 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-05-10T04:16:37.389 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-05-10T04:16:37.721 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-05-10T04:16:37.806 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-05-10T04:16:37.930 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-05-10T04:16:38.081 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-05-10T04:16:38.288 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-05-10T04:16:38.534 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-05-10T04:16:38.754 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-05-10T04:16:39.043 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-05-10T04:16:39.062 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-05-10T04:16:39.264 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-05-10T04:16:39.404 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-05-10T04:16:39.517 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-05-10T04:16:39.659 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-05-10T04:16:39.705 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:18.0.0-3851.g2ef5137f.el8. 26/134 2023-05-10T04:16:39.853 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-05-10T04:16:39.861 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:18.0.0-3851.g2ef5137f.el 27/134 2023-05-10T04:16:40.094 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-05-10T04:16:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:18.0.0-3851.g2ef5137f.el8.x86_6 28/134 2023-05-10T04:16:40.288 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-05-10T04:16:40.331 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-05-10T04:16:40.446 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-05-10T04:16:40.812 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-05-10T04:16:41.101 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-05-10T04:16:41.355 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-05-10T04:16:41.623 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-05-10T04:16:41.807 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-05-10T04:16:41.952 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-05-10T04:16:42.140 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-05-10T04:16:42.223 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-05-10T04:16:42.378 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-05-10T04:16:42.484 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-05-10T04:16:42.721 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-05-10T04:16:42.881 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-05-10T04:16:42.977 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-05-10T04:16:43.196 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-05-10T04:16:43.409 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-05-10T04:16:43.533 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-05-10T04:16:43.608 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-05-10T04:16:43.824 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-05-10T04:16:43.899 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-05-10T04:16:44.094 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-05-10T04:16:44.177 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-05-10T04:16:44.348 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-05-10T04:16:44.401 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-05-10T04:16:44.512 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-05-10T04:16:44.623 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-05-10T04:16:44.671 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-05-10T04:16:44.810 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-05-10T04:16:44.890 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-05-10T04:16:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 36/134 2023-05-10T04:16:45.116 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-05-10T04:16:45.163 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:18.0.0-3851.g2ef5137f.el8.x86_6 37/134 2023-05-10T04:16:45.323 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-05-10T04:16:45.330 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-05-10T04:16:45.485 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-05-10T04:16:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-05-10T04:16:45.664 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-05-10T04:16:45.704 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-05-10T04:16:45.789 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-05-10T04:16:45.890 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-05-10T04:16:46.034 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-05-10T04:16:46.155 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-05-10T04:16:46.244 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-05-10T04:16:46.355 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-05-10T04:16:46.413 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-05-10T04:16:46.511 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-05-10T04:16:46.648 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-05-10T04:16:46.748 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-05-10T04:16:46.882 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-05-10T04:16:46.935 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-05-10T04:16:47.041 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-05-10T04:16:47.100 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-05-10T04:16:47.254 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-05-10T04:16:47.282 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-05-10T04:16:47.457 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-05-10T04:16:47.601 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-05-10T04:16:47.815 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-05-10T04:16:48.039 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-05-10T04:16:48.450 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-05-10T04:16:48.580 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-05-10T04:16:48.744 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-05-10T04:16:48.866 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-05-10T04:16:48.977 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-05-10T04:16:49.128 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-05-10T04:16:49.249 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-05-10T04:16:49.452 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-05-10T04:16:49.489 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-05-10T04:16:49.788 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-05-10T04:16:49.862 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-05-10T04:16:49.997 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-05-10T04:16:50.113 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-05-10T04:16:50.308 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-05-10T04:16:50.531 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-05-10T04:16:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-05-10T04:16:50.839 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-05-10T04:16:50.884 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-05-10T04:16:51.022 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : librgw2-2:18.0.0-3851.g2ef5137f.el8.x86_64 92/134 2023-05-10T04:16:51.120 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librgw2-2:18.0.0-3851.g2ef5137f.el8.x86_64 92/134 2023-05-10T04:16:51.227 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-05-10T04:16:51.306 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : python3-rgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 93/134 2023-05-10T04:16:51.522 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-05-10T04:16:51.768 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-05-10T04:16:52.015 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-05-10T04:16:52.205 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-05-10T04:16:52.411 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-05-10T04:16:52.665 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-05-10T04:16:52.878 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 70/134 2023-05-10T04:16:53.033 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-05-10T04:16:53.191 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-05-10T04:16:53.409 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-05-10T04:16:53.644 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-05-10T04:16:53.851 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-05-10T04:16:54.032 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-05-10T04:16:54.211 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-05-10T04:16:54.452 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-05-10T04:16:54.651 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-05-10T04:16:54.835 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-05-10T04:16:55.137 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-05-10T04:16:55.354 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-05-10T04:16:55.546 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-05-10T04:16:55.760 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-05-10T04:16:56.016 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 94/134 2023-05-10T04:16:56.255 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 94/134 2023-05-10T04:16:56.922 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 94/134 2023-05-10T04:16:57.123 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-05-10T04:16:57.228 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-base-2:18.0.0-3851.g2ef5137f.el8.x86_64 95/134 2023-05-10T04:16:57.354 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-base-2:18.0.0-3851.g2ef5137f.el8.x86_64 95/134 2023-05-10T04:16:57.397 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-05-10T04:16:57.454 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-selinux-2:18.0.0-3851.g2ef5137f.el8.x86_64 96/134 2023-05-10T04:16:57.666 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-05-10T04:16:57.992 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-05-10T04:16:58.271 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-05-10T04:16:58.493 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-05-10T04:16:59.329 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-05-10T04:16:59.494 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:18.0.0-3851.g2ef5137f.el8.x86_64 92/134 2023-05-10T04:16:59.598 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:18.0.0-3851.g2ef5137f.el8.x86_64 92/134 2023-05-10T04:16:59.770 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 93/134 2023-05-10T04:17:04.793 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 94/134 2023-05-10T04:17:05.044 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 94/134 2023-05-10T04:17:05.708 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 94/134 2023-05-10T04:17:05.966 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:18.0.0-3851.g2ef5137f.el8.x86_64 95/134 2023-05-10T04:17:06.277 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:18.0.0-3851.g2ef5137f.el8.x86_64 95/134 2023-05-10T04:17:06.551 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:18.0.0-3851.g2ef5137f.el8.x86_64 96/134 2023-05-10T04:17:17.552 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3851.g2ef5137f.el8.x86_64 96/134 2023-05-10T04:17:17.552 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /sys 2023-05-10T04:17:17.552 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /proc 2023-05-10T04:17:17.552 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2023-05-10T04:17:17.553 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /run 2023-05-10T04:17:17.553 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /mnt 2023-05-10T04:17:17.553 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /var/tmp 2023-05-10T04:17:17.553 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /home 2023-05-10T04:17:17.553 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /tmp 2023-05-10T04:17:17.553 INFO:teuthology.orchestra.run.smithi154.stdout:skipping the directory /dev 2023-05-10T04:17:17.553 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:17:17.951 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-volume-2:18.0.0-3851.g2ef5137f.el8.noarch 97/134 2023-05-10T04:17:19.677 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-volume-2:18.0.0-3851.g2ef5137f.el8.noarch 97/134 2023-05-10T04:17:19.858 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-osd-2:18.0.0-3851.g2ef5137f.el8.x86_64 98/134 2023-05-10T04:17:20.121 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-osd-2:18.0.0-3851.g2ef5137f.el8.x86_64 98/134 2023-05-10T04:17:20.317 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mds-2:18.0.0-3851.g2ef5137f.el8.x86_64 99/134 2023-05-10T04:17:20.835 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mds-2:18.0.0-3851.g2ef5137f.el8.x86_64 99/134 2023-05-10T04:17:21.067 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mon-2:18.0.0-3851.g2ef5137f.el8.x86_64 100/134 2023-05-10T04:17:21.105 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mon-2:18.0.0-3851.g2ef5137f.el8.x86_64 100/134 2023-05-10T04:17:23.686 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 101/134 2023-05-10T04:17:23.868 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 101/134 2023-05-10T04:17:24.033 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3851.g2ef5137f.e 102/134 2023-05-10T04:17:24.246 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3851.g2ef5137f. 103/134 2023-05-10T04:17:24.441 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3851.g2ef5137f.el8.noa 104/134 2023-05-10T04:17:24.699 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3851.g2ef5137f.el8.noa 104/134 2023-05-10T04:17:24.897 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3851.g2ef5137f.el8.n 105/134 2023-05-10T04:17:26.004 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3851.g2ef5137f.el8.n 105/134 2023-05-10T04:17:26.207 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3851.g2ef 106/134 2023-05-10T04:17:26.332 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3851.g2ef 106/134 2023-05-10T04:17:26.690 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:18.0.0-3851.g2ef5137f.el8.x86_64 96/134 2023-05-10T04:17:26.690 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2023-05-10T04:17:26.691 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2023-05-10T04:17:26.691 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /dev 2023-05-10T04:17:26.691 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /run 2023-05-10T04:17:26.691 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2023-05-10T04:17:26.691 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2023-05-10T04:17:26.691 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2023-05-10T04:17:26.691 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2023-05-10T04:17:26.692 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /dev 2023-05-10T04:17:26.692 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:17:26.730 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3851.g2ef5137f.el 107/134 2023-05-10T04:17:26.931 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-2:18.0.0-3851.g2ef5137f.el8.x86_64 108/134 2023-05-10T04:17:26.992 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3851.g2ef5137f.el8.x86_64 108/134 2023-05-10T04:17:27.074 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:18.0.0-3851.g2ef5137f.el8.noarch 97/134 2023-05-10T04:17:27.157 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-mgr-rook-2:18.0.0-3851.g2ef5137f.el8.noarch 109/134 2023-05-10T04:17:27.183 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3851.g2ef5137f.el8.noarch 109/134 2023-05-10T04:17:28.525 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-2:18.0.0-3851.g2ef5137f.el8.x86_64 110/134 2023-05-10T04:17:28.745 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-radosgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 111/134 2023-05-10T04:17:28.798 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:18.0.0-3851.g2ef5137f.el8.noarch 97/134 2023-05-10T04:17:28.803 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 111/134 2023-05-10T04:17:28.957 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3851.g2ef51 112/134 2023-05-10T04:17:28.987 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:18.0.0-3851.g2ef5137f.el8.x86_64 98/134 2023-05-10T04:17:29.025 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3851.g2ef51 112/134 2023-05-10T04:17:29.190 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 113/134 2023-05-10T04:17:29.256 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:18.0.0-3851.g2ef5137f.el8.x86_64 98/134 2023-05-10T04:17:29.440 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:18.0.0-3851.g2ef5137f.el8.x86_64 99/134 2023-05-10T04:17:29.594 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 113/134 2023-05-10T04:17:29.790 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 114/134 2023-05-10T04:17:29.958 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:18.0.0-3851.g2ef5137f.el8.x86_64 99/134 2023-05-10T04:17:30.198 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:18.0.0-3851.g2ef5137f.el8.x86_64 100/134 2023-05-10T04:17:30.236 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:18.0.0-3851.g2ef5137f.el8.x86_64 100/134 2023-05-10T04:17:32.769 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 101/134 2023-05-10T04:17:32.940 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 101/134 2023-05-10T04:17:33.105 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-3851.g2ef5137f.e 102/134 2023-05-10T04:17:33.310 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-3851.g2ef5137f. 103/134 2023-05-10T04:17:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-3851.g2ef5137f.el8.noa 104/134 2023-05-10T04:17:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-3851.g2ef5137f.el8.noa 104/134 2023-05-10T04:17:33.978 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-3851.g2ef5137f.el8.n 105/134 2023-05-10T04:17:34.104 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 114/134 2023-05-10T04:17:34.414 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-test-2:18.0.0-3851.g2ef5137f.el8.x86_64 115/134 2023-05-10T04:17:34.573 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-05-10T04:17:34.819 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-05-10T04:17:35.080 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-3851.g2ef5137f.el8.n 105/134 2023-05-10T04:17:35.272 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-3851.g2ef 106/134 2023-05-10T04:17:35.397 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-3851.g2ef 106/134 2023-05-10T04:17:35.769 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-3851.g2ef5137f.el 107/134 2023-05-10T04:17:35.994 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:18.0.0-3851.g2ef5137f.el8.x86_64 108/134 2023-05-10T04:17:36.056 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:18.0.0-3851.g2ef5137f.el8.x86_64 108/134 2023-05-10T04:17:36.063 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-05-10T04:17:36.222 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:18.0.0-3851.g2ef5137f.el8.noarch 109/134 2023-05-10T04:17:36.247 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-3851.g2ef5137f.el8.noarch 109/134 2023-05-10T04:17:36.411 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-05-10T04:17:36.605 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : ceph-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 119/134 2023-05-10T04:17:36.835 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-05-10T04:17:36.994 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libcephfs-devel-2:18.0.0-3851.g2ef5137f.el8.x86_ 121/134 2023-05-10T04:17:37.140 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-10T04:17:37.617 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:18.0.0-3851.g2ef5137f.el8.x86_64 110/134 2023-05-10T04:17:37.851 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 111/134 2023-05-10T04:17:37.910 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 111/134 2023-05-10T04:17:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-3851.g2ef51 112/134 2023-05-10T04:17:38.154 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-3851.g2ef51 112/134 2023-05-10T04:17:38.313 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 113/134 2023-05-10T04:17:38.716 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 113/134 2023-05-10T04:17:38.880 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 114/134 2023-05-10T04:17:40.250 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-10T04:17:40.572 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-10T04:17:40.607 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-10T04:17:40.848 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : cephfs-top-2:18.0.0-3851.g2ef5137f.el8.noarch 124/134 2023-05-10T04:17:41.039 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 125/134 2023-05-10T04:17:41.346 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : rbd-nbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 126/134 2023-05-10T04:17:41.648 INFO:teuthology.orchestra.run.smithi154.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-05-10T04:17:41.847 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-10T04:17:41.868 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-10T04:17:42.079 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-05-10T04:17:42.279 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-05-10T04:17:42.388 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-05-10T04:17:42.604 INFO:teuthology.orchestra.run.smithi154.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-05-10T04:17:42.630 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-05-10T04:17:42.630 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-10T04:17:42.844 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-10T04:17:42.845 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-10T04:17:43.121 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-10T04:17:43.192 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 114/134 2023-05-10T04:17:43.330 INFO:teuthology.orchestra.run.smithi154.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-10T04:17:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-05-10T04:17:43.584 INFO:teuthology.orchestra.run.smithi154.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-10T04:17:43.584 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:17:43.878 INFO:teuthology.orchestra.run.smithi154.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-10T04:17:43.878 INFO:teuthology.orchestra.run.smithi154.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-10T04:17:43.878 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:17:44.168 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-2:18.0.0-3851.g2ef5137f.el8.x86_64 1/134 2023-05-10T04:17:44.168 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-base-2:18.0.0-3851.g2ef5137f.el8.x86_64 2/134 2023-05-10T04:17:44.169 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 3/134 2023-05-10T04:17:44.169 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 4/134 2023-05-10T04:17:44.169 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3851.g2ef51 5/134 2023-05-10T04:17:44.169 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mds-2:18.0.0-3851.g2ef5137f.el8.x86_64 6/134 2023-05-10T04:17:44.169 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-2:18.0.0-3851.g2ef5137f.el8.x86_64 7/134 2023-05-10T04:17:44.169 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mon-2:18.0.0-3851.g2ef5137f.el8.x86_64 8/134 2023-05-10T04:17:44.169 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-osd-2:18.0.0-3851.g2ef5137f.el8.x86_64 9/134 2023-05-10T04:17:44.170 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-radosgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 10/134 2023-05-10T04:17:44.170 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-selinux-2:18.0.0-3851.g2ef5137f.el8.x86_64 11/134 2023-05-10T04:17:44.170 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-test-2:18.0.0-3851.g2ef5137f.el8.x86_64 12/134 2023-05-10T04:17:44.170 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 13/134 2023-05-10T04:17:44.170 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs-devel-2:18.0.0-3851.g2ef5137f.el8.x86_ 14/134 2023-05-10T04:17:44.170 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephfs2-2:18.0.0-3851.g2ef5137f.el8.x86_64 15/134 2023-05-10T04:17:44.170 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcephsqlite-2:18.0.0-3851.g2ef5137f.el8.x86_64 16/134 2023-05-10T04:17:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados-devel-2:18.0.0-3851.g2ef5137f.el8.x86_6 17/134 2023-05-10T04:17:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libradosstriper1-2:18.0.0-3851.g2ef5137f.el8.x86 18/134 2023-05-10T04:17:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librgw2-2:18.0.0-3851.g2ef5137f.el8.x86_64 19/134 2023-05-10T04:17:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3851.g2ef5137f.el 20/134 2023-05-10T04:17:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-ceph-common-2:18.0.0-3851.g2ef5137f.el8. 21/134 2023-05-10T04:17:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cephfs-2:18.0.0-3851.g2ef5137f.el8.x86_6 22/134 2023-05-10T04:17:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rados-2:18.0.0-3851.g2ef5137f.el8.x86_64 23/134 2023-05-10T04:17:44.171 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 24/134 2023-05-10T04:17:44.172 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 25/134 2023-05-10T04:17:44.172 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 26/134 2023-05-10T04:17:44.172 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 27/134 2023-05-10T04:17:44.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : rbd-nbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 28/134 2023-05-10T04:17:44.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3851.g2ef5137f. 29/134 2023-05-10T04:17:44.179 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3851.g2ef5137f.el8.noa 30/134 2023-05-10T04:17:44.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3851.g2ef5137f.el8.n 31/134 2023-05-10T04:17:44.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3851.g2ef 32/134 2023-05-10T04:17:44.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3851.g2ef5137f.el 33/134 2023-05-10T04:17:44.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3851.g2ef5137f.el8.noarch 34/134 2023-05-10T04:17:44.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3851.g2ef5137f.e 35/134 2023-05-10T04:17:44.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : ceph-volume-2:18.0.0-3851.g2ef5137f.el8.noarch 36/134 2023-05-10T04:17:44.180 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 37/134 2023-05-10T04:17:44.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : cephfs-top-2:18.0.0-3851.g2ef5137f.el8.noarch 38/134 2023-05-10T04:17:44.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-05-10T04:17:44.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-05-10T04:17:44.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-05-10T04:17:44.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-05-10T04:17:44.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-05-10T04:17:44.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-05-10T04:17:44.181 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-05-10T04:17:44.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-05-10T04:17:44.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-05-10T04:17:44.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-05-10T04:17:44.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-05-10T04:17:44.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-05-10T04:17:44.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-05-10T04:17:44.182 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-05-10T04:17:44.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-05-10T04:17:44.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-05-10T04:17:44.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-05-10T04:17:44.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-05-10T04:17:44.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-05-10T04:17:44.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-05-10T04:17:44.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-05-10T04:17:44.183 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-05-10T04:17:44.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-05-10T04:17:44.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-05-10T04:17:44.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-05-10T04:17:44.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-05-10T04:17:44.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-05-10T04:17:44.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-05-10T04:17:44.184 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-05-10T04:17:44.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-05-10T04:17:44.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-05-10T04:17:44.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-05-10T04:17:44.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-05-10T04:17:44.185 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-05-10T04:17:44.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-05-10T04:17:44.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-05-10T04:17:44.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-05-10T04:17:44.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-05-10T04:17:44.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-05-10T04:17:44.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-05-10T04:17:44.186 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-05-10T04:17:44.187 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-05-10T04:17:44.187 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-05-10T04:17:44.187 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-05-10T04:17:44.187 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-05-10T04:17:44.187 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-05-10T04:17:44.187 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-05-10T04:17:44.187 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-05-10T04:17:44.188 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-05-10T04:17:44.188 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-05-10T04:17:44.188 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-05-10T04:17:44.188 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-05-10T04:17:44.188 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-05-10T04:17:44.188 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-05-10T04:17:44.188 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-05-10T04:17:44.188 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-05-10T04:17:44.189 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-05-10T04:17:44.189 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-05-10T04:17:44.189 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-05-10T04:17:44.189 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-05-10T04:17:44.189 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-05-10T04:17:44.189 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-05-10T04:17:44.189 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-05-10T04:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-05-10T04:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-05-10T04:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-05-10T04:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-05-10T04:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-05-10T04:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-05-10T04:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-05-10T04:17:44.190 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-05-10T04:17:44.191 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-05-10T04:17:44.191 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-05-10T04:17:44.191 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-05-10T04:17:44.191 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-05-10T04:17:44.191 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-05-10T04:17:44.191 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-05-10T04:17:44.191 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-05-10T04:17:44.191 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-05-10T04:17:44.192 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-05-10T04:17:44.192 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-05-10T04:17:44.192 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-05-10T04:17:44.192 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-05-10T04:17:44.192 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-10T04:17:44.192 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-05-10T04:17:44.192 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-05-10T04:17:44.193 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-05-10T04:17:44.193 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-05-10T04:17:44.193 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-05-10T04:17:44.193 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-05-10T04:17:44.193 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-2:18.0.0-3851.g2ef5137f.el8.x86_64 129/134 2023-05-10T04:17:44.193 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-05-10T04:17:44.193 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-2:18.0.0-3851.g2ef5137f.el8.x86_64 131/134 2023-05-10T04:17:44.194 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-10T04:17:44.194 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-05-10T04:17:44.432 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:18.0.0-3851.g2ef5137f.el8.x86_64 115/134 2023-05-10T04:17:44.749 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-05-10T04:17:44.936 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 117/134 2023-05-10T04:17:45.197 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-05-10T04:17:45.378 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-05-10T04:17:45.627 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-05-10T04:17:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-05-10T04:17:46.084 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:18.0.0-3851.g2ef5137f.el8.x86_ 121/134 2023-05-10T04:17:46.238 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-05-10T04:17:46.817 INFO:teuthology.orchestra.run.smithi154.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-10T04:17:46.817 INFO:teuthology.orchestra.run.smithi154.stdout:Last metadata expiration check: 0:01:56 ago on Wed 10 May 2023 04:15:50 AM UTC. 2023-05-10T04:17:49.383 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-10T04:17:49.488 INFO:teuthology.orchestra.run.smithi154.stdout:Installed products updated. 2023-05-10T04:17:49.700 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-10T04:17:49.728 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:17:49.729 INFO:teuthology.orchestra.run.smithi154.stdout:Upgraded: 2023-05-10T04:17:49.729 INFO:teuthology.orchestra.run.smithi154.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-05-10T04:17:49.729 INFO:teuthology.orchestra.run.smithi154.stdout: librados2-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.729 INFO:teuthology.orchestra.run.smithi154.stdout: librbd1-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.729 INFO:teuthology.orchestra.run.smithi154.stdout:Installed: 2023-05-10T04:17:49.729 INFO:teuthology.orchestra.run.smithi154.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-05-10T04:17:49.729 INFO:teuthology.orchestra.run.smithi154.stdout: automake-1.16.1-7.el8.noarch 2023-05-10T04:17:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: bison-3.0.4-10.el8.x86_64 2023-05-10T04:17:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-base-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-grafana-dashboards-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.730 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-immutable-object-cache-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.731 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mds-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.731 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.731 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.731 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-dashboard-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.731 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.731 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-modules-core-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.731 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mgr-rook-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.731 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-mon-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.732 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-osd-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.732 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-prometheus-alerts-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.732 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-radosgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.732 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-selinux-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.732 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-test-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.732 INFO:teuthology.orchestra.run.smithi154.stdout: ceph-volume-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.732 INFO:teuthology.orchestra.run.smithi154.stdout: cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.733 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.733 INFO:teuthology.orchestra.run.smithi154.stdout: cephfs-top-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:49.733 INFO:teuthology.orchestra.run.smithi154.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-05-10T04:17:49.733 INFO:teuthology.orchestra.run.smithi154.stdout: flex-2.6.1-9.el8.x86_64 2023-05-10T04:17:49.733 INFO:teuthology.orchestra.run.smithi154.stdout: fuse-2.9.7-15.el8.x86_64 2023-05-10T04:17:49.733 INFO:teuthology.orchestra.run.smithi154.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-10T04:17:49.733 INFO:teuthology.orchestra.run.smithi154.stdout: jq-1.6-3.el8.x86_64 2023-05-10T04:17:49.733 INFO:teuthology.orchestra.run.smithi154.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-10T04:17:49.734 INFO:teuthology.orchestra.run.smithi154.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-05-10T04:17:49.734 INFO:teuthology.orchestra.run.smithi154.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-10T04:17:49.734 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs-devel-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.734 INFO:teuthology.orchestra.run.smithi154.stdout: libcephfs2-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.734 INFO:teuthology.orchestra.run.smithi154.stdout: libcephsqlite-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.734 INFO:teuthology.orchestra.run.smithi154.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-05-10T04:17:49.735 INFO:teuthology.orchestra.run.smithi154.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-05-10T04:17:49.735 INFO:teuthology.orchestra.run.smithi154.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-10T04:17:49.735 INFO:teuthology.orchestra.run.smithi154.stdout: libpq-13.5-1.el8.x86_64 2023-05-10T04:17:49.735 INFO:teuthology.orchestra.run.smithi154.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-05-10T04:17:49.736 INFO:teuthology.orchestra.run.smithi154.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-10T04:17:49.736 INFO:teuthology.orchestra.run.smithi154.stdout: librados-devel-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.736 INFO:teuthology.orchestra.run.smithi154.stdout: libradosstriper1-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.736 INFO:teuthology.orchestra.run.smithi154.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-10T04:17:49.736 INFO:teuthology.orchestra.run.smithi154.stdout: librgw2-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.736 INFO:teuthology.orchestra.run.smithi154.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-10T04:17:49.736 INFO:teuthology.orchestra.run.smithi154.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-10T04:17:49.737 INFO:teuthology.orchestra.run.smithi154.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-10T04:17:49.737 INFO:teuthology.orchestra.run.smithi154.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-10T04:17:49.737 INFO:teuthology.orchestra.run.smithi154.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-05-10T04:17:49.737 INFO:teuthology.orchestra.run.smithi154.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-10T04:17:49.737 INFO:teuthology.orchestra.run.smithi154.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-10T04:17:49.737 INFO:teuthology.orchestra.run.smithi154.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-10T04:17:49.737 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-0.3.15-3.el8.x86_64 2023-05-10T04:17:49.738 INFO:teuthology.orchestra.run.smithi154.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-05-10T04:17:49.738 INFO:teuthology.orchestra.run.smithi154.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-05-10T04:17:49.738 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-10T04:17:49.738 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-10T04:17:49.738 INFO:teuthology.orchestra.run.smithi154.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-10T04:17:49.738 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-10T04:17:49.738 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-10T04:17:49.738 INFO:teuthology.orchestra.run.smithi154.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-10T04:17:49.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-10T04:17:49.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-10T04:17:49.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-10T04:17:49.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-10T04:17:49.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-10T04:17:49.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-argparse-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.739 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cephfs-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-10T04:17:49.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-10T04:17:49.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-10T04:17:49.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-10T04:17:49.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-10T04:17:49.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-10T04:17:49.740 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-10T04:17:49.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-10T04:17:49.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-10T04:17:49.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-10T04:17:49.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-10T04:17:49.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-10T04:17:49.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-10T04:17:49.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-10T04:17:49.741 INFO:teuthology.orchestra.run.smithi154.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-10T04:17:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-10T04:17:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-10T04:17:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-10T04:17:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-10T04:17:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-10T04:17:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-10T04:17:49.742 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-10T04:17:49.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-portend-2.6-1.el8.noarch 2023-05-10T04:17:49.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-10T04:17:49.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-10T04:17:49.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-10T04:17:49.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-10T04:17:49.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-10T04:17:49.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-10T04:17:49.743 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rados-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-10T04:17:49.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-10T04:17:49.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-10T04:17:49.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-10T04:17:49.744 INFO:teuthology.orchestra.run.smithi154.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-05-10T04:17:49.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-10T04:17:49.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-10T04:17:49.745 INFO:teuthology.orchestra.run.smithi154.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-10T04:17:49.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-10T04:17:49.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-10T04:17:49.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-10T04:17:49.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-10T04:17:49.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-10T04:17:49.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-10T04:17:49.746 INFO:teuthology.orchestra.run.smithi154.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-10T04:17:49.747 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.747 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.747 INFO:teuthology.orchestra.run.smithi154.stdout: rbd-nbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:49.747 INFO:teuthology.orchestra.run.smithi154.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-10T04:17:49.747 INFO:teuthology.orchestra.run.smithi154.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-10T04:17:49.747 INFO:teuthology.orchestra.run.smithi154.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-10T04:17:49.748 INFO:teuthology.orchestra.run.smithi154.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-10T04:17:49.748 INFO:teuthology.orchestra.run.smithi154.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-10T04:17:49.748 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-05-10T04:17:49.749 INFO:teuthology.orchestra.run.smithi154.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-05-10T04:17:49.749 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:17:49.749 INFO:teuthology.orchestra.run.smithi154.stdout:Complete! 2023-05-10T04:17:49.929 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:18.0.0-3851.g2ef5137f.el8.noarch 124/134 2023-05-10T04:17:50.042 DEBUG:teuthology.parallel:result is None 2023-05-10T04:17:50.137 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 125/134 2023-05-10T04:17:50.474 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 126/134 2023-05-10T04:17:50.827 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-05-10T04:17:50.994 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-05-10T04:17:51.099 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-05-10T04:17:51.286 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-05-10T04:17:51.311 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-05-10T04:17:51.511 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-05-10T04:17:51.531 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-05-10T04:17:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-05-10T04:17:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-10T04:17:51.900 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-10T04:17:51.901 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-10T04:17:52.143 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-05-10T04:17:52.352 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-10T04:17:52.605 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-05-10T04:17:52.605 INFO:teuthology.orchestra.run.smithi132.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-05-10T04:17:52.605 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:17:52.890 INFO:teuthology.orchestra.run.smithi132.stdout:[/usr/lib/tmpfiles.d/journal-nocow.conf:26] Failed to resolve specifier: uninitialized /etc detected, skipping 2023-05-10T04:17:52.891 INFO:teuthology.orchestra.run.smithi132.stdout:All rules containing unresolvable specifiers will be skipped. 2023-05-10T04:17:52.891 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:17:53.179 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:18.0.0-3851.g2ef5137f.el8.x86_64 1/134 2023-05-10T04:17:53.179 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:18.0.0-3851.g2ef5137f.el8.x86_64 2/134 2023-05-10T04:17:53.179 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 3/134 2023-05-10T04:17:53.180 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 4/134 2023-05-10T04:17:53.180 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-3851.g2ef51 5/134 2023-05-10T04:17:53.180 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:18.0.0-3851.g2ef5137f.el8.x86_64 6/134 2023-05-10T04:17:53.180 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:18.0.0-3851.g2ef5137f.el8.x86_64 7/134 2023-05-10T04:17:53.180 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:18.0.0-3851.g2ef5137f.el8.x86_64 8/134 2023-05-10T04:17:53.180 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:18.0.0-3851.g2ef5137f.el8.x86_64 9/134 2023-05-10T04:17:53.180 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 10/134 2023-05-10T04:17:53.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:18.0.0-3851.g2ef5137f.el8.x86_64 11/134 2023-05-10T04:17:53.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:18.0.0-3851.g2ef5137f.el8.x86_64 12/134 2023-05-10T04:17:53.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 13/134 2023-05-10T04:17:53.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:18.0.0-3851.g2ef5137f.el8.x86_ 14/134 2023-05-10T04:17:53.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:18.0.0-3851.g2ef5137f.el8.x86_64 15/134 2023-05-10T04:17:53.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:18.0.0-3851.g2ef5137f.el8.x86_64 16/134 2023-05-10T04:17:53.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:18.0.0-3851.g2ef5137f.el8.x86_6 17/134 2023-05-10T04:17:53.181 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:18.0.0-3851.g2ef5137f.el8.x86 18/134 2023-05-10T04:17:53.182 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:18.0.0-3851.g2ef5137f.el8.x86_64 19/134 2023-05-10T04:17:53.182 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:18.0.0-3851.g2ef5137f.el 20/134 2023-05-10T04:17:53.182 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:18.0.0-3851.g2ef5137f.el8. 21/134 2023-05-10T04:17:53.182 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:18.0.0-3851.g2ef5137f.el8.x86_6 22/134 2023-05-10T04:17:53.182 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:18.0.0-3851.g2ef5137f.el8.x86_64 23/134 2023-05-10T04:17:53.182 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 24/134 2023-05-10T04:17:53.182 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 25/134 2023-05-10T04:17:53.189 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 26/134 2023-05-10T04:17:53.189 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 27/134 2023-05-10T04:17:53.190 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 28/134 2023-05-10T04:17:53.190 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-3851.g2ef5137f. 29/134 2023-05-10T04:17:53.190 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-3851.g2ef5137f.el8.noa 30/134 2023-05-10T04:17:53.190 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-3851.g2ef5137f.el8.n 31/134 2023-05-10T04:17:53.190 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-3851.g2ef 32/134 2023-05-10T04:17:53.190 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-3851.g2ef5137f.el 33/134 2023-05-10T04:17:53.190 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:18.0.0-3851.g2ef5137f.el8.noarch 34/134 2023-05-10T04:17:53.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-3851.g2ef5137f.e 35/134 2023-05-10T04:17:53.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:18.0.0-3851.g2ef5137f.el8.noarch 36/134 2023-05-10T04:17:53.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 37/134 2023-05-10T04:17:53.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:18.0.0-3851.g2ef5137f.el8.noarch 38/134 2023-05-10T04:17:53.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-05-10T04:17:53.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-05-10T04:17:53.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-05-10T04:17:53.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-05-10T04:17:53.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-05-10T04:17:53.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-05-10T04:17:53.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-05-10T04:17:53.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-05-10T04:17:53.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-05-10T04:17:53.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-05-10T04:17:53.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-05-10T04:17:53.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-05-10T04:17:53.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-05-10T04:17:53.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-05-10T04:17:53.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-05-10T04:17:53.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-05-10T04:17:53.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-05-10T04:17:53.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-05-10T04:17:53.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-05-10T04:17:53.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-05-10T04:17:53.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-05-10T04:17:53.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-05-10T04:17:53.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-05-10T04:17:53.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-05-10T04:17:53.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-05-10T04:17:53.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-05-10T04:17:53.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/134 2023-05-10T04:17:53.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-05-10T04:17:53.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-05-10T04:17:53.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-05-10T04:17:53.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-05-10T04:17:53.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-05-10T04:17:53.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-05-10T04:17:53.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-05-10T04:17:53.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-05-10T04:17:53.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-05-10T04:17:53.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-05-10T04:17:53.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-05-10T04:17:53.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-05-10T04:17:53.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-05-10T04:17:53.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-05-10T04:17:53.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-05-10T04:17:53.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-05-10T04:17:53.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-05-10T04:17:53.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-05-10T04:17:53.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-05-10T04:17:53.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-05-10T04:17:53.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-05-10T04:17:53.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-05-10T04:17:53.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-05-10T04:17:53.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-05-10T04:17:53.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-05-10T04:17:53.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-05-10T04:17:53.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-05-10T04:17:53.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-05-10T04:17:53.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-05-10T04:17:53.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-05-10T04:17:53.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-05-10T04:17:53.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-05-10T04:17:53.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-05-10T04:17:53.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-05-10T04:17:53.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-05-10T04:17:53.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-05-10T04:17:53.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-05-10T04:17:53.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-05-10T04:17:53.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-05-10T04:17:53.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-05-10T04:17:53.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-05-10T04:17:53.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-05-10T04:17:53.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-05-10T04:17:53.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-05-10T04:17:53.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-05-10T04:17:53.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-05-10T04:17:53.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-05-10T04:17:53.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-05-10T04:17:53.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-05-10T04:17:53.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-05-10T04:17:53.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-05-10T04:17:53.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-05-10T04:17:53.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-05-10T04:17:53.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-05-10T04:17:53.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-05-10T04:17:53.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-05-10T04:17:53.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-05-10T04:17:53.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-05-10T04:17:53.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-05-10T04:17:53.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-05-10T04:17:53.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-05-10T04:17:53.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-05-10T04:17:53.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-05-10T04:17:53.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:18.0.0-3851.g2ef5137f.el8.x86_64 129/134 2023-05-10T04:17:53.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-05-10T04:17:53.204 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:18.0.0-3851.g2ef5137f.el8.x86_64 131/134 2023-05-10T04:17:53.204 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-05-10T04:17:53.204 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-05-10T04:17:55.883 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-05-10T04:17:55.883 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:02:01 ago on Wed 10 May 2023 04:15:54 AM UTC. 2023-05-10T04:17:58.825 INFO:teuthology.orchestra.run.smithi132.stdout:Installed products updated. 2023-05-10T04:17:59.061 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:17:59.061 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2023-05-10T04:17:59.061 INFO:teuthology.orchestra.run.smithi132.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-05-10T04:17:59.062 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.062 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.062 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2023-05-10T04:17:59.062 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-05-10T04:17:59.062 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.1-7.el8.noarch 2023-05-10T04:17:59.062 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.0.4-10.el8.x86_64 2023-05-10T04:17:59.063 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.063 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.064 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.064 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.064 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.064 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.064 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.064 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.065 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.065 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.065 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.065 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.065 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.065 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.065 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.065 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.066 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.066 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.066 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.066 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.066 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.066 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.066 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:18.0.0-3851.g2ef5137f.el8.noarch 2023-05-10T04:17:59.067 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-05-10T04:17:59.067 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.1-9.el8.x86_64 2023-05-10T04:17:59.067 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.7-15.el8.x86_64 2023-05-10T04:17:59.067 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-05-10T04:17:59.067 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.6-3.el8.x86_64 2023-05-10T04:17:59.067 INFO:teuthology.orchestra.run.smithi132.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-05-10T04:17:59.067 INFO:teuthology.orchestra.run.smithi132.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-05-10T04:17:59.067 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-05-10T04:17:59.068 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.068 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.068 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.068 INFO:teuthology.orchestra.run.smithi132.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-05-10T04:17:59.068 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-05-10T04:17:59.068 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.2-3.el8.x86_64 2023-05-10T04:17:59.068 INFO:teuthology.orchestra.run.smithi132.stdout: libpq-13.5-1.el8.x86_64 2023-05-10T04:17:59.069 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-05-10T04:17:59.069 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-05-10T04:17:59.069 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.069 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.069 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-05-10T04:17:59.069 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.069 INFO:teuthology.orchestra.run.smithi132.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-05-10T04:17:59.070 INFO:teuthology.orchestra.run.smithi132.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-05-10T04:17:59.070 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-25.el8.x86_64 2023-05-10T04:17:59.070 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.3.1-3.el8.x86_64 2023-05-10T04:17:59.070 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-05-10T04:17:59.070 INFO:teuthology.orchestra.run.smithi132.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-05-10T04:17:59.070 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-05-10T04:17:59.070 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-05-10T04:17:59.070 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.15-3.el8.x86_64 2023-05-10T04:17:59.071 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-05-10T04:17:59.071 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-05-10T04:17:59.071 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-05-10T04:17:59.071 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-05-10T04:17:59.071 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-05-10T04:17:59.071 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-10T04:17:59.071 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-10T04:17:59.071 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-05-10T04:17:59.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-05-10T04:17:59.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.5.1-7.el8.noarch 2023-05-10T04:17:59.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-05-10T04:17:59.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-05-10T04:17:59.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-05-10T04:17:59.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.072 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-05-10T04:17:59.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-05-10T04:17:59.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-05-10T04:17:59.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-05-10T04:17:59.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-05-10T04:17:59.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-05-10T04:17:59.073 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-6.2-6.el8.noarch 2023-05-10T04:17:59.074 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-05-10T04:17:59.074 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-05-10T04:17:59.074 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-05-10T04:17:59.074 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-05-10T04:17:59.074 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-05-10T04:17:59.074 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-05-10T04:17:59.074 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-05-10T04:17:59.074 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.0.6-13.el8.noarch 2023-05-10T04:17:59.075 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-05-10T04:17:59.075 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-05-10T04:17:59.075 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-05-10T04:17:59.075 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-05-10T04:17:59.075 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-05-10T04:17:59.075 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-05-10T04:17:59.075 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-05-10T04:17:59.075 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-2.6-1.el8.noarch 2023-05-10T04:17:59.076 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-05-10T04:17:59.076 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-05-10T04:17:59.076 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-05-10T04:17:59.076 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-05-10T04:17:59.076 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.14-14.el8.noarch 2023-05-10T04:17:59.076 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2017.2-9.el8.noarch 2023-05-10T04:17:59.076 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.077 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.077 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-05-10T04:17:59.077 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-05-10T04:17:59.077 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.077 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.4.1-12.el8.noarch 2023-05-10T04:17:59.077 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.8-1.el8.noarch 2023-05-10T04:17:59.077 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-05-10T04:17:59.077 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-05-10T04:17:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-05-10T04:17:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-05-10T04:17:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-05-10T04:17:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2023-05-10T04:17:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-05-10T04:17:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-05-10T04:17:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-05-10T04:17:59.078 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-05-10T04:17:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-05-10T04:17:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:18.0.0-3851.g2ef5137f.el8.x86_64 2023-05-10T04:17:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-1.el8.x86_64 2023-05-10T04:17:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.13.0-2.el8.x86_64 2023-05-10T04:17:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-43.el8.x86_64 2023-05-10T04:17:59.079 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-05-10T04:17:59.080 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-05-10T04:17:59.080 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-05-10T04:17:59.080 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:17:59.081 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-05-10T04:17:59.365 DEBUG:teuthology.parallel:result is None 2023-05-10T04:17:59.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2ef5137fbb6e28908d2161218e7b594628c1b6d3 2023-05-10T04:17:59.508 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-10T04:17:59.559 INFO:teuthology.orchestra.run.smithi132.stdout:18.0.0-3851.g2ef5137f.el8 2023-05-10T04:17:59.560 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3851.g2ef5137f.el8 2023-05-10T04:17:59.560 INFO:teuthology.task.install:The correct ceph version 18.0.0-3851.g2ef5137f is installed. 2023-05-10T04:17:59.561 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=2ef5137fbb6e28908d2161218e7b594628c1b6d3 2023-05-10T04:17:59.698 DEBUG:teuthology.orchestra.run.smithi154:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-05-10T04:17:59.747 INFO:teuthology.orchestra.run.smithi154.stdout:18.0.0-3851.g2ef5137f.el8 2023-05-10T04:17:59.747 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3851.g2ef5137f.el8 2023-05-10T04:17:59.748 INFO:teuthology.task.install:The correct ceph version 18.0.0-3851.g2ef5137f is installed. 2023-05-10T04:17:59.748 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-10T04:17:59.749 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:17:59.749 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-10T04:17:59.837 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:17:59.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-10T04:17:59.923 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-10T04:17:59.924 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:17:59.924 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2023-05-10T04:17:59.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-10T04:18:00.093 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:00.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/daemon-helper 2023-05-10T04:18:00.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-10T04:18:00.263 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-10T04:18:00.263 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:00.263 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-10T04:18:00.324 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-10T04:18:00.425 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:00.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-10T04:18:00.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-10T04:18:00.587 INFO:teuthology.run_tasks:Running task ceph... 2023-05-10T04:18:00.661 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-10T04:18:00.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2023-05-10T04:18:00.666 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 777 /var/log/ceph 2023-05-10T04:18:00.730 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-10T04:18:00.730 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-10T04:18:00.734 DEBUG:teuthology.orchestra.run.smithi154:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-10T04:18:00.798 INFO:tasks.ceph:Creating extra log directories... 2023-05-10T04:18:00.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-10T04:18:00.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-10T04:18:00.895 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-10T04:18:00.896 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-10T04:18:00.897 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-10T04:18:00.897 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:00.897 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-10T04:18:00.934 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-10T04:18:01.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-10T04:18:01.442 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:01.443 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-10T04:18:01.482 DEBUG:teuthology.orchestra.run.smithi154:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-10T04:18:01.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-05-10T04:18:01.768 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-10T04:18:01.768 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-10T04:18:01.768 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi/7269329', 'branch': 'wip-vshankar-testing-20230509.054005', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7269329', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'f1e69e4d36541db1c678e2015bfdc10d07c10e5b'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-05-10_03:47:39-fs-wip-vshankar-testing-20230509.054005-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20230509.054005'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2ef5137fbb6e28908d2161218e7b594628c1b6d3'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2ef5137fbb6e28908d2161218e7b594628c1b6d3'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20230510.034551', 'sha1': '38d0174b6b3ad6dc690a927ef6824114d9a01704'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 30, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': '2ef5137fbb6e28908d2161218e7b594628c1b6d3', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20230510.034551', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_38d0174b6b3ad6dc690a927ef6824114d9a01704/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': '38d0174b6b3ad6dc690a927ef6824114d9a01704', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi132.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi154.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'f1e69e4d36541db1c678e2015bfdc10d07c10e5b'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2ef5137fbb6e28908d2161218e7b594628c1b6d3'}}, {'ceph': None}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-10_03:47:39', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-10T04:18:01.769 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-10T04:18:01.774 DEBUG:teuthology.orchestra.run.smithi154:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-10T04:18:01.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2023-05-10T04:18:01.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo install -d -m0777 -- /var/run/ceph 2023-05-10T04:18:01.918 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:01.919 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2023-05-10T04:18:01.958 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-10T04:18:01.959 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2023-05-10T04:18:02.039 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-10T04:18:02.216 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T04:18:02.217 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-05-10T04:18:02.217 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T04:18:02.217 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T04:18:02.218 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-05-10 04:17:52.715420430 +0000 2023-05-10T04:18:02.218 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-05-10 04:14:51.241616171 +0000 2023-05-10T04:18:02.218 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-05-10 04:14:51.241616171 +0000 2023-05-10T04:18:02.218 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-05-10 04:14:51.215616842 +0000 2023-05-10T04:18:02.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-10T04:18:02.277 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-05-10T04:18:02.278 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-05-10T04:18:02.278 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000321347 s, 1.6 MB/s 2023-05-10T04:18:02.280 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-10T04:18:02.322 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2023-05-10T04:18:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-10T04:18:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T04:18:02.403 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-05-10T04:18:02.403 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T04:18:02.403 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T04:18:02.403 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-05-10 04:17:52.715420430 +0000 2023-05-10T04:18:02.404 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-05-10 04:14:52.046595408 +0000 2023-05-10T04:18:02.404 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-05-10 04:14:52.046595408 +0000 2023-05-10T04:18:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-05-10 04:14:52.024595975 +0000 2023-05-10T04:18:02.404 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-10T04:18:02.501 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-05-10T04:18:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-05-10T04:18:02.502 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000270899 s, 1.9 MB/s 2023-05-10T04:18:02.504 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-10T04:18:02.546 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2023-05-10T04:18:02.625 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-10T04:18:02.625 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T04:18:02.626 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-05-10T04:18:02.626 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T04:18:02.626 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T04:18:02.626 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-05-10 04:17:52.715420430 +0000 2023-05-10T04:18:02.626 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-05-10 04:14:52.822575392 +0000 2023-05-10T04:18:02.627 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-05-10 04:14:52.822575392 +0000 2023-05-10T04:18:02.627 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-05-10 04:14:52.800575959 +0000 2023-05-10T04:18:02.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-10T04:18:02.723 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-05-10T04:18:02.724 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-05-10T04:18:02.724 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.00027749 s, 1.8 MB/s 2023-05-10T04:18:02.726 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-10T04:18:02.767 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2023-05-10T04:18:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-10T04:18:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T04:18:02.847 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-05-10T04:18:02.847 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T04:18:02.847 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T04:18:02.847 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-05-10 04:17:52.715420430 +0000 2023-05-10T04:18:02.848 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-05-10 04:14:53.639554319 +0000 2023-05-10T04:18:02.848 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-05-10 04:14:53.639554319 +0000 2023-05-10T04:18:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-05-10 04:14:53.615554938 +0000 2023-05-10T04:18:02.848 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-10T04:18:02.948 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-05-10T04:18:02.948 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-05-10T04:18:02.948 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000292693 s, 1.7 MB/s 2023-05-10T04:18:02.951 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-10T04:18:02.992 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:02.993 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:02.993 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/scratch_devs of=/dev/stdout 2023-05-10T04:18:03.031 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-10T04:18:03.032 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_1 2023-05-10T04:18:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-10T04:18:03.112 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T04:18:03.113 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-05-10T04:18:03.113 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T04:18:03.113 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T04:18:03.113 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-05-10 04:17:43.694593903 +0000 2023-05-10T04:18:03.113 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-05-10 04:12:55.645735395 +0000 2023-05-10T04:18:03.113 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-05-10 04:12:55.645735395 +0000 2023-05-10T04:18:03.113 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-05-10 04:12:55.618736112 +0000 2023-05-10T04:18:03.114 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-10T04:18:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-05-10T04:18:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-05-10T04:18:03.214 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00035179 s, 1.5 MB/s 2023-05-10T04:18:03.216 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-10T04:18:03.258 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_2 2023-05-10T04:18:03.338 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-10T04:18:03.338 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T04:18:03.338 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-05-10T04:18:03.339 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T04:18:03.339 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T04:18:03.339 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-05-10 04:17:43.694593903 +0000 2023-05-10T04:18:03.339 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-05-10 04:12:56.428714607 +0000 2023-05-10T04:18:03.339 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-05-10 04:12:56.428714607 +0000 2023-05-10T04:18:03.339 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-05-10 04:12:56.404715244 +0000 2023-05-10T04:18:03.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-10T04:18:03.440 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-05-10T04:18:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-05-10T04:18:03.441 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.000298512 s, 1.7 MB/s 2023-05-10T04:18:03.442 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-10T04:18:03.482 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_3 2023-05-10T04:18:03.561 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-10T04:18:03.561 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T04:18:03.561 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-05-10T04:18:03.561 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T04:18:03.561 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T04:18:03.562 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-05-10 04:17:43.694593903 +0000 2023-05-10T04:18:03.562 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-05-10 04:12:57.215693713 +0000 2023-05-10T04:18:03.562 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-05-10 04:12:57.215693713 +0000 2023-05-10T04:18:03.562 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-05-10 04:12:57.190694377 +0000 2023-05-10T04:18:03.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-10T04:18:03.659 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-05-10T04:18:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-05-10T04:18:03.660 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00030127 s, 1.7 MB/s 2023-05-10T04:18:03.662 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-10T04:18:03.702 DEBUG:teuthology.orchestra.run.smithi154:> stat /dev/vg_nvme/lv_4 2023-05-10T04:18:03.785 INFO:teuthology.orchestra.run.smithi154.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-10T04:18:03.785 INFO:teuthology.orchestra.run.smithi154.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-10T04:18:03.785 INFO:teuthology.orchestra.run.smithi154.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-05-10T04:18:03.786 INFO:teuthology.orchestra.run.smithi154.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-10T04:18:03.786 INFO:teuthology.orchestra.run.smithi154.stdout:Context: system_u:object_r:device_t:s0 2023-05-10T04:18:03.786 INFO:teuthology.orchestra.run.smithi154.stdout:Access: 2023-05-10 04:17:43.695593876 +0000 2023-05-10T04:18:03.786 INFO:teuthology.orchestra.run.smithi154.stdout:Modify: 2023-05-10 04:12:57.992673085 +0000 2023-05-10T04:18:03.786 INFO:teuthology.orchestra.run.smithi154.stdout:Change: 2023-05-10 04:12:57.992673085 +0000 2023-05-10T04:18:03.786 INFO:teuthology.orchestra.run.smithi154.stdout: Birth: 2023-05-10 04:12:57.968673722 +0000 2023-05-10T04:18:03.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-10T04:18:03.883 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records in 2023-05-10T04:18:03.883 INFO:teuthology.orchestra.run.smithi154.stderr:1+0 records out 2023-05-10T04:18:03.883 INFO:teuthology.orchestra.run.smithi154.stderr:512 bytes copied, 0.00031889 s, 1.6 MB/s 2023-05-10T04:18:03.885 DEBUG:teuthology.orchestra.run.smithi154:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-10T04:18:03.924 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:03.925 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-10T04:18:03.925 INFO:tasks.ceph:Generating config... 2023-05-10T04:18:03.926 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-10T04:18:03.927 INFO:tasks.ceph:[client] debug client = 20 2023-05-10T04:18:03.927 INFO:tasks.ceph:[client] debug ms = 1 2023-05-10T04:18:03.927 INFO:tasks.ceph:[client] pid file = 2023-05-10T04:18:03.927 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-10T04:18:03.927 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-10T04:18:03.928 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-10T04:18:03.928 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-10T04:18:03.928 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-10T04:18:03.928 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-10T04:18:03.928 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-10T04:18:03.929 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-10T04:18:03.929 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-10T04:18:03.929 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-10T04:18:03.929 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-10T04:18:03.929 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-10T04:18:03.930 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-10T04:18:03.930 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-10T04:18:03.930 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-10T04:18:03.930 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-10T04:18:03.930 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-10T04:18:03.930 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-10T04:18:03.931 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-10T04:18:03.931 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-10T04:18:03.931 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-05-10T04:18:03.931 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-05-10T04:18:03.931 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-10T04:18:03.932 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-10T04:18:03.932 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-05-10T04:18:03.932 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-10T04:18:03.932 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-10T04:18:03.932 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-10T04:18:03.933 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-10T04:18:03.933 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-10T04:18:03.933 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-10T04:18:03.933 INFO:tasks.ceph:Setting up mon.a... 2023-05-10T04:18:03.934 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-10T04:18:04.036 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.keyring 2023-05-10T04:18:04.042 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-10T04:18:04.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-10T04:18:04.194 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.132'), ('mon.b', '172.21.15.154'), ('mon.c', '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]')] 2023-05-10T04:18:04.195 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.132,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-10T04:18:04.196 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:04.196 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-10T04:18:04.233 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.132 --add b 172.21.15.154 --addv c '[v2:172.21.15.154:3301,v1:172.21.15.154:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:04.355 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:04.355 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: generated fsid 390ee88e-3ece-4689-996a-1bc273e3e6b7 2023-05-10T04:18:04.355 INFO:teuthology.orchestra.run.smithi132.stdout:setting min_mon_release = pacific 2023-05-10T04:18:04.356 INFO:teuthology.orchestra.run.smithi132.stdout:epoch 0 2023-05-10T04:18:04.356 INFO:teuthology.orchestra.run.smithi132.stdout:fsid 390ee88e-3ece-4689-996a-1bc273e3e6b7 2023-05-10T04:18:04.356 INFO:teuthology.orchestra.run.smithi132.stdout:last_changed 2023-05-10T04:18:04.354206+0000 2023-05-10T04:18:04.356 INFO:teuthology.orchestra.run.smithi132.stdout:created 2023-05-10T04:18:04.354206+0000 2023-05-10T04:18:04.356 INFO:teuthology.orchestra.run.smithi132.stdout:min_mon_release 16 (pacific) 2023-05-10T04:18:04.356 INFO:teuthology.orchestra.run.smithi132.stdout:election_strategy: 1 2023-05-10T04:18:04.356 INFO:teuthology.orchestra.run.smithi132.stdout:0: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.a 2023-05-10T04:18:04.356 INFO:teuthology.orchestra.run.smithi132.stdout:1: [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] mon.b 2023-05-10T04:18:04.357 INFO:teuthology.orchestra.run.smithi132.stdout:2: [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] mon.c 2023-05-10T04:18:04.357 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-10T04:18:04.358 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-10T04:18:04.397 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 390ee88e-3ece-4689-996a-1bc273e3e6b7... 2023-05-10T04:18:04.398 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-10T04:18:04.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-10T04:18:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2023-05-10T04:18:04.551 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2023-05-10T04:18:04.551 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-10T04:18:04.552 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2023-05-10T04:18:04.552 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.552 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2023-05-10T04:18:04.552 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.552 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2023-05-10T04:18:04.552 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.553 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2023-05-10T04:18:04.553 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2023-05-10T04:18:04.553 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.553 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2023-05-10T04:18:04.554 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2023-05-10T04:18:04.554 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.554 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-10T04:18:04.554 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2023-05-10T04:18:04.554 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.555 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2023-05-10T04:18:04.555 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-10T04:18:04.559 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.559 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2023-05-10T04:18:04.559 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.559 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2023-05-10T04:18:04.559 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2023-05-10T04:18:04.559 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2023-05-10T04:18:04.559 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2023-05-10T04:18:04.560 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2023-05-10T04:18:04.560 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2023-05-10T04:18:04.560 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2023-05-10T04:18:04.560 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-10T04:18:04.560 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-10T04:18:04.560 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2023-05-10T04:18:04.560 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.561 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-10T04:18:04.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.561 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2023-05-10T04:18:04.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.561 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2023-05-10T04:18:04.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.561 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2023-05-10T04:18:04.561 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2023-05-10T04:18:04.562 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2023-05-10T04:18:04.562 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.132,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2023-05-10T04:18:04.562 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 390ee88e-3ece-4689-996a-1bc273e3e6b7 2023-05-10T04:18:04.562 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2023-05-10T04:18:04.562 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2023-05-10T04:18:04.562 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.562 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2023-05-10T04:18:04.563 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2023-05-10T04:18:04.563 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.563 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2023-05-10T04:18:04.563 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2023-05-10T04:18:04.563 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.563 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2023-05-10T04:18:04.563 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2023-05-10T04:18:04.564 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2023-05-10T04:18:04.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.564 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2023-05-10T04:18:04.564 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2023-05-10T04:18:04.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.564 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2023-05-10T04:18:04.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.564 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2023-05-10T04:18:04.565 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.565 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2023-05-10T04:18:04.565 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.565 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2023-05-10T04:18:04.565 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2023-05-10T04:18:04.565 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.565 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2023-05-10T04:18:04.566 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2023-05-10T04:18:04.566 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2023-05-10T04:18:04.566 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2023-05-10T04:18:04.566 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 20 2023-05-10T04:18:04.566 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 20 2023-05-10T04:18:04.566 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-05-10T04:18:04.566 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2023-05-10T04:18:04.567 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 10 2023-05-10T04:18:04.567 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2023-05-10T04:18:04.567 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2023-05-10T04:18:04.567 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2023-05-10T04:18:04.567 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2023-05-10T04:18:04.567 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2023-05-10T04:18:04.567 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-05-10T04:18:04.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2023-05-10T04:18:04.568 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-05-10T04:18:04.568 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2023-05-10T04:18:04.568 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-05-10T04:18:04.568 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-05-10T04:18:04.568 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-05-10T04:18:04.568 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-05-10T04:18:04.569 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2023-05-10T04:18:04.569 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2023-05-10T04:18:04.570 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-05-10T04:18:04.570 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-05-10T04:18:04.570 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2023-05-10T04:18:04.570 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-05-10T04:18:04.570 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2023-05-10T04:18:04.570 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2023-05-10T04:18:04.571 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-05-10T04:18:04.571 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2023-05-10T04:18:04.571 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2023-05-10T04:18:04.571 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-05-10T04:18:04.571 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.571 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-10T04:18:04.571 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2023-05-10T04:18:04.572 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2023-05-10T04:18:04.572 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.572 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2023-05-10T04:18:04.572 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-10T04:18:04.572 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-10T04:18:04.572 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.574 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2023-05-10T04:18:04.574 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2023-05-10T04:18:04.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.575 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2023-05-10T04:18:04.575 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2023-05-10T04:18:04.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2023-05-10T04:18:04.575 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2023-05-10T04:18:04.575 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2023-05-10T04:18:04.575 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2023-05-10T04:18:04.576 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-10T04:18:04.576 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-10T04:18:04.576 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2023-05-10T04:18:04.576 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-05-10T04:18:04.576 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-05-10T04:18:04.576 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = "" 2023-05-10T04:18:04.577 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-05-10T04:18:04.577 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-05-10T04:18:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2023-05-10T04:18:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2023-05-10T04:18:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2023-05-10T04:18:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-05-10T04:18:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-05-10T04:18:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-05-10T04:18:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-05-10T04:18:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2023-05-10T04:18:04.578 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2023-05-10T04:18:04.578 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2023-05-10T04:18:04.578 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-05-10T04:18:04.578 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2023-05-10T04:18:04.578 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2023-05-10T04:18:04.578 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2023-05-10T04:18:04.579 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2023-05-10T04:18:04.579 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-05-10T04:18:04.579 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-05-10T04:18:04.579 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-05-10T04:18:04.580 INFO:teuthology.orchestra.run.smithi154.stdout:[global] 2023-05-10T04:18:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: chdir = "" 2023-05-10T04:18:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-10T04:18:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: auth supported = cephx 2023-05-10T04:18:04.580 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.581 INFO:teuthology.orchestra.run.smithi154.stdout: filestore xattr use omap = true 2023-05-10T04:18:04.581 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.581 INFO:teuthology.orchestra.run.smithi154.stdout: mon clock drift allowed = 1.000 2023-05-10T04:18:04.581 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.581 INFO:teuthology.orchestra.run.smithi154.stdout: osd crush chooseleaf type = 0 2023-05-10T04:18:04.581 INFO:teuthology.orchestra.run.smithi154.stdout: auth debug = true 2023-05-10T04:18:04.581 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.582 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on old message = true 2023-05-10T04:18:04.582 INFO:teuthology.orchestra.run.smithi154.stdout: ms die on bug = true 2023-05-10T04:18:04.582 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.582 INFO:teuthology.orchestra.run.smithi154.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-10T04:18:04.582 INFO:teuthology.orchestra.run.smithi154.stdout: mon pg warn max object skew = 0 2023-05-10T04:18:04.582 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.582 INFO:teuthology.orchestra.run.smithi154.stdout: # disable pg_autoscaler by default for new pools 2023-05-10T04:18:04.582 INFO:teuthology.orchestra.run.smithi154.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-10T04:18:04.583 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.583 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default size = 2 2023-05-10T04:18:04.583 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.583 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow primary affinity = true 2023-05-10T04:18:04.583 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd allow pg remap = true 2023-05-10T04:18:04.583 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on legacy crush tunables = false 2023-05-10T04:18:04.583 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on crush straw calc version zero = false 2023-05-10T04:18:04.583 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on no sortbitwise = false 2023-05-10T04:18:04.584 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on osd down out interval zero = false 2023-05-10T04:18:04.584 INFO:teuthology.orchestra.run.smithi154.stdout: mon warn on too few osds = false 2023-05-10T04:18:04.584 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-10T04:18:04.584 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-10T04:18:04.584 INFO:teuthology.orchestra.run.smithi154.stdout: mon_allow_pool_size_one = true 2023-05-10T04:18:04.584 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.584 INFO:teuthology.orchestra.run.smithi154.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-10T04:18:04.584 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.585 INFO:teuthology.orchestra.run.smithi154.stdout: osd default data pool replay window = 5 2023-05-10T04:18:04.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.585 INFO:teuthology.orchestra.run.smithi154.stdout: mon allow pool delete = true 2023-05-10T04:18:04.585 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.585 INFO:teuthology.orchestra.run.smithi154.stdout: mon cluster log file level = debug 2023-05-10T04:18:04.585 INFO:teuthology.orchestra.run.smithi154.stdout: debug asserts on shutdown = true 2023-05-10T04:18:04.585 INFO:teuthology.orchestra.run.smithi154.stdout: mon health detail to clog = false 2023-05-10T04:18:04.586 INFO:teuthology.orchestra.run.smithi154.stdout: mon host = "172.21.15.132,172.21.15.154,[v2:172.21.15.154:3301,v1:172.21.15.154:6790]" 2023-05-10T04:18:04.586 INFO:teuthology.orchestra.run.smithi154.stdout: fsid = 390ee88e-3ece-4689-996a-1bc273e3e6b7 2023-05-10T04:18:04.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.586 INFO:teuthology.orchestra.run.smithi154.stdout:[osd] 2023-05-10T04:18:04.586 INFO:teuthology.orchestra.run.smithi154.stdout: osd journal size = 100 2023-05-10T04:18:04.586 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.586 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub load threshold = 5.0 2023-05-10T04:18:04.586 INFO:teuthology.orchestra.run.smithi154.stdout: osd scrub max interval = 600 2023-05-10T04:18:04.587 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.587 INFO:teuthology.orchestra.run.smithi154.stdout: osd recover clone overlap = true 2023-05-10T04:18:04.587 INFO:teuthology.orchestra.run.smithi154.stdout: osd recovery max chunk = 1048576 2023-05-10T04:18:04.587 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.587 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug shutdown = true 2023-05-10T04:18:04.587 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug op order = true 2023-05-10T04:18:04.587 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug verify stray on activate = true 2023-05-10T04:18:04.587 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.588 INFO:teuthology.orchestra.run.smithi154.stdout: osd open classes on start = true 2023-05-10T04:18:04.588 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug pg log writeout = true 2023-05-10T04:18:04.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.588 INFO:teuthology.orchestra.run.smithi154.stdout: osd deep scrub update digest min age = 30 2023-05-10T04:18:04.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.588 INFO:teuthology.orchestra.run.smithi154.stdout: osd map max advance = 10 2023-05-10T04:18:04.588 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.589 INFO:teuthology.orchestra.run.smithi154.stdout: journal zero on create = true 2023-05-10T04:18:04.589 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.589 INFO:teuthology.orchestra.run.smithi154.stdout: filestore ondisk finisher threads = 3 2023-05-10T04:18:04.589 INFO:teuthology.orchestra.run.smithi154.stdout: filestore apply finisher threads = 3 2023-05-10T04:18:04.589 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.589 INFO:teuthology.orchestra.run.smithi154.stdout: bdev debug aio = true 2023-05-10T04:18:04.589 INFO:teuthology.orchestra.run.smithi154.stdout: osd debug misdirected ops = true 2023-05-10T04:18:04.589 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore block size = 96636764160 2023-05-10T04:18:04.590 INFO:teuthology.orchestra.run.smithi154.stdout: bluestore fsck on mount = True 2023-05-10T04:18:04.590 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluefs = 20 2023-05-10T04:18:04.590 INFO:teuthology.orchestra.run.smithi154.stdout: debug bluestore = 20 2023-05-10T04:18:04.590 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-05-10T04:18:04.590 INFO:teuthology.orchestra.run.smithi154.stdout: debug osd = 20 2023-05-10T04:18:04.590 INFO:teuthology.orchestra.run.smithi154.stdout: debug rocksdb = 10 2023-05-10T04:18:04.590 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd backfillfull_ratio = 0.85 2023-05-10T04:18:04.591 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd full ratio = 0.9 2023-05-10T04:18:04.591 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd nearfull ratio = 0.8 2023-05-10T04:18:04.591 INFO:teuthology.orchestra.run.smithi154.stdout: osd failsafe full ratio = 0.95 2023-05-10T04:18:04.591 INFO:teuthology.orchestra.run.smithi154.stdout: osd objectstore = bluestore 2023-05-10T04:18:04.591 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-05-10T04:18:04.591 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.591 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr] 2023-05-10T04:18:04.592 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-05-10T04:18:04.592 INFO:teuthology.orchestra.run.smithi154.stdout: debug mgr = 20 2023-05-10T04:18:04.592 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-05-10T04:18:04.592 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-05-10T04:18:04.592 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-05-10T04:18:04.592 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-05-10T04:18:04.593 INFO:teuthology.orchestra.run.smithi154.stdout: mgr/telemetry/nag = false 2023-05-10T04:18:04.593 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.593 INFO:teuthology.orchestra.run.smithi154.stdout:[mon] 2023-05-10T04:18:04.593 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-05-10T04:18:04.593 INFO:teuthology.orchestra.run.smithi154.stdout: debug mon = 20 2023-05-10T04:18:04.593 INFO:teuthology.orchestra.run.smithi154.stdout: debug paxos = 20 2023-05-10T04:18:04.593 INFO:teuthology.orchestra.run.smithi154.stdout: debug auth = 20 2023-05-10T04:18:04.593 INFO:teuthology.orchestra.run.smithi154.stdout: mon data avail warn = 5 2023-05-10T04:18:04.594 INFO:teuthology.orchestra.run.smithi154.stdout: mon mgr mkfs grace = 240 2023-05-10T04:18:04.594 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min pgs per osd = 4 2023-05-10T04:18:04.594 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd reporter subtree level = osd 2023-05-10T04:18:04.594 INFO:teuthology.orchestra.run.smithi154.stdout: mon osd prime pg temp = true 2023-05-10T04:18:04.594 INFO:teuthology.orchestra.run.smithi154.stdout: mon reweight min bytes per osd = 10 2023-05-10T04:18:04.594 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.594 INFO:teuthology.orchestra.run.smithi154.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-10T04:18:04.595 INFO:teuthology.orchestra.run.smithi154.stdout: auth mon ticket ttl = 660 # 11m 2023-05-10T04:18:04.595 INFO:teuthology.orchestra.run.smithi154.stdout: auth service ticket ttl = 240 # 4m 2023-05-10T04:18:04.595 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.595 INFO:teuthology.orchestra.run.smithi154.stdout: # don't complain about insecure global_id in the test suite 2023-05-10T04:18:04.595 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-10T04:18:04.595 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-10T04:18:04.595 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.595 INFO:teuthology.orchestra.run.smithi154.stdout: # 1m isn't quite enough 2023-05-10T04:18:04.596 INFO:teuthology.orchestra.run.smithi154.stdout: mon_down_mkfs_grace = 2m 2023-05-10T04:18:04.596 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.596 INFO:teuthology.orchestra.run.smithi154.stdout: mon_warn_on_filestore_osds = false 2023-05-10T04:18:04.596 INFO:teuthology.orchestra.run.smithi154.stdout: mon op complaint time = 120 2023-05-10T04:18:04.596 INFO:teuthology.orchestra.run.smithi154.stdout: 2023-05-10T04:18:04.596 INFO:teuthology.orchestra.run.smithi154.stdout:[client] 2023-05-10T04:18:04.596 INFO:teuthology.orchestra.run.smithi154.stdout: rgw cache enabled = true 2023-05-10T04:18:04.597 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable ops log = true 2023-05-10T04:18:04.597 INFO:teuthology.orchestra.run.smithi154.stdout: rgw enable usage log = true 2023-05-10T04:18:04.597 INFO:teuthology.orchestra.run.smithi154.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-10T04:18:04.597 INFO:teuthology.orchestra.run.smithi154.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-10T04:18:04.597 INFO:teuthology.orchestra.run.smithi154.stdout: client mount timeout = 600 2023-05-10T04:18:04.597 INFO:teuthology.orchestra.run.smithi154.stdout: debug client = 20 2023-05-10T04:18:04.597 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-05-10T04:18:04.598 INFO:teuthology.orchestra.run.smithi154.stdout: pid file = "" 2023-05-10T04:18:04.598 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-05-10T04:18:04.598 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-05-10T04:18:04.598 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.a] 2023-05-10T04:18:04.598 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.b] 2023-05-10T04:18:04.598 INFO:teuthology.orchestra.run.smithi154.stdout:[mon.c] 2023-05-10T04:18:04.598 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-05-10T04:18:04.598 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-05-10T04:18:04.599 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-05-10T04:18:04.599 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-05-10T04:18:04.599 INFO:teuthology.orchestra.run.smithi154.stdout:[mds] 2023-05-10T04:18:04.599 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds = 20 2023-05-10T04:18:04.599 INFO:teuthology.orchestra.run.smithi154.stdout: debug mds balancer = 20 2023-05-10T04:18:04.599 INFO:teuthology.orchestra.run.smithi154.stdout: debug ms = 1 2023-05-10T04:18:04.599 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug frag = True 2023-05-10T04:18:04.599 INFO:teuthology.orchestra.run.smithi154.stdout: mds debug scatterstat = True 2023-05-10T04:18:04.600 INFO:teuthology.orchestra.run.smithi154.stdout: mds op complaint time = 180 2023-05-10T04:18:04.600 INFO:teuthology.orchestra.run.smithi154.stdout: mds verify scatter = True 2023-05-10T04:18:04.600 INFO:teuthology.orchestra.run.smithi154.stdout: osd op complaint time = 180 2023-05-10T04:18:04.600 INFO:teuthology.orchestra.run.smithi154.stdout: rados mon op timeout = 900 2023-05-10T04:18:04.600 INFO:teuthology.orchestra.run.smithi154.stdout: rados osd op timeout = 900 2023-05-10T04:18:04.602 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-10T04:18:04.602 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-10T04:18:04.705 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-10T04:18:04.706 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:04.706 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-10T04:18:04.744 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:04.745 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-10T04:18:04.825 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T04:18:04.826 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:04.826 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-10T04:18:04.826 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-10T04:18:04.952 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:04.952 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:05.031 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi154.front.sepia.ceph.com 2023-05-10T04:18:05.031 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:05.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-10T04:18:05.032 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-10T04:18:05.120 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:05.121 DEBUG:teuthology.orchestra.run.smithi154:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:05.200 INFO:tasks.ceph:Setting up mon nodes... 2023-05-10T04:18:05.201 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-10T04:18:05.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-10T04:18:05.324 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-10T04:18:05.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-10T04:18:05.467 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-10T04:18:05.473 INFO:tasks.ceph:Setting up mds nodes... 2023-05-10T04:18:05.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-10T04:18:05.589 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-10T04:18:05.594 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-10T04:18:05.656 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-10T04:18:05.769 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-10T04:18:05.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-10T04:18:05.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-10T04:18:05.952 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-10T04:18:05.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-10T04:18:06.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-05-10T04:18:06.135 INFO:teuthology.orchestra.run.smithi154.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-05-10T04:18:06.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-05-10T04:18:06.203 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-10T04:18:06.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-10T04:18:06.291 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-10T04:18:06.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-05-10T04:18:06.408 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-05-10T04:18:06.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-05-10T04:18:06.527 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-05-10T04:18:06.561 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-05-10T04:18:06.652 INFO:teuthology.orchestra.run.smithi154.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-05-10T04:18:06.682 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-10T04:18:06.682 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi154.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-10T04:18:06.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-10T04:18:06.743 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:06.744 INFO:tasks.ceph:role: osd.0 2023-05-10T04:18:06.744 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T04:18:06.744 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-10T04:18:06.810 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T04:18:06.810 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T04:18:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T04:18:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-10T04:18:06.811 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T04:18:06.811 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-05-10T04:18:06.811 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T04:18:06.812 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T04:18:06.812 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T04:18:06.812 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T04:18:07.242 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-05-10T04:18:07.245 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-05-10T04:18:07.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-10T04:18:07.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-10T04:18:07.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-10T04:18:07.567 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:07.568 INFO:tasks.ceph:role: osd.1 2023-05-10T04:18:07.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T04:18:07.568 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-10T04:18:07.637 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T04:18:07.638 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T04:18:07.638 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T04:18:07.638 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-10T04:18:07.638 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T04:18:07.638 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-05-10T04:18:07.638 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T04:18:07.638 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T04:18:07.639 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T04:18:07.639 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T04:18:08.042 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-05-10T04:18:08.046 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-05-10T04:18:08.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-10T04:18:08.162 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-10T04:18:08.233 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-10T04:18:08.294 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:08.295 INFO:tasks.ceph:role: osd.2 2023-05-10T04:18:08.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T04:18:08.295 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-10T04:18:08.363 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T04:18:08.363 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T04:18:08.364 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T04:18:08.364 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-10T04:18:08.364 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T04:18:08.364 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-05-10T04:18:08.364 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T04:18:08.364 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T04:18:08.364 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T04:18:08.365 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T04:18:08.810 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-05-10T04:18:08.814 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-05-10T04:18:08.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-10T04:18:08.972 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-10T04:18:09.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-10T04:18:09.106 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:09.107 INFO:tasks.ceph:role: osd.3 2023-05-10T04:18:09.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T04:18:09.107 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-10T04:18:09.175 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T04:18:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T04:18:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T04:18:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-10T04:18:09.175 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T04:18:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-05-10T04:18:09.176 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T04:18:09.176 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T04:18:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T04:18:09.176 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T04:18:09.618 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-05-10T04:18:09.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-05-10T04:18:09.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-10T04:18:09.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-10T04:18:09.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:09.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:09.987+0000 7f1b022a1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-10T04:18:09.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:09.988+0000 7f1b022a1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-10T04:18:09.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:09.988+0000 7f1b022a1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-10T04:18:09.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:09.988+0000 7f1b022a1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-10T04:18:09.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:09.988+0000 7f1b022a1640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-10T04:18:09.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:09.990+0000 7f1b022a1640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-10T04:18:12.941 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-10T04:18:13.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:13.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:13.097+0000 7fe6293d3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-10T04:18:13.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:13.097+0000 7fe6293d3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-10T04:18:13.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:13.097+0000 7fe6293d3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-10T04:18:13.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:13.097+0000 7fe6293d3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-10T04:18:13.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:13.097+0000 7fe6293d3640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-10T04:18:13.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:13.099+0000 7fe6293d3640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-10T04:18:16.076 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-10T04:18:16.142 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:16.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:16.236+0000 7f547440a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-10T04:18:16.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:16.237+0000 7f547440a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-10T04:18:16.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:16.237+0000 7f547440a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-10T04:18:16.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:16.237+0000 7f547440a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-10T04:18:16.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:16.237+0000 7f547440a640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-10T04:18:16.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:16.238+0000 7f547440a640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-10T04:18:19.154 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-10T04:18:19.221 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:19.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:19.318+0000 7f8d8ba4a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-10T04:18:19.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:19.318+0000 7f8d8ba4a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-10T04:18:19.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:19.318+0000 7f8d8ba4a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-10T04:18:19.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:19.318+0000 7f8d8ba4a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-10T04:18:19.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:19.318+0000 7f8d8ba4a640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-10T04:18:19.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:19.320+0000 7f8d8ba4a640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-10T04:18:22.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-10T04:18:22.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-10T04:18:22.377 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:22.377 INFO:tasks.ceph:role: osd.4 2023-05-10T04:18:22.377 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com 2023-05-10T04:18:22.378 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-10T04:18:22.447 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T04:18:22.447 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T04:18:22.447 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T04:18:22.447 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-10T04:18:22.447 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T04:18:22.447 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-05-10T04:18:22.448 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T04:18:22.448 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T04:18:22.448 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T04:18:22.448 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T04:18:22.875 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-05-10T04:18:22.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-05-10T04:18:22.879 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-10T04:18:23.072 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-10T04:18:23.146 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-10T04:18:23.208 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:23.209 INFO:tasks.ceph:role: osd.5 2023-05-10T04:18:23.209 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com 2023-05-10T04:18:23.209 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-10T04:18:23.279 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T04:18:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T04:18:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T04:18:23.279 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-10T04:18:23.280 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T04:18:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-05-10T04:18:23.280 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T04:18:23.280 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T04:18:23.280 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T04:18:23.280 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T04:18:23.688 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-05-10T04:18:23.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-05-10T04:18:23.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-10T04:18:23.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-10T04:18:23.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-10T04:18:23.970 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:23.970 INFO:tasks.ceph:role: osd.6 2023-05-10T04:18:23.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com 2023-05-10T04:18:23.971 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-10T04:18:24.044 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T04:18:24.044 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T04:18:24.045 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T04:18:24.045 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-10T04:18:24.045 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T04:18:24.045 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-05-10T04:18:24.045 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T04:18:24.045 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T04:18:24.046 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T04:18:24.046 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T04:18:24.486 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-05-10T04:18:24.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-05-10T04:18:24.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-10T04:18:24.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-10T04:18:24.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-10T04:18:24.806 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-10T04:18:24.807 INFO:tasks.ceph:role: osd.7 2023-05-10T04:18:24.807 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com 2023-05-10T04:18:24.807 DEBUG:teuthology.orchestra.run.smithi154:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-10T04:18:24.879 INFO:teuthology.orchestra.run.smithi154.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-10T04:18:24.879 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-10T04:18:24.879 INFO:teuthology.orchestra.run.smithi154.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-10T04:18:24.880 INFO:teuthology.orchestra.run.smithi154.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-10T04:18:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-10T04:18:24.880 INFO:teuthology.orchestra.run.smithi154.stdout: = sunit=0 swidth=0 blks 2023-05-10T04:18:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-10T04:18:24.880 INFO:teuthology.orchestra.run.smithi154.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-10T04:18:24.881 INFO:teuthology.orchestra.run.smithi154.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-10T04:18:24.881 INFO:teuthology.orchestra.run.smithi154.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-10T04:18:25.300 INFO:teuthology.orchestra.run.smithi154.stdout:Discarding blocks...Done. 2023-05-10T04:18:25.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi154.front.sepia.ceph.com -o noatime 2023-05-10T04:18:25.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-10T04:18:25.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-10T04:18:25.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:25.646 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:25.644+0000 7f158a978640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-10T04:18:25.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:25.645+0000 7f158a978640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-10T04:18:25.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:25.645+0000 7f158a978640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-10T04:18:25.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:25.645+0000 7f158a978640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-10T04:18:25.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:25.645+0000 7f158a978640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-10T04:18:25.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:25.647+0000 7f158a978640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-10T04:18:28.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-10T04:18:28.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:28.766 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:28.764+0000 7f16b97c9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-10T04:18:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:28.765+0000 7f16b97c9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-10T04:18:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:28.765+0000 7f16b97c9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-10T04:18:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:28.765+0000 7f16b97c9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-10T04:18:28.767 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:28.765+0000 7f16b97c9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-10T04:18:28.768 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:28.766+0000 7f16b97c9640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-10T04:18:31.662 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-10T04:18:31.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:31.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:18:31.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:18:31.829 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:31.827+0000 7f99150fe640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-10T04:18:31.830 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:31.828+0000 7f99150fe640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-10T04:18:31.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:31.828+0000 7f99150fe640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-10T04:18:31.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:31.828+0000 7f99150fe640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-10T04:18:31.831 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:31.828+0000 7f99150fe640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-10T04:18:31.832 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:31.829+0000 7f99150fe640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-10T04:18:34.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-10T04:18:34.780 DEBUG:teuthology.orchestra.run.smithi154:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:34.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:34.874+0000 7f874261d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-10T04:18:34.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:34.874+0000 7f874261d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-10T04:18:34.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:34.874+0000 7f874261d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-10T04:18:34.876 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:34.874+0000 7f874261d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-10T04:18:34.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:34.874+0000 7f874261d640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-10T04:18:34.877 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:34.876+0000 7f874261d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-10T04:18:37.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-10T04:18:37.816 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-10T04:18:37.817 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:37.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-10T04:18:37.879 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:37.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-10T04:18:37.981 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:37.982 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-10T04:18:38.082 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:38.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-10T04:18:38.185 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:38.186 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-10T04:18:38.286 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:38.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-10T04:18:38.386 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:38.387 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-10T04:18:38.489 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:38.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-10T04:18:38.559 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:38.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-10T04:18:38.662 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:38.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-05-10T04:18:38.764 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:38.765 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-10T04:18:38.866 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:38.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-10T04:18:38.966 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:38.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-10T04:18:39.066 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:39.066 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-10T04:18:39.166 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:39.166 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-10T04:18:39.204 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:39.204 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-05-10T04:18:39.284 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:39.284 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-05-10T04:18:39.322 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:39.322 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-05-10T04:18:39.399 INFO:tasks.ceph:Adding keys to all mons... 2023-05-10T04:18:39.399 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-10T04:18:39.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-10T04:18:39.459 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2023-05-10T04:18:39.459 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD9GltkFddFExAAEvVVUufCAFZxGNn4r3Hbng== 2023-05-10T04:18:39.459 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-05-10T04:18:39.459 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD9GltkGboSIxAANVeTng29GZoenorLpF+wqQ== 2023-05-10T04:18:39.459 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-05-10T04:18:39.460 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD9GltklZXRLRAAUJtXhsJeUM4XOK9H39H+og== 2023-05-10T04:18:39.460 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2023-05-10T04:18:39.460 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQABG1tknZz1OhAAt6+Ek3tWpayOz1TWbRkfeQ== 2023-05-10T04:18:39.460 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2023-05-10T04:18:39.460 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAFG1tkstvnBRAANJhhErtvfkz0knSYKq8F5A== 2023-05-10T04:18:39.460 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2023-05-10T04:18:39.460 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAIG1tkSHQ6DhAAkQPXaIUKNp51/WPkB1okaQ== 2023-05-10T04:18:39.461 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2023-05-10T04:18:39.461 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQALG1tkQaUGExAAYCWM+m8D469dHlWK1lMzKw== 2023-05-10T04:18:39.461 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2023-05-10T04:18:39.461 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD9GltkDe/NGxAAs5VopmFAmxF00MWTqk+CMQ== 2023-05-10T04:18:39.461 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-05-10T04:18:39.461 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD9GltkVsyxOBAAkNxpFzXux3SD5Bws/NNb5w== 2023-05-10T04:18:39.461 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-05-10T04:18:39.461 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD+GltkZMUKCBAAOEya1nJz+dwadqggjDY7Gg== 2023-05-10T04:18:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2023-05-10T04:18:39.462 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQARG1tkwox7JhAAKHtst55ILgIysBcYKl6HZA== 2023-05-10T04:18:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2023-05-10T04:18:39.462 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAUG1tkpOWkLRAADvd4Asp5yKv2z5byqWvbEA== 2023-05-10T04:18:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2023-05-10T04:18:39.462 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAXG1tkYzJmMRAA/wUbtwozLornUKLWCM1xZw== 2023-05-10T04:18:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2023-05-10T04:18:39.462 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAaG1tkgo8oNBAArOHZpegQMdZN/UTsniCCSQ== 2023-05-10T04:18:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-05-10T04:18:39.463 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD+Gltk3wdTERAAbpH7ragpXf4eKgvv2UW2Ww== 2023-05-10T04:18:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:[client.2] 2023-05-10T04:18:39.463 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD+Gltk2adJGBAANWDUzaxLqQmP28q3FfRBHg== 2023-05-10T04:18:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-05-10T04:18:39.463 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD+Gltkck1jHxAAcTQ6TzQtGEgAwd2wv1pDbA== 2023-05-10T04:18:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:[client.3] 2023-05-10T04:18:39.464 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD+GltkZK3TJhAATsv/qK5kipmpNiWbE9295Q== 2023-05-10T04:18:39.497 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.y] 2023-05-10T04:18:39.497 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD9GltkFddFExAAEvVVUufCAFZxGNn4r3Hbng== 2023-05-10T04:18:39.497 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.a] 2023-05-10T04:18:39.498 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD9GltkGboSIxAANVeTng29GZoenorLpF+wqQ== 2023-05-10T04:18:39.498 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.c] 2023-05-10T04:18:39.498 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD9GltklZXRLRAAUJtXhsJeUM4XOK9H39H+og== 2023-05-10T04:18:39.498 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.0] 2023-05-10T04:18:39.498 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQABG1tknZz1OhAAt6+Ek3tWpayOz1TWbRkfeQ== 2023-05-10T04:18:39.498 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.1] 2023-05-10T04:18:39.498 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAFG1tkstvnBRAANJhhErtvfkz0knSYKq8F5A== 2023-05-10T04:18:39.498 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.2] 2023-05-10T04:18:39.499 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAIG1tkSHQ6DhAAkQPXaIUKNp51/WPkB1okaQ== 2023-05-10T04:18:39.499 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.3] 2023-05-10T04:18:39.499 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQALG1tkQaUGExAAYCWM+m8D469dHlWK1lMzKw== 2023-05-10T04:18:39.499 INFO:teuthology.orchestra.run.smithi154.stdout:[mgr.x] 2023-05-10T04:18:39.499 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD9GltkDe/NGxAAs5VopmFAmxF00MWTqk+CMQ== 2023-05-10T04:18:39.499 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.b] 2023-05-10T04:18:39.499 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD9GltkVsyxOBAAkNxpFzXux3SD5Bws/NNb5w== 2023-05-10T04:18:39.500 INFO:teuthology.orchestra.run.smithi154.stdout:[mds.d] 2023-05-10T04:18:39.500 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD+GltkZMUKCBAAOEya1nJz+dwadqggjDY7Gg== 2023-05-10T04:18:39.500 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.4] 2023-05-10T04:18:39.500 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQARG1tkwox7JhAAKHtst55ILgIysBcYKl6HZA== 2023-05-10T04:18:39.500 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.5] 2023-05-10T04:18:39.500 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAUG1tkpOWkLRAADvd4Asp5yKv2z5byqWvbEA== 2023-05-10T04:18:39.500 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.6] 2023-05-10T04:18:39.501 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAXG1tkYzJmMRAA/wUbtwozLornUKLWCM1xZw== 2023-05-10T04:18:39.501 INFO:teuthology.orchestra.run.smithi154.stdout:[osd.7] 2023-05-10T04:18:39.501 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQAaG1tkgo8oNBAArOHZpegQMdZN/UTsniCCSQ== 2023-05-10T04:18:39.501 INFO:teuthology.orchestra.run.smithi154.stdout:[client.0] 2023-05-10T04:18:39.502 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD+Gltk3wdTERAAbpH7ragpXf4eKgvv2UW2Ww== 2023-05-10T04:18:39.502 INFO:teuthology.orchestra.run.smithi154.stdout:[client.2] 2023-05-10T04:18:39.502 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD+Gltk2adJGBAANWDUzaxLqQmP28q3FfRBHg== 2023-05-10T04:18:39.502 INFO:teuthology.orchestra.run.smithi154.stdout:[client.1] 2023-05-10T04:18:39.502 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD+Gltkck1jHxAAcTQ6TzQtGEgAwd2wv1pDbA== 2023-05-10T04:18:39.502 INFO:teuthology.orchestra.run.smithi154.stdout:[client.3] 2023-05-10T04:18:39.502 INFO:teuthology.orchestra.run.smithi154.stdout: key = AQD+GltkZK3TJhAATsv/qK5kipmpNiWbE9295Q== 2023-05-10T04:18:39.503 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-10T04:18:39.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-10T04:18:39.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T04:18:39.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T04:18:39.757 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T04:18:39.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T04:18:39.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:39.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:39.965 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:39.969 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.068 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.076 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-10T04:18:40.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-10T04:18:40.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T04:18:40.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T04:18:40.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T04:18:40.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-10T04:18:40.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.596 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.803 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.902 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:40.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-10T04:18:41.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T04:18:41.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T04:18:41.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T04:18:41.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T04:18:41.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T04:18:41.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T04:18:41.323 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T04:18:41.328 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-10T04:18:41.429 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-10T04:18:41.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-10T04:18:41.492 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-10T04:18:41.607 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-10T04:18:41.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-10T04:18:41.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-10T04:18:41.843 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-10T04:18:41.904 DEBUG:teuthology.orchestra.run.smithi154:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-10T04:18:41.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-10T04:18:42.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-10T04:18:42.141 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:42.145 DEBUG:teuthology.orchestra.run.smithi154:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-10T04:18:42.182 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-10T04:18:42.183 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-10T04:18:42.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-10T04:18:42.225 INFO:tasks.ceph.mon.a:Started 2023-05-10T04:18:42.225 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-10T04:18:42.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-10T04:18:42.229 INFO:tasks.ceph.mon.b:Started 2023-05-10T04:18:42.230 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-10T04:18:42.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-10T04:18:42.234 INFO:tasks.ceph.mon.c:Started 2023-05-10T04:18:42.234 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-10T04:18:42.234 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-10T04:18:42.235 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-10T04:18:42.238 INFO:tasks.ceph.mgr.y:Started 2023-05-10T04:18:42.238 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-10T04:18:42.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-10T04:18:42.242 INFO:tasks.ceph.mgr.x:Started 2023-05-10T04:18:42.242 INFO:tasks.ceph:Setting crush tunables to default 2023-05-10T04:18:42.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd crush tunables default 2023-05-10T04:18:42.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.427+0000 7fc5295ff700 1 Processor -- start 2023-05-10T04:18:42.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.427+0000 7fc5295ff700 1 -- start start 2023-05-10T04:18:42.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5295ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:42.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5295ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:42.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5295ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:42.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5295ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52406d380 con 0x7fc5240c9050 2023-05-10T04:18:42.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5295ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc524158aa0 con 0x7fc52406a3e0 2023-05-10T04:18:42.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5295ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52415d100 con 0x7fc52406a7b0 2023-05-10T04:18:42.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5237fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:42.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5237fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37192/0 (socket says 172.21.15.132:37192) 2023-05-10T04:18:42.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5237fe700 1 -- 172.21.15.132:0/4112319999 learned_addr learned my addr 172.21.15.132:0/4112319999 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:18:42.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc51bfff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:42.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5237fe700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 msgr2=0x7fc5240c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-10T04:18:42.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5237fe700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 msgr2=0x7fc5240c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T04:18:42.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-10T04:18:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-10T04:18:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc522ffd700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc51bfff700 1 -- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 msgr2=0x7fc52406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-10T04:18:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc51bfff700 1 -- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 msgr2=0x7fc52406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T04:18:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc51bfff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-10T04:18:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc51bfff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-10T04:18:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc522ffd700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 msgr2=0x7fc52415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T04:18:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc522ffd700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 msgr2=0x7fc52415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T04:18:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc522ffd700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-10T04:18:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.429+0000 7fc522ffd700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-10T04:18:42.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:42.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc5237fe700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 msgr2=0x7fc5240c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-10T04:18:42.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc5237fe700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 msgr2=0x7fc5240c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T04:18:42.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-10T04:18:42.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-10T04:18:42.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc522ffd700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:42.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc51bfff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:42.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc522ffd700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 msgr2=0x7fc52415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-10T04:18:42.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc522ffd700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 msgr2=0x7fc52415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T04:18:42.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc522ffd700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-10T04:18:42.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc51bfff700 1 -- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 msgr2=0x7fc52406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-10T04:18:42.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc51bfff700 1 -- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 msgr2=0x7fc52406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-10T04:18:42.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc51bfff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-10T04:18:42.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc522ffd700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-10T04:18:42.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:42.630+0000 7fc51bfff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-10T04:18:42.787 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:42.785+0000 7f239dba4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-10T04:18:42.867 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:42.865+0000 7f239dba4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T04:18:42.959 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:42.957+0000 7f239dba4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T04:18:43.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.132:3300/0 conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:43.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc522ffd700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:43.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc51bfff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:43.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc5237fe700 1 -- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 msgr2=0x7fc52406d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:18:43.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc5237fe700 1 -- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 msgr2=0x7fc52415cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:18:43.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc5237fe700 1 -- 172.21.15.132:0/4112319999 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5240cd210 con 0x7fc5240c9050 2023-05-10T04:18:43.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc51bfff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:18:43.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc522ffd700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:18:43.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.031+0000 7fc5237fe700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5240c9050 0x7fc5240c9490 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc52406b3d0 tx=0x7fc51c009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db06fb7be2c87d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:43.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.032+0000 7fc5227fc700 1 -- 172.21.15.132:0/4112319999 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c007d60 con 0x7fc5240c9050 2023-05-10T04:18:43.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.032+0000 7fc5227fc700 1 -- 172.21.15.132:0/4112319999 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc51c00f050 con 0x7fc5240c9050 2023-05-10T04:18:43.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.032+0000 7fc5227fc700 1 -- 172.21.15.132:0/4112319999 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc51c014650 con 0x7fc5240c9050 2023-05-10T04:18:43.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 -- 172.21.15.132:0/4112319999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5240c9050 msgr2=0x7fc5240c9490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:43.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5240c9050 0x7fc5240c9490 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc52406b3d0 tx=0x7fc51c009e60 comp rx=0 tx=0).stop 2023-05-10T04:18:43.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 -- 172.21.15.132:0/4112319999 shutdown_connections 2023-05-10T04:18:43.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5240c9050 0x7fc5240c9490 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 --2- 172.21.15.132:0/4112319999 >> v2:172.21.15.154:3300/0 conn(0x7fc52406a3e0 0x7fc52415cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 --2- 172.21.15.132:0/4112319999 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a7b0 0x7fc52406d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 -- 172.21.15.132:0/4112319999 >> 172.21.15.132:0/4112319999 conn(0x7fc5240cf720 msgr2=0x7fc5240cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:43.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 -- 172.21.15.132:0/4112319999 shutdown_connections 2023-05-10T04:18:43.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.033+0000 7fc5295ff700 1 -- 172.21.15.132:0/4112319999 wait complete. 2023-05-10T04:18:43.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.035+0000 7fc5295ff700 1 Processor -- start 2023-05-10T04:18:43.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.035+0000 7fc5295ff700 1 -- start start 2023-05-10T04:18:43.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc5295ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a3e0 0x7fc52415a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:43.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc5295ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc52406a7b0 0x7fc52414cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:43.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc5295ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240c9050 0x7fc52415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:43.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc5295ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc524159190 con 0x7fc52406a7b0 2023-05-10T04:18:43.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc5295ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc524159470 con 0x7fc5240c9050 2023-05-10T04:18:43.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc5295ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc524159750 con 0x7fc52406a3e0 2023-05-10T04:18:43.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc51bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc52406a7b0 0x7fc52414cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:43.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc5237fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240c9050 0x7fc52415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:43.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc51bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc52406a7b0 0x7fc52414cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47334/0 (socket says 172.21.15.132:47334) 2023-05-10T04:18:43.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc522ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a3e0 0x7fc52415a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:43.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.036+0000 7fc51bfff700 1 -- 172.21.15.132:0/3273272894 learned_addr learned my addr 172.21.15.132:0/3273272894 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:18:43.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51bfff700 1 -- 172.21.15.132:0/3273272894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a3e0 msgr2=0x7fc52415a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:43.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51bfff700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a3e0 0x7fc52415a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51bfff700 1 -- 172.21.15.132:0/3273272894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240c9050 msgr2=0x7fc52415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:43.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51bfff700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240c9050 0x7fc52415b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51bfff700 1 -- 172.21.15.132:0/3273272894 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc51c0097e0 con 0x7fc52406a7b0 2023-05-10T04:18:43.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc5237fe700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240c9050 0x7fc52415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:43.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc522ffd700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a3e0 0x7fc52415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:43.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51bfff700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc52406a7b0 0x7fc52414cde0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc50c012a70 tx=0x7fc50c012d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:43.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51b7fe700 1 -- 172.21.15.132:0/3273272894 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c005c20 con 0x7fc52406a7b0 2023-05-10T04:18:43.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51b7fe700 1 -- 172.21.15.132:0/3273272894 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50c005d80 con 0x7fc52406a7b0 2023-05-10T04:18:43.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51b7fe700 1 -- 172.21.15.132:0/3273272894 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc50c00ec80 con 0x7fc52406a7b0 2023-05-10T04:18:43.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc52406cd30 con 0x7fc52406a7b0 2023-05-10T04:18:43.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5240cd4f0 con 0x7fc52406a7b0 2023-05-10T04:18:43.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.037+0000 7fc51b7fe700 1 -- 172.21.15.132:0/3273272894 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc50c006330 con 0x7fc52406a7b0 2023-05-10T04:18:43.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.038+0000 7fc51b7fe700 1 -- 172.21.15.132:0/3273272894 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc50c00ede0 con 0x7fc52406a7b0 2023-05-10T04:18:43.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.038+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc52406d010 con 0x7fc52406a7b0 2023-05-10T04:18:43.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.041+0000 7fc51b7fe700 1 -- 172.21.15.132:0/3273272894 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fc50c020020 con 0x7fc52406a7b0 2023-05-10T04:18:43.056 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:43.054+0000 7f239dba4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T04:18:43.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.120+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc524074430 con 0x7fc52406a7b0 2023-05-10T04:18:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.124+0000 7fc51b7fe700 1 -- 172.21.15.132:0/3273272894 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc50c01b900 con 0x7fc52406a7b0 2023-05-10T04:18:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc52406a7b0 msgr2=0x7fc52414cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:43.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc52406a7b0 0x7fc52414cde0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fc50c012a70 tx=0x7fc50c012d80 comp rx=0 tx=0).stop 2023-05-10T04:18:43.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 shutdown_connections 2023-05-10T04:18:43.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc5240c9050 0x7fc52415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc52406a3e0 0x7fc52415a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 --2- 172.21.15.132:0/3273272894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc52406a7b0 0x7fc52414cde0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:43.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 >> 172.21.15.132:0/3273272894 conn(0x7fc5240cf720 msgr2=0x7fc52415c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:43.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 shutdown_connections 2023-05-10T04:18:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:43.125+0000 7fc5295ff700 1 -- 172.21.15.132:0/3273272894 wait complete. 2023-05-10T04:18:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:adjusted tunables profile to default 2023-05-10T04:18:43.131 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:43.129+0000 7fbf38a38200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-10T04:18:43.144 INFO:tasks.ceph:check_enable_crimson: False 2023-05-10T04:18:43.144 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-10T04:18:43.145 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:43.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-10T04:18:43.206 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:43.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-10T04:18:43.211 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:43.209+0000 7fbf38a38200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-10T04:18:43.240 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:43.238+0000 7f239dba4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T04:18:43.302 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:43.300+0000 7fbf38a38200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-10T04:18:43.303 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:43.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-10T04:18:43.396 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:43.393+0000 7fbf38a38200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-10T04:18:43.404 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:18:43.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-10T04:18:43.505 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:43.505 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-10T04:18:43.566 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:43.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-10T04:18:43.576 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:43.573+0000 7fbf38a38200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-10T04:18:43.637 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:43.638 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-10T04:18:43.645 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:43.643+0000 7f239dba4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T04:18:43.736 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:43.735+0000 7f239dba4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T04:18:43.741 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:18:43.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-10T04:18:43.842 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 77016e07-b3f6-49ff-abc1-0a6f44e63eb8 0 2023-05-10T04:18:43.892 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:43.891+0000 7f239dba4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T04:18:43.992 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:43.990+0000 7f239dba4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T04:18:43.993 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:43.990+0000 7fbf38a38200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-10T04:18:44.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.058+0000 7f293d7ff700 1 Processor -- start 2023-05-10T04:18:44.061 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.058+0000 7f293d7ff700 1 -- start start 2023-05-10T04:18:44.062 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.059+0000 7f293d7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29380cd640 0x7f29380cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.059+0000 7f293d7ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29380d00b0 0x7f29380d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.059+0000 7f293d7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f293815d480 con 0x7f293815a280 2023-05-10T04:18:44.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.059+0000 7f293d7ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293815d6e0 con 0x7f29380d00b0 2023-05-10T04:18:44.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.059+0000 7f293d7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f293815d9c0 con 0x7f29380cd640 2023-05-10T04:18:44.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29367fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29380cd640 0x7f29380cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.063 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29367fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f29380cd640 0x7f29380cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58794/0 (socket says 172.21.15.154:58794) 2023-05-10T04:18:44.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29367fc700 1 -- 172.21.15.154:0/4173476259 learned_addr learned my addr 172.21.15.154:0/4173476259 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:44.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f2936ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f293815a280 0x7f293815cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33094/0 (socket says 172.21.15.154:33094) 2023-05-10T04:18:44.064 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29377fe700 1 --2- 172.21.15.154:0/4173476259 >> v2:172.21.15.132:3300/0 conn(0x7f29380d00b0 0x7f29380d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29367fc700 1 -- 172.21.15.154:0/4173476259 >> v2:172.21.15.132:3300/0 conn(0x7f29380d00b0 msgr2=0x7f29380d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:18:44.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29367fc700 1 --2- 172.21.15.154:0/4173476259 >> v2:172.21.15.132:3300/0 conn(0x7f29380d00b0 0x7f29380d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.065 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29367fc700 1 -- 172.21.15.154:0/4173476259 >> v1:172.21.15.154:6789/0 conn(0x7f293815a280 legacy=0x7f293815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29367fc700 1 -- 172.21.15.154:0/4173476259 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293815dca0 con 0x7f29380cd640 2023-05-10T04:18:44.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29377fe700 1 --2- 172.21.15.154:0/4173476259 >> v2:172.21.15.132:3300/0 conn(0x7f29380d00b0 0x7f29380d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:18:44.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f29367fc700 1 --2- 172.21.15.154:0/4173476259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380cfb70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2938072b40 tx=0x7f2920009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca3500d512c29c79 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:44.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.060+0000 7f2935ffb700 1 -- 172.21.15.154:0/4173476259 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000b870 con 0x7f29380cd640 2023-05-10T04:18:44.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f2935ffb700 1 -- 172.21.15.154:0/4173476259 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292000b9d0 con 0x7f29380cd640 2023-05-10T04:18:44.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f2935ffb700 1 -- 172.21.15.154:0/4173476259 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292000bd60 con 0x7f29380cd640 2023-05-10T04:18:44.066 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f293d7ff700 1 -- 172.21.15.154:0/4173476259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 msgr2=0x7f29380cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f293d7ff700 1 --2- 172.21.15.154:0/4173476259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380cfb70 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2938072b40 tx=0x7f2920009bd0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f293d7ff700 1 -- 172.21.15.154:0/4173476259 shutdown_connections 2023-05-10T04:18:44.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f293d7ff700 1 --2- 172.21.15.154:0/4173476259 >> v2:172.21.15.132:3300/0 conn(0x7f29380d00b0 0x7f29380d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f293d7ff700 1 --2- 172.21.15.154:0/4173476259 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380cfb70 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f293d7ff700 1 -- 172.21.15.154:0/4173476259 >> 172.21.15.154:0/4173476259 conn(0x7f2938066260 msgr2=0x7f2938071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:44.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f293d7ff700 1 -- 172.21.15.154:0/4173476259 shutdown_connections 2023-05-10T04:18:44.067 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.061+0000 7f293d7ff700 1 -- 172.21.15.154:0/4173476259 wait complete. 2023-05-10T04:18:44.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.063+0000 7f293d7ff700 1 Processor -- start 2023-05-10T04:18:44.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.063+0000 7f293d7ff700 1 -- start start 2023-05-10T04:18:44.069 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f293d7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f293d7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29380d00b0 0x7f29381493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f293d7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f293815a280 0x7f29380b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f293d7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2938156fc0 con 0x7f293815a280 2023-05-10T04:18:44.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f293d7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29380cadb0 con 0x7f29380cd640 2023-05-10T04:18:44.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f293d7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2938157210 con 0x7f29380d00b0 2023-05-10T04:18:44.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f2936ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.070 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f29367fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29380d00b0 0x7f29381493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f2936ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58808/0 (socket says 172.21.15.154:58808) 2023-05-10T04:18:44.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f2936ffd700 1 -- 172.21.15.154:0/2336893801 learned_addr learned my addr 172.21.15.154:0/2336893801 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:44.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.064+0000 7f29377fe700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f293815a280 0x7f29380b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f2936ffd700 1 -- 172.21.15.154:0/2336893801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29380d00b0 msgr2=0x7f29381493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f2936ffd700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29380d00b0 0x7f29381493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f2936ffd700 1 -- 172.21.15.154:0/2336893801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f293815a280 msgr2=0x7f29380b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.071 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f2936ffd700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f293815a280 0x7f29380b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f2936ffd700 1 -- 172.21.15.154:0/2336893801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920009550 con 0x7f29380cd640 2023-05-10T04:18:44.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f29367fc700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29380d00b0 0x7f29381493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:44.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f2936ffd700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380ccf50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f292800c500 tx=0x7f292800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:44.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f292f7fe700 1 -- 172.21.15.154:0/2336893801 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2928005cb0 con 0x7f29380cd640 2023-05-10T04:18:44.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f292f7fe700 1 -- 172.21.15.154:0/2336893801 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2928005e10 con 0x7f29380cd640 2023-05-10T04:18:44.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29380cf650 con 0x7f29380cd640 2023-05-10T04:18:44.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f292f7fe700 1 -- 172.21.15.154:0/2336893801 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29280072d0 con 0x7f29380cd640 2023-05-10T04:18:44.072 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.065+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29380cf370 con 0x7f29380cd640 2023-05-10T04:18:44.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.066+0000 7f292f7fe700 1 -- 172.21.15.154:0/2336893801 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f292801c440 con 0x7f29380cd640 2023-05-10T04:18:44.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.066+0000 7f292f7fe700 1 -- 172.21.15.154:0/2336893801 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2928012740 con 0x7f29380cd640 2023-05-10T04:18:44.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.067+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f293815a650 con 0x7f29380cd640 2023-05-10T04:18:44.073 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.069+0000 7f292f7fe700 1 -- 172.21.15.154:0/2336893801 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f2928021060 con 0x7f29380cd640 2023-05-10T04:18:44.099 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:44.096+0000 7fbf38a38200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-10T04:18:44.177 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.174+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "77016e07-b3f6-49ff-abc1-0a6f44e63eb8", "id": 0} v 0) v1 -- 0x7f2938074430 con 0x7f29380cd640 2023-05-10T04:18:44.183 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.180+0000 7f292f7fe700 1 -- 172.21.15.154:0/2336893801 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77016e07-b3f6-49ff-abc1-0a6f44e63eb8", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2928017070 con 0x7f29380cd640 2023-05-10T04:18:44.184 INFO:teuthology.orchestra.run.smithi154.stdout:0 2023-05-10T04:18:44.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.181+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 msgr2=0x7f29380ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.181+0000 7f293d7ff700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380ccf50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f292800c500 tx=0x7f292800c810 comp rx=0 tx=0).stop 2023-05-10T04:18:44.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.182+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 shutdown_connections 2023-05-10T04:18:44.185 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.182+0000 7f293d7ff700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f293815a280 0x7f29380b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.182+0000 7f293d7ff700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f29380cd640 0x7f29380ccf50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.182+0000 7f293d7ff700 1 --2- 172.21.15.154:0/2336893801 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f29380d00b0 0x7f29381493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.182+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 >> 172.21.15.154:0/2336893801 conn(0x7f2938066260 msgr2=0x7f29380d2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.182+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 shutdown_connections 2023-05-10T04:18:44.186 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.182+0000 7f293d7ff700 1 -- 172.21.15.154:0/2336893801 wait complete. 2023-05-10T04:18:44.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1eb053cc-9afa-423c-8726-b8eb036965e9 1 2023-05-10T04:18:44.257 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:44.254+0000 7fbf38a38200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-10T04:18:44.359 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:44.356+0000 7fbf38a38200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-10T04:18:44.382 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.379+0000 7fd51d5ff700 1 Processor -- start 2023-05-10T04:18:44.383 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.379+0000 7fd51d5ff700 1 -- start start 2023-05-10T04:18:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.380+0000 7fd51d5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5180b87a0 0x7fd5180cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.380+0000 7fd51d5ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180cdc60 con 0x7fd518160d40 2023-05-10T04:18:44.387 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.380+0000 7fd51d5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5180cd6a0 con 0x7fd5181601e0 2023-05-10T04:18:44.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.380+0000 7fd51d5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5180d02d0 con 0x7fd5180b87a0 2023-05-10T04:18:44.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.381+0000 7fd516ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5180b87a0 0x7fd5180cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.388 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.381+0000 7fd516ffd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd5180b87a0 0x7fd5180cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58824/0 (socket says 172.21.15.154:58824) 2023-05-10T04:18:44.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.381+0000 7fd516ffd700 1 -- 172.21.15.154:0/1980215946 learned_addr learned my addr 172.21.15.154:0/1980215946 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:44.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.381+0000 7fd516ffd700 1 -- 172.21.15.154:0/1980215946 >> v1:172.21.15.154:6789/0 conn(0x7fd5181601e0 legacy=0x7fd518160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.389 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.381+0000 7fd516ffd700 1 -- 172.21.15.154:0/1980215946 >> v1:172.21.15.132:6789/0 conn(0x7fd518160d40 legacy=0x7fd5180d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.381+0000 7fd516ffd700 1 -- 172.21.15.154:0/1980215946 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5180cd980 con 0x7fd5180b87a0 2023-05-10T04:18:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.381+0000 7fd516ffd700 1 --2- 172.21.15.154:0/1980215946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5180b87a0 0x7fd5180cfbf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5080098f0 tx=0x7fd508009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef5d034ac9961c58 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.382+0000 7fd515ffb700 1 -- 172.21.15.154:0/1980215946 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800b8a0 con 0x7fd5180b87a0 2023-05-10T04:18:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.382+0000 7fd515ffb700 1 -- 172.21.15.154:0/1980215946 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50800ba00 con 0x7fd5180b87a0 2023-05-10T04:18:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.382+0000 7fd515ffb700 1 -- 172.21.15.154:0/1980215946 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50800bd90 con 0x7fd5180b87a0 2023-05-10T04:18:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.382+0000 7fd51d5ff700 1 -- 172.21.15.154:0/1980215946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5180b87a0 msgr2=0x7fd5180cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.390 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.382+0000 7fd51d5ff700 1 --2- 172.21.15.154:0/1980215946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5180b87a0 0x7fd5180cfbf0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd5080098f0 tx=0x7fd508009c00 comp rx=0 tx=0).stop 2023-05-10T04:18:44.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.383+0000 7fd51d5ff700 1 -- 172.21.15.154:0/1980215946 shutdown_connections 2023-05-10T04:18:44.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.383+0000 7fd51d5ff700 1 --2- 172.21.15.154:0/1980215946 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5180b87a0 0x7fd5180cfbf0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.383+0000 7fd51d5ff700 1 -- 172.21.15.154:0/1980215946 >> 172.21.15.154:0/1980215946 conn(0x7fd518071b10 msgr2=0x7fd518071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:44.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.383+0000 7fd51d5ff700 1 -- 172.21.15.154:0/1980215946 shutdown_connections 2023-05-10T04:18:44.391 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.383+0000 7fd51d5ff700 1 -- 172.21.15.154:0/1980215946 wait complete. 2023-05-10T04:18:44.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.385+0000 7fd51d5ff700 1 Processor -- start 2023-05-10T04:18:44.393 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.386+0000 7fd51d5ff700 1 -- start start 2023-05-10T04:18:44.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd51d5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5180b87a0 0x7fd51815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd51d5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5181601e0 0x7fd5181e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd51d5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd518160d40 0x7fd51815a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd51d5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181e7120 con 0x7fd5180b87a0 2023-05-10T04:18:44.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd51d5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181e7400 con 0x7fd5181601e0 2023-05-10T04:18:44.394 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd51d5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5181e76e0 con 0x7fd518160d40 2023-05-10T04:18:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd5177fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd518160d40 0x7fd51815a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd516ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5180b87a0 0x7fd51815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd5167fc700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5181601e0 0x7fd5181e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd516ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5180b87a0 0x7fd51815cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.154:38296/0 (socket says 172.21.15.154:38296) 2023-05-10T04:18:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.387+0000 7fd516ffd700 1 -- 172.21.15.154:0/820042140 learned_addr learned my addr 172.21.15.154:0/820042140 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd5167fc700 1 -- 172.21.15.154:0/820042140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd518160d40 msgr2=0x7fd51815a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd5167fc700 1 --2- 172.21.15.154:0/820042140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd518160d40 0x7fd51815a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.395 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd5167fc700 1 -- 172.21.15.154:0/820042140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5180b87a0 msgr2=0x7fd51815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd5167fc700 1 --2- 172.21.15.154:0/820042140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5180b87a0 0x7fd51815cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd5167fc700 1 -- 172.21.15.154:0/820042140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508009550 con 0x7fd5181601e0 2023-05-10T04:18:44.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd5177fe700 1 --2- 172.21.15.154:0/820042140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd518160d40 0x7fd51815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:44.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd5167fc700 1 --2- 172.21.15.154:0/820042140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5181601e0 0x7fd5181e68f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd50c000f60 tx=0x7fd50c00c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:44.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd4ff7fe700 1 -- 172.21.15.154:0/820042140 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0052d0 con 0x7fd5181601e0 2023-05-10T04:18:44.396 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd4ff7fe700 1 -- 172.21.15.154:0/820042140 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c005430 con 0x7fd5181601e0 2023-05-10T04:18:44.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd4ff7fe700 1 -- 172.21.15.154:0/820042140 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c0038c0 con 0x7fd5181601e0 2023-05-10T04:18:44.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.388+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5180d19a0 con 0x7fd5181601e0 2023-05-10T04:18:44.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.389+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5180d1810 con 0x7fd5181601e0 2023-05-10T04:18:44.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.389+0000 7fd4ff7fe700 1 -- 172.21.15.154:0/820042140 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd50c003d20 con 0x7fd5181601e0 2023-05-10T04:18:44.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.389+0000 7fd4ff7fe700 1 -- 172.21.15.154:0/820042140 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fd50c011d60 con 0x7fd5181601e0 2023-05-10T04:18:44.397 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.390+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5180d1b30 con 0x7fd5181601e0 2023-05-10T04:18:44.398 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.392+0000 7fd4ff7fe700 1 -- 172.21.15.154:0/820042140 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fd50c017070 con 0x7fd5181601e0 2023-05-10T04:18:44.482 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.479+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1eb053cc-9afa-423c-8726-b8eb036965e9", "id": 1} v 0) v1 -- 0x7fd5180b52f0 con 0x7fd5181601e0 2023-05-10T04:18:44.489 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.486+0000 7fd4ff7fe700 1 -- 172.21.15.154:0/820042140 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1eb053cc-9afa-423c-8726-b8eb036965e9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd50c00ce30 con 0x7fd5181601e0 2023-05-10T04:18:44.490 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-05-10T04:18:44.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.487+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5181601e0 msgr2=0x7fd5181e68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.490 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.487+0000 7fd51d5ff700 1 --2- 172.21.15.154:0/820042140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5181601e0 0x7fd5181e68f0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd50c000f60 tx=0x7fd50c00c730 comp rx=0 tx=0).stop 2023-05-10T04:18:44.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.487+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 shutdown_connections 2023-05-10T04:18:44.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.487+0000 7fd51d5ff700 1 --2- 172.21.15.154:0/820042140 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd518160d40 0x7fd51815a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.487+0000 7fd51d5ff700 1 --2- 172.21.15.154:0/820042140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5180b87a0 0x7fd51815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.487+0000 7fd51d5ff700 1 --2- 172.21.15.154:0/820042140 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd5181601e0 0x7fd5181e68f0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.488+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 >> 172.21.15.154:0/820042140 conn(0x7fd518071b10 msgr2=0x7fd5180cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:44.491 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.488+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 shutdown_connections 2023-05-10T04:18:44.492 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.488+0000 7fd51d5ff700 1 -- 172.21.15.154:0/820042140 wait complete. 2023-05-10T04:18:44.507 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 14fc4c3f-e543-4a69-b015-2b22a0cdc634 2 2023-05-10T04:18:44.508 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:44.506+0000 7f239dba4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T04:18:44.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.693+0000 7f16db7ff700 1 Processor -- start 2023-05-10T04:18:44.696 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.693+0000 7f16db7ff700 1 -- start start 2023-05-10T04:18:44.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16db7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16d40b87a0 0x7f16d40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.697 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16db7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d4160d40 0x7f16d40d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16db7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16d40cdc60 con 0x7f16d41601e0 2023-05-10T04:18:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16db7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16d40d02d0 con 0x7f16d40b87a0 2023-05-10T04:18:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16db7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40d0cb0 con 0x7f16d4160d40 2023-05-10T04:18:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16d959b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16d40b87a0 0x7f16d40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16d959b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16d40b87a0 0x7f16d40cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58846/0 (socket says 172.21.15.154:58846) 2023-05-10T04:18:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16d959b700 1 -- 172.21.15.154:0/1705245844 learned_addr learned my addr 172.21.15.154:0/1705245844 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:44.698 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.694+0000 7f16d9d9c700 1 --2- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d4160d40 0x7f16d40d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16d959b700 1 -- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d4160d40 msgr2=0x7f16d40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:18:44.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16d959b700 1 --2- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d4160d40 0x7f16d40d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16d959b700 1 -- 172.21.15.154:0/1705245844 >> v1:172.21.15.154:6789/0 conn(0x7f16d41601e0 legacy=0x7f16d4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16d959b700 1 -- 172.21.15.154:0/1705245844 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d40cd6a0 con 0x7f16d40b87a0 2023-05-10T04:18:44.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16cbfff700 1 -- 172.21.15.154:0/1705245844 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436921898 0 0) 0x7f16d40cdc60 con 0x7f16d41601e0 2023-05-10T04:18:44.700 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16d9d9c700 1 --2- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d4160d40 0x7f16d40d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:44.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16d959b700 1 --2- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d40b87a0 0x7f16d40cfbf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16d00098f0 tx=0x7f16d0009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6fd413a2d95bd112 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:44.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16cbfff700 1 -- 172.21.15.154:0/1705245844 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0011830 con 0x7f16d40b87a0 2023-05-10T04:18:44.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16cbfff700 1 -- 172.21.15.154:0/1705245844 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d0011990 con 0x7f16d40b87a0 2023-05-10T04:18:44.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.695+0000 7f16cbfff700 1 -- 172.21.15.154:0/1705245844 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d0011d20 con 0x7f16d40b87a0 2023-05-10T04:18:44.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.696+0000 7f16db7ff700 1 -- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d40b87a0 msgr2=0x7f16d40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.696+0000 7f16db7ff700 1 --2- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d40b87a0 0x7f16d40cfbf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f16d00098f0 tx=0x7f16d0009c00 comp rx=0 tx=0).stop 2023-05-10T04:18:44.701 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.696+0000 7f16db7ff700 1 -- 172.21.15.154:0/1705245844 shutdown_connections 2023-05-10T04:18:44.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.696+0000 7f16db7ff700 1 --2- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d4160d40 0x7f16d40d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.696+0000 7f16db7ff700 1 --2- 172.21.15.154:0/1705245844 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d40b87a0 0x7f16d40cfbf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.696+0000 7f16db7ff700 1 -- 172.21.15.154:0/1705245844 >> 172.21.15.154:0/1705245844 conn(0x7f16d4071b10 msgr2=0x7f16d4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:44.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.696+0000 7f16db7ff700 1 -- 172.21.15.154:0/1705245844 shutdown_connections 2023-05-10T04:18:44.702 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.696+0000 7f16db7ff700 1 -- 172.21.15.154:0/1705245844 wait complete. 2023-05-10T04:18:44.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.698+0000 7f16db7ff700 1 Processor -- start 2023-05-10T04:18:44.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.698+0000 7f16db7ff700 1 -- start start 2023-05-10T04:18:44.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16db7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16d40b87a0 0x7f16d40c8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.704 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16db7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d41601e0 0x7f16d41e7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16db7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d4160d40 0x7f16d4159250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:44.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16db7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d415e480 con 0x7f16d40b87a0 2023-05-10T04:18:44.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16db7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d40c8cb0 con 0x7f16d4160d40 2023-05-10T04:18:44.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16db7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16d415d800 con 0x7f16d41601e0 2023-05-10T04:18:44.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d8d9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d41601e0 0x7f16d41e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d9d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d4160d40 0x7f16d4159250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.705 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d9d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d4160d40 0x7f16d4159250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58858/0 (socket says 172.21.15.154:58858) 2023-05-10T04:18:44.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d8d9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d41601e0 0x7f16d41e7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52710/0 (socket says 172.21.15.154:52710) 2023-05-10T04:18:44.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d9d9c700 1 -- 172.21.15.154:0/3959378823 learned_addr learned my addr 172.21.15.154:0/3959378823 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:44.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d959b700 1 --2- 172.21.15.154:0/3959378823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16d40b87a0 0x7f16d40c8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:44.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d9d9c700 1 -- 172.21.15.154:0/3959378823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d41601e0 msgr2=0x7f16d41e7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d9d9c700 1 --2- 172.21.15.154:0/3959378823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d41601e0 0x7f16d41e7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d9d9c700 1 -- 172.21.15.154:0/3959378823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16d40b87a0 msgr2=0x7f16d40c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d9d9c700 1 --2- 172.21.15.154:0/3959378823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16d40b87a0 0x7f16d40c8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.706 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.699+0000 7f16d9d9c700 1 -- 172.21.15.154:0/3959378823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16cc009a70 con 0x7f16d4160d40 2023-05-10T04:18:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.700+0000 7f16d9d9c700 1 --2- 172.21.15.154:0/3959378823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d4160d40 0x7f16d4159250 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00efc0 tx=0x7f16cc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.700+0000 7f16c9ffb700 1 -- 172.21.15.154:0/3959378823 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc00ca90 con 0x7f16d4160d40 2023-05-10T04:18:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.700+0000 7f16c9ffb700 1 -- 172.21.15.154:0/3959378823 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16cc00f040 con 0x7f16d4160d40 2023-05-10T04:18:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.700+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d0009550 con 0x7f16d4160d40 2023-05-10T04:18:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.700+0000 7f16c9ffb700 1 -- 172.21.15.154:0/3959378823 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16cc00ce30 con 0x7f16d4160d40 2023-05-10T04:18:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.700+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d40d1640 con 0x7f16d4160d40 2023-05-10T04:18:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.700+0000 7f16c9ffb700 1 -- 172.21.15.154:0/3959378823 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f16cc003d20 con 0x7f16d4160d40 2023-05-10T04:18:44.707 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.700+0000 7f16c9ffb700 1 -- 172.21.15.154:0/3959378823 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f16cc004440 con 0x7f16d4160d40 2023-05-10T04:18:44.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.701+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16d40cd980 con 0x7f16d4160d40 2023-05-10T04:18:44.708 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.703+0000 7f16c9ffb700 1 -- 172.21.15.154:0/3959378823 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f16cc018030 con 0x7f16d4160d40 2023-05-10T04:18:44.793 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.790+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "14fc4c3f-e543-4a69-b015-2b22a0cdc634", "id": 2} v 0) v1 -- 0x7f16d40d17d0 con 0x7f16d4160d40 2023-05-10T04:18:44.801 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.798+0000 7f16c9ffb700 1 -- 172.21.15.154:0/3959378823 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "14fc4c3f-e543-4a69-b015-2b22a0cdc634", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f16cc004020 con 0x7f16d4160d40 2023-05-10T04:18:44.801 INFO:teuthology.orchestra.run.smithi154.stdout:2 2023-05-10T04:18:44.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.799+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d4160d40 msgr2=0x7f16d4159250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:44.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.799+0000 7f16db7ff700 1 --2- 172.21.15.154:0/3959378823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d4160d40 0x7f16d4159250 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f16cc00efc0 tx=0x7f16cc00c3a0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.802 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.799+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 shutdown_connections 2023-05-10T04:18:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.799+0000 7f16db7ff700 1 --2- 172.21.15.154:0/3959378823 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16d4160d40 0x7f16d4159250 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.799+0000 7f16db7ff700 1 --2- 172.21.15.154:0/3959378823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16d40b87a0 0x7f16d40c8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.799+0000 7f16db7ff700 1 --2- 172.21.15.154:0/3959378823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16d41601e0 0x7f16d41e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.799+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 >> 172.21.15.154:0/3959378823 conn(0x7f16d4071b10 msgr2=0x7f16d4160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.799+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 shutdown_connections 2023-05-10T04:18:44.803 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.800+0000 7f16db7ff700 1 -- 172.21.15.154:0/3959378823 wait complete. 2023-05-10T04:18:44.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new e99c67c3-b73f-4074-abe5-262beda6f65a 3 2023-05-10T04:18:44.906 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:44.904+0000 7fbf38a38200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-10T04:18:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.999+0000 7fba795ff700 1 Processor -- start 2023-05-10T04:18:45.002 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:44.999+0000 7fba795ff700 1 -- start start 2023-05-10T04:18:45.004 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.001+0000 7fba795ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fba7406cdd0 0x7fba7406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba795ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba740ca890 con 0x7fba74158da0 2023-05-10T04:18:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba795ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba740cd860 con 0x7fba741589d0 2023-05-10T04:18:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba795ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba740ca5b0 con 0x7fba7406cdd0 2023-05-10T04:18:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba72ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fba741589d0 0x7fba740cd150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33124/0 (socket says 172.21.15.154:33124) 2023-05-10T04:18:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba72ffd700 1 -- 172.21.15.154:0/207406465 learned_addr learned my addr 172.21.15.154:0/207406465 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-05-10T04:18:45.005 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba737fe700 1 --2- 172.21.15.154:0/207406465 >> v2:172.21.15.132:3300/0 conn(0x7fba7406cdd0 0x7fba7406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba727fc700 1 -- 172.21.15.154:0/207406465 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909401439 0 0) 0x7fba740cd860 con 0x7fba741589d0 2023-05-10T04:18:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba727fc700 1 -- 172.21.15.154:0/207406465 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba600035b0 con 0x7fba741589d0 2023-05-10T04:18:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba727fc700 1 -- 172.21.15.154:0/207406465 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160537150 0 0) 0x7fba740ca890 con 0x7fba74158da0 2023-05-10T04:18:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba727fc700 1 -- 172.21.15.154:0/207406465 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba740cd860 con 0x7fba74158da0 2023-05-10T04:18:45.007 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba737fe700 1 -- 172.21.15.154:0/207406465 >> v1:172.21.15.154:6789/0 conn(0x7fba741589d0 legacy=0x7fba740cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba737fe700 1 -- 172.21.15.154:0/207406465 >> v1:172.21.15.132:6789/0 conn(0x7fba74158da0 legacy=0x7fba7406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.002+0000 7fba737fe700 1 -- 172.21.15.154:0/207406465 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba740cc670 con 0x7fba7406cdd0 2023-05-10T04:18:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.003+0000 7fba737fe700 1 --2- 172.21.15.154:0/207406465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7406cdd0 0x7fba7406a3e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009d90 tx=0x7fba6c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727c70d945b9a90d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.003+0000 7fba727fc700 1 -- 172.21.15.154:0/207406465 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c00e070 con 0x7fba7406cdd0 2023-05-10T04:18:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.003+0000 7fba727fc700 1 -- 172.21.15.154:0/207406465 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c00bb20 con 0x7fba7406cdd0 2023-05-10T04:18:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.003+0000 7fba727fc700 1 -- 172.21.15.154:0/207406465 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba6c012430 con 0x7fba7406cdd0 2023-05-10T04:18:45.008 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.004+0000 7fba795ff700 1 -- 172.21.15.154:0/207406465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7406cdd0 msgr2=0x7fba7406a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.004+0000 7fba795ff700 1 --2- 172.21.15.154:0/207406465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7406cdd0 0x7fba7406a3e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba6c009d90 tx=0x7fba6c00b330 comp rx=0 tx=0).stop 2023-05-10T04:18:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.004+0000 7fba795ff700 1 -- 172.21.15.154:0/207406465 shutdown_connections 2023-05-10T04:18:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.004+0000 7fba795ff700 1 --2- 172.21.15.154:0/207406465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba7406cdd0 0x7fba7406a3e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.004+0000 7fba795ff700 1 -- 172.21.15.154:0/207406465 >> 172.21.15.154:0/207406465 conn(0x7fba740cf720 msgr2=0x7fba740cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.004+0000 7fba795ff700 1 -- 172.21.15.154:0/207406465 shutdown_connections 2023-05-10T04:18:45.009 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.004+0000 7fba795ff700 1 -- 172.21.15.154:0/207406465 wait complete. 2023-05-10T04:18:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.006+0000 7fba795ff700 1 Processor -- start 2023-05-10T04:18:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.006+0000 7fba795ff700 1 -- start start 2023-05-10T04:18:45.010 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba795ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7406cdd0 0x7fba7415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba795ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba741589d0 0x7fba741f2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba795ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74158da0 0x7fba741f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba795ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba740c3580 con 0x7fba741589d0 2023-05-10T04:18:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba795ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba7415b4e0 con 0x7fba74158da0 2023-05-10T04:18:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba795ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba740c37d0 con 0x7fba7406cdd0 2023-05-10T04:18:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7406cdd0 0x7fba7415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.011 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba737fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74158da0 0x7fba741f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba6bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba741589d0 0x7fba741f2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba72ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7406cdd0 0x7fba7415ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52716/0 (socket says 172.21.15.154:52716) 2023-05-10T04:18:45.012 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.007+0000 7fba72ffd700 1 -- 172.21.15.154:0/72222606 learned_addr learned my addr 172.21.15.154:0/72222606 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:45.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba72ffd700 1 -- 172.21.15.154:0/72222606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74158da0 msgr2=0x7fba741f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba72ffd700 1 --2- 172.21.15.154:0/72222606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74158da0 0x7fba741f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba72ffd700 1 -- 172.21.15.154:0/72222606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba741589d0 msgr2=0x7fba741f2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.013 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba72ffd700 1 --2- 172.21.15.154:0/72222606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba741589d0 0x7fba741f2ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba72ffd700 1 -- 172.21.15.154:0/72222606 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c009a70 con 0x7fba7406cdd0 2023-05-10T04:18:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba6bfff700 1 --2- 172.21.15.154:0/72222606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba741589d0 0x7fba741f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba72ffd700 1 --2- 172.21.15.154:0/72222606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7406cdd0 0x7fba7415ade0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c700 tx=0x7fba6400ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba6b7fe700 1 -- 172.21.15.154:0/72222606 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64005d70 con 0x7fba7406cdd0 2023-05-10T04:18:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba6b7fe700 1 -- 172.21.15.154:0/72222606 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba640070d0 con 0x7fba7406cdd0 2023-05-10T04:18:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba6b7fe700 1 -- 172.21.15.154:0/72222606 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba64007440 con 0x7fba7406cdd0 2023-05-10T04:18:45.014 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba740ccc30 con 0x7fba7406cdd0 2023-05-10T04:18:45.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.008+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba740cc950 con 0x7fba7406cdd0 2023-05-10T04:18:45.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.009+0000 7fba6b7fe700 1 -- 172.21.15.154:0/72222606 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fba6401c440 con 0x7fba7406cdd0 2023-05-10T04:18:45.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.009+0000 7fba6b7fe700 1 -- 172.21.15.154:0/72222606 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fba6401cb80 con 0x7fba7406cdd0 2023-05-10T04:18:45.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.010+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba7406a920 con 0x7fba7406cdd0 2023-05-10T04:18:45.015 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.012+0000 7fba6b7fe700 1 -- 172.21.15.154:0/72222606 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7fba64021060 con 0x7fba7406cdd0 2023-05-10T04:18:45.102 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.100+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e99c67c3-b73f-4074-abe5-262beda6f65a", "id": 3} v 0) v1 -- 0x7fba740b4a10 con 0x7fba7406cdd0 2023-05-10T04:18:45.110 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.107+0000 7fba6b7fe700 1 -- 172.21.15.154:0/72222606 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e99c67c3-b73f-4074-abe5-262beda6f65a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fba64017070 con 0x7fba7406cdd0 2023-05-10T04:18:45.111 INFO:teuthology.orchestra.run.smithi154.stdout:3 2023-05-10T04:18:45.111 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.108+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7406cdd0 msgr2=0x7fba7415ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.108+0000 7fba795ff700 1 --2- 172.21.15.154:0/72222606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7406cdd0 0x7fba7415ade0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fba6400c700 tx=0x7fba6400ca10 comp rx=0 tx=0).stop 2023-05-10T04:18:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.109+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 shutdown_connections 2023-05-10T04:18:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.109+0000 7fba795ff700 1 --2- 172.21.15.154:0/72222606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fba74158da0 0x7fba741f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.109+0000 7fba795ff700 1 --2- 172.21.15.154:0/72222606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fba7406cdd0 0x7fba7415ade0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.109+0000 7fba795ff700 1 --2- 172.21.15.154:0/72222606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba741589d0 0x7fba741f2ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.112 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.109+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 >> 172.21.15.154:0/72222606 conn(0x7fba740cf720 msgr2=0x7fba740c9840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.109+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 shutdown_connections 2023-05-10T04:18:45.113 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.109+0000 7fba795ff700 1 -- 172.21.15.154:0/72222606 wait complete. 2023-05-10T04:18:45.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 1c72e791-f491-43f9-8faa-d19c443b5a33 4 2023-05-10T04:18:45.202 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:45.200+0000 7f239dba4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T04:18:45.314 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.311+0000 7f47b6dff700 1 Processor -- start 2023-05-10T04:18:45.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.311+0000 7f47b6dff700 1 -- start start 2023-05-10T04:18:45.315 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.312+0000 7f47b6dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b015c590 0x7f47b0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.312+0000 7f47b6dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47b00cff50 0x7f47b00d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.312+0000 7f47b6dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b00cd520 con 0x7f47b00cf010 2023-05-10T04:18:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.312+0000 7f47b6dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b00d2640 con 0x7f47b00cff50 2023-05-10T04:18:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.312+0000 7f47b6dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01610d0 con 0x7f47b015c590 2023-05-10T04:18:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b4b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b015c590 0x7f47b0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b539c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f47b00cff50 0x7f47b00d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.316 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b4b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b015c590 0x7f47b0160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52730/0 (socket says 172.21.15.154:52730) 2023-05-10T04:18:45.317 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b4b9b700 1 -- 172.21.15.154:0/3370029958 learned_addr learned my addr 172.21.15.154:0/3370029958 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b539c700 1 -- 172.21.15.154:0/3370029958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b015c590 msgr2=0x7f47b0160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:18:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b539c700 1 --2- 172.21.15.154:0/3370029958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b015c590 0x7f47b0160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b539c700 1 -- 172.21.15.154:0/3370029958 >> v1:172.21.15.154:6789/0 conn(0x7f47b00cf010 legacy=0x7f47b00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b539c700 1 -- 172.21.15.154:0/3370029958 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b00b23c0 con 0x7f47b00cff50 2023-05-10T04:18:45.318 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47af7fe700 1 -- 172.21.15.154:0/3370029958 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597497744 0 0) 0x7f47b00cd520 con 0x7f47b00cf010 2023-05-10T04:18:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b4b9b700 1 --2- 172.21.15.154:0/3370029958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b015c590 0x7f47b0160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.313+0000 7f47b539c700 1 --2- 172.21.15.154:0/3370029958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b00cff50 0x7f47b00d2ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009d90 tx=0x7f47a800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca89ae95802657f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47af7fe700 1 -- 172.21.15.154:0/3370029958 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a800e070 con 0x7f47b00cff50 2023-05-10T04:18:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47af7fe700 1 -- 172.21.15.154:0/3370029958 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a800bb20 con 0x7f47b00cff50 2023-05-10T04:18:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47af7fe700 1 -- 172.21.15.154:0/3370029958 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8012430 con 0x7f47b00cff50 2023-05-10T04:18:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47b6dff700 1 -- 172.21.15.154:0/3370029958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b00cff50 msgr2=0x7f47b00d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47b6dff700 1 --2- 172.21.15.154:0/3370029958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b00cff50 0x7f47b00d2ad0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009d90 tx=0x7f47a800b330 comp rx=0 tx=0).stop 2023-05-10T04:18:45.319 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47b6dff700 1 -- 172.21.15.154:0/3370029958 shutdown_connections 2023-05-10T04:18:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47b6dff700 1 --2- 172.21.15.154:0/3370029958 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b00cff50 0x7f47b00d2ad0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47b6dff700 1 --2- 172.21.15.154:0/3370029958 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b015c590 0x7f47b0160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47b6dff700 1 -- 172.21.15.154:0/3370029958 >> 172.21.15.154:0/3370029958 conn(0x7f47b0071b10 msgr2=0x7f47b0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.314+0000 7f47b6dff700 1 -- 172.21.15.154:0/3370029958 shutdown_connections 2023-05-10T04:18:45.320 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.315+0000 7f47b6dff700 1 -- 172.21.15.154:0/3370029958 wait complete. 2023-05-10T04:18:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.316+0000 7f47b6dff700 1 Processor -- start 2023-05-10T04:18:45.322 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.316+0000 7f47b6dff700 1 -- start start 2023-05-10T04:18:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b6dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b00cf010 0x7f47b00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b6dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47b00cff50 0x7f47b015a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b6dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b015c590 0x7f47b015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b6dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b015ba20 con 0x7f47b00cff50 2023-05-10T04:18:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b6dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00c7100 con 0x7f47b015c590 2023-05-10T04:18:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b6dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b00c73e0 con 0x7f47b00cf010 2023-05-10T04:18:45.323 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b4b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b00cf010 0x7f47b00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b539c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b015c590 0x7f47b015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b4b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b00cf010 0x7f47b00c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52732/0 (socket says 172.21.15.154:52732) 2023-05-10T04:18:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.317+0000 7f47b4b9b700 1 -- 172.21.15.154:0/2127164171 learned_addr learned my addr 172.21.15.154:0/2127164171 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47affff700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47b00cff50 0x7f47b015a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47b539c700 1 -- 172.21.15.154:0/2127164171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b00cf010 msgr2=0x7f47b00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47b539c700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b00cf010 0x7f47b00c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.324 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47b539c700 1 -- 172.21.15.154:0/2127164171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47b00cff50 msgr2=0x7f47b015a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47b539c700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47b00cff50 0x7f47b015a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47b539c700 1 -- 172.21.15.154:0/2127164171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4009550 con 0x7f47b015c590 2023-05-10T04:18:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47b4b9b700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b00cf010 0x7f47b00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47b539c700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b015c590 0x7f47b015eb00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f47a8016000 tx=0x7f47a8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.318+0000 7f47ad7fa700 1 -- 172.21.15.154:0/2127164171 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8012430 con 0x7f47b015c590 2023-05-10T04:18:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.319+0000 7f47ad7fa700 1 -- 172.21.15.154:0/2127164171 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a8020070 con 0x7f47b015c590 2023-05-10T04:18:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.319+0000 7f47ad7fa700 1 -- 172.21.15.154:0/2127164171 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8004280 con 0x7f47b015c590 2023-05-10T04:18:45.325 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.319+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a8009a70 con 0x7f47b015c590 2023-05-10T04:18:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.319+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b00cd770 con 0x7f47b015c590 2023-05-10T04:18:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.319+0000 7f47ad7fa700 1 -- 172.21.15.154:0/2127164171 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f47a80046e0 con 0x7f47b015c590 2023-05-10T04:18:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.319+0000 7f47ad7fa700 1 -- 172.21.15.154:0/2127164171 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f47a8022070 con 0x7f47b015c590 2023-05-10T04:18:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.320+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00cf560 con 0x7f47b015c590 2023-05-10T04:18:45.326 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.322+0000 7f47ad7fa700 1 -- 172.21.15.154:0/2127164171 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f47a802c060 con 0x7f47b015c590 2023-05-10T04:18:45.384 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:45.382+0000 7f239dba4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T04:18:45.430 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.427+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1c72e791-f491-43f9-8faa-d19c443b5a33", "id": 4} v 0) v1 -- 0x7f47b015c960 con 0x7f47b015c590 2023-05-10T04:18:45.438 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.435+0000 7f47ad7fa700 1 -- 172.21.15.154:0/2127164171 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c72e791-f491-43f9-8faa-d19c443b5a33", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f47a8027e40 con 0x7f47b015c590 2023-05-10T04:18:45.439 INFO:teuthology.orchestra.run.smithi154.stdout:4 2023-05-10T04:18:45.439 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b015c590 msgr2=0x7f47b015eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b015c590 0x7f47b015eb00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f47a8016000 tx=0x7f47a8004ad0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 shutdown_connections 2023-05-10T04:18:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f47b015c590 0x7f47b015eb00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f47b00cf010 0x7f47b00c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 --2- 172.21.15.154:0/2127164171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47b00cff50 0x7f47b015a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.440 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 >> 172.21.15.154:0/2127164171 conn(0x7f47b0071b10 msgr2=0x7f47b00d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:45.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 shutdown_connections 2023-05-10T04:18:45.441 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.437+0000 7f47b6dff700 1 -- 172.21.15.154:0/2127164171 wait complete. 2023-05-10T04:18:45.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 02dca35a-889e-4ec2-865c-174c1bdec803 5 2023-05-10T04:18:45.626 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:45.624+0000 7fbf38a38200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-05-10T04:18:45.647 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.644+0000 7f9732dff700 1 Processor -- start 2023-05-10T04:18:45.648 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.645+0000 7f9732dff700 1 -- start start 2023-05-10T04:18:45.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f9732dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f972c0cfbf0 0x7f972c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f9732dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 0x7f972c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f9732dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972c0d0020 con 0x7f972c0b87a0 2023-05-10T04:18:45.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f9732dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f972c0d02d0 con 0x7f972c0cfbf0 2023-05-10T04:18:45.649 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f9732dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c0d0cb0 con 0x7f972c0d1100 2023-05-10T04:18:45.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f972bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f972c0cfbf0 0x7f972c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f972bfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f972c0cfbf0 0x7f972c1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58890/0 (socket says 172.21.15.154:58890) 2023-05-10T04:18:45.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f972bfff700 1 -- 172.21.15.154:0/2956166052 learned_addr learned my addr 172.21.15.154:0/2956166052 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:45.650 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f973139c700 1 --2- 172.21.15.154:0/2956166052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 0x7f972c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.646+0000 7f972bfff700 1 -- 172.21.15.154:0/2956166052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 msgr2=0x7f972c0d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:18:45.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.647+0000 7f972bfff700 1 --2- 172.21.15.154:0/2956166052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 0x7f972c0d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.651 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.647+0000 7f972bfff700 1 -- 172.21.15.154:0/2956166052 >> v1:172.21.15.154:6789/0 conn(0x7f972c0b87a0 legacy=0x7f972c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.647+0000 7f972bfff700 1 -- 172.21.15.154:0/2956166052 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c0cdc60 con 0x7f972c0cfbf0 2023-05-10T04:18:45.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.647+0000 7f972bfff700 1 --2- 172.21.15.154:0/2956166052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c1608f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97180098f0 tx=0x7f9718009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11387d2862603a86 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:45.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.647+0000 7f972b7fe700 1 -- 172.21.15.154:0/2956166052 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718011830 con 0x7f972c0cfbf0 2023-05-10T04:18:45.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.647+0000 7f972b7fe700 1 -- 172.21.15.154:0/2956166052 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9718011990 con 0x7f972c0cfbf0 2023-05-10T04:18:45.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.647+0000 7f972b7fe700 1 -- 172.21.15.154:0/2956166052 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718011d20 con 0x7f972c0cfbf0 2023-05-10T04:18:45.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.648+0000 7f9732dff700 1 -- 172.21.15.154:0/2956166052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 msgr2=0x7f972c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.652 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.648+0000 7f9732dff700 1 --2- 172.21.15.154:0/2956166052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c1608f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f97180098f0 tx=0x7f9718009c00 comp rx=0 tx=0).stop 2023-05-10T04:18:45.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.648+0000 7f9732dff700 1 -- 172.21.15.154:0/2956166052 shutdown_connections 2023-05-10T04:18:45.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.648+0000 7f9732dff700 1 --2- 172.21.15.154:0/2956166052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 0x7f972c0d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.653 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.648+0000 7f9732dff700 1 --2- 172.21.15.154:0/2956166052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c1608f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.648+0000 7f9732dff700 1 -- 172.21.15.154:0/2956166052 >> 172.21.15.154:0/2956166052 conn(0x7f972c071b10 msgr2=0x7f972c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:45.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.648+0000 7f9732dff700 1 -- 172.21.15.154:0/2956166052 shutdown_connections 2023-05-10T04:18:45.654 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.648+0000 7f9732dff700 1 -- 172.21.15.154:0/2956166052 wait complete. 2023-05-10T04:18:45.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.650+0000 7f9732dff700 1 Processor -- start 2023-05-10T04:18:45.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.650+0000 7f9732dff700 1 -- start start 2023-05-10T04:18:45.655 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f9732dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f972c0b87a0 0x7f972c1f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f9732dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c15cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f9732dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 0x7f972c0d2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f9732dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c15d220 con 0x7f972c0b87a0 2023-05-10T04:18:45.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f9732dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972c0cc0c0 con 0x7f972c0cfbf0 2023-05-10T04:18:45.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f9732dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972c0cb4b0 con 0x7f972c0d1100 2023-05-10T04:18:45.656 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f972bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c15cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f972bfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c15cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58900/0 (socket says 172.21.15.154:58900) 2023-05-10T04:18:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f973139c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 0x7f972c0d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f972bfff700 1 -- 172.21.15.154:0/1347387350 learned_addr learned my addr 172.21.15.154:0/1347387350 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f9730b9b700 1 --2- 172.21.15.154:0/1347387350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f972c0b87a0 0x7f972c1f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f972bfff700 1 -- 172.21.15.154:0/1347387350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 msgr2=0x7f972c0d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f972bfff700 1 --2- 172.21.15.154:0/1347387350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 0x7f972c0d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.657 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f972bfff700 1 -- 172.21.15.154:0/1347387350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f972c0b87a0 msgr2=0x7f972c1f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f972bfff700 1 --2- 172.21.15.154:0/1347387350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f972c0b87a0 0x7f972c1f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.658 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.652+0000 7f972bfff700 1 -- 172.21.15.154:0/1347387350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9718009550 con 0x7f972c0cfbf0 2023-05-10T04:18:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.653+0000 7f972bfff700 1 --2- 172.21.15.154:0/1347387350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c15cce0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9718009c40 tx=0x7f9718004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.653+0000 7f97297fa700 1 -- 172.21.15.154:0/1347387350 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9718004400 con 0x7f972c0cfbf0 2023-05-10T04:18:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.653+0000 7f97297fa700 1 -- 172.21.15.154:0/1347387350 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f971801f070 con 0x7f972c0cfbf0 2023-05-10T04:18:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.653+0000 7f97297fa700 1 -- 172.21.15.154:0/1347387350 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97180038e0 con 0x7f972c0cfbf0 2023-05-10T04:18:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.653+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f972c0cd980 con 0x7f972c0cfbf0 2023-05-10T04:18:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.653+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f972c0cd6a0 con 0x7f972c0cfbf0 2023-05-10T04:18:45.659 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.653+0000 7f97297fa700 1 -- 172.21.15.154:0/1347387350 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9718021030 con 0x7f972c0cfbf0 2023-05-10T04:18:45.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.653+0000 7f97297fa700 1 -- 172.21.15.154:0/1347387350 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f971801a450 con 0x7f972c0cfbf0 2023-05-10T04:18:45.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.654+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f972c160e30 con 0x7f972c0cfbf0 2023-05-10T04:18:45.660 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.657+0000 7f97297fa700 1 -- 172.21.15.154:0/1347387350 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f9718015020 con 0x7f972c0cfbf0 2023-05-10T04:18:45.746 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.744+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02dca35a-889e-4ec2-865c-174c1bdec803", "id": 5} v 0) v1 -- 0x7f972c0cc270 con 0x7f972c0cfbf0 2023-05-10T04:18:45.754 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.751+0000 7f97297fa700 1 -- 172.21.15.154:0/1347387350 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02dca35a-889e-4ec2-865c-174c1bdec803", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f972c0cc270 con 0x7f972c0cfbf0 2023-05-10T04:18:45.755 INFO:teuthology.orchestra.run.smithi154.stdout:5 2023-05-10T04:18:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.752+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 msgr2=0x7f972c15cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.752+0000 7f9732dff700 1 --2- 172.21.15.154:0/1347387350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c15cce0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9718009c40 tx=0x7f9718004750 comp rx=0 tx=0).stop 2023-05-10T04:18:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.752+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 shutdown_connections 2023-05-10T04:18:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.752+0000 7f9732dff700 1 --2- 172.21.15.154:0/1347387350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f972c0d1100 0x7f972c0d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.752+0000 7f9732dff700 1 --2- 172.21.15.154:0/1347387350 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f972c0b87a0 0x7f972c1f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.752+0000 7f9732dff700 1 --2- 172.21.15.154:0/1347387350 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f972c0cfbf0 0x7f972c15cce0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.756 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.752+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 >> 172.21.15.154:0/1347387350 conn(0x7f972c071b10 msgr2=0x7f972c0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:45.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.753+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 shutdown_connections 2023-05-10T04:18:45.757 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.753+0000 7f9732dff700 1 -- 172.21.15.154:0/1347387350 wait complete. 2023-05-10T04:18:45.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 71c6da84-17fc-46b1-be4d-719b9cb31953 6 2023-05-10T04:18:45.819 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:45.816+0000 7fbf38a38200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-10T04:18:45.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.950+0000 7f63c83ff700 1 Processor -- start 2023-05-10T04:18:45.953 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.951+0000 7f63c83ff700 1 -- start start 2023-05-10T04:18:45.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.952+0000 7f63c83ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.952+0000 7f63c83ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00cb280 con 0x7f63c0071030 2023-05-10T04:18:45.954 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.952+0000 7f63c83ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63c00714b0 con 0x7f63c015a5a0 2023-05-10T04:18:45.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.952+0000 7f63c83ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c015a970 con 0x7f63c006aaf0 2023-05-10T04:18:45.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.952+0000 7f63c599a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.952+0000 7f63c619b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f63c015a5a0 0x7f63c006a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.154:33164/0 (socket says 172.21.15.154:33164) 2023-05-10T04:18:45.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.952+0000 7f63c619b700 1 -- 172.21.15.154:0/3107452909 learned_addr learned my addr 172.21.15.154:0/3107452909 (peer_addr_for_me v1:172.21.15.154:0/0) 2023-05-10T04:18:45.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c599a700 1 -- 172.21.15.154:0/3107452909 >> v1:172.21.15.154:6789/0 conn(0x7f63c015a5a0 legacy=0x7f63c006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c599a700 1 -- 172.21.15.154:0/3107452909 >> v1:172.21.15.132:6789/0 conn(0x7f63c0071030 legacy=0x7f63c006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.955 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.952+0000 7f63c5199700 1 -- 172.21.15.154:0/3107452909 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914676409 0 0) 0x7f63c00714b0 con 0x7f63c015a5a0 2023-05-10T04:18:45.956 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c599a700 1 -- 172.21.15.154:0/3107452909 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0071700 con 0x7f63c006aaf0 2023-05-10T04:18:45.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c599a700 1 --2- 172.21.15.154:0/3107452909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0070af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009850 tx=0x7f63b0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ceb9db5fdcfeee4a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:45.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c5199700 1 -- 172.21.15.154:0/3107452909 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b0005e30 con 0x7f63c006aaf0 2023-05-10T04:18:45.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c5199700 1 -- 172.21.15.154:0/3107452909 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63b0006030 con 0x7f63c006aaf0 2023-05-10T04:18:45.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c5199700 1 -- 172.21.15.154:0/3107452909 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63b00063c0 con 0x7f63c006aaf0 2023-05-10T04:18:45.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c83ff700 1 -- 172.21.15.154:0/3107452909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 msgr2=0x7f63c0070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.953+0000 7f63c83ff700 1 --2- 172.21.15.154:0/3107452909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0070af0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f63b0009850 tx=0x7f63b0009b60 comp rx=0 tx=0).stop 2023-05-10T04:18:45.957 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.954+0000 7f63c83ff700 1 -- 172.21.15.154:0/3107452909 shutdown_connections 2023-05-10T04:18:45.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.954+0000 7f63c83ff700 1 --2- 172.21.15.154:0/3107452909 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0070af0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.954+0000 7f63c83ff700 1 -- 172.21.15.154:0/3107452909 >> 172.21.15.154:0/3107452909 conn(0x7f63c00cf720 msgr2=0x7f63c00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:45.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.954+0000 7f63c83ff700 1 -- 172.21.15.154:0/3107452909 shutdown_connections 2023-05-10T04:18:45.958 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.954+0000 7f63c83ff700 1 -- 172.21.15.154:0/3107452909 wait complete. 2023-05-10T04:18:45.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.955+0000 7f63c83ff700 1 Processor -- start 2023-05-10T04:18:45.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.956+0000 7f63c83ff700 1 -- start start 2023-05-10T04:18:45.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.956+0000 7f63c83ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.956+0000 7f63c83ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63c0071030 0x7f63c0151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.960 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.956+0000 7f63c83ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c015a5a0 0x7f63c015c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:45.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.956+0000 7f63c83ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0153180 con 0x7f63c0071030 2023-05-10T04:18:45.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.956+0000 7f63c83ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0152570 con 0x7f63c015a5a0 2023-05-10T04:18:45.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.956+0000 7f63c83ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63c0152850 con 0x7f63c006aaf0 2023-05-10T04:18:45.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52760/0 (socket says 172.21.15.154:52760) 2023-05-10T04:18:45.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 -- 172.21.15.154:0/379585849 learned_addr learned my addr 172.21.15.154:0/379585849 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:45.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c599a700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63c0071030 0x7f63c0151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.961 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c699c700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c015a5a0 0x7f63c015c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:45.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 -- 172.21.15.154:0/379585849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c015a5a0 msgr2=0x7f63c015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c015a5a0 0x7f63c015c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 -- 172.21.15.154:0/379585849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63c0071030 msgr2=0x7f63c0151170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:45.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63c0071030 0x7f63c0151170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:45.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 -- 172.21.15.154:0/379585849 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b0009430 con 0x7f63c006aaf0 2023-05-10T04:18:45.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c599a700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63c0071030 0x7f63c0151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:45.962 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.957+0000 7f63c619b700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0153610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00c520 tx=0x7f63bc00c830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:45.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.958+0000 7f63b6ffd700 1 -- 172.21.15.154:0/379585849 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc004c80 con 0x7f63c006aaf0 2023-05-10T04:18:45.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.958+0000 7f63b6ffd700 1 -- 172.21.15.154:0/379585849 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63bc004de0 con 0x7f63c006aaf0 2023-05-10T04:18:45.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.958+0000 7f63b6ffd700 1 -- 172.21.15.154:0/379585849 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc007310 con 0x7f63c006aaf0 2023-05-10T04:18:45.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.958+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63c006c6c0 con 0x7f63c006aaf0 2023-05-10T04:18:45.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.958+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c00719e0 con 0x7f63c006aaf0 2023-05-10T04:18:45.963 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.958+0000 7f63b6ffd700 1 -- 172.21.15.154:0/379585849 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f63bc0133c0 con 0x7f63c006aaf0 2023-05-10T04:18:45.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.958+0000 7f63b6ffd700 1 -- 172.21.15.154:0/379585849 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f63bc013c60 con 0x7f63c006aaf0 2023-05-10T04:18:45.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.959+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63c006c9a0 con 0x7f63c006aaf0 2023-05-10T04:18:45.964 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:45.961+0000 7f63b6ffd700 1 -- 172.21.15.154:0/379585849 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f63bc013670 con 0x7f63c006aaf0 2023-05-10T04:18:46.050 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.048+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd new", "uuid": "71c6da84-17fc-46b1-be4d-719b9cb31953", "id": 6} v 0) v1 -- 0x7f63c00cbcf0 con 0x7f63c006aaf0 2023-05-10T04:18:46.056 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.055+0000 7f63b6ffd700 1 -- 172.21.15.154:0/379585849 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "71c6da84-17fc-46b1-be4d-719b9cb31953", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f63bc013810 con 0x7f63c006aaf0 2023-05-10T04:18:46.057 INFO:teuthology.orchestra.run.smithi154.stdout:6 2023-05-10T04:18:46.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 msgr2=0x7f63c0153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0153610 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00c520 tx=0x7f63bc00c830 comp rx=0 tx=0).stop 2023-05-10T04:18:46.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 shutdown_connections 2023-05-10T04:18:46.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f63c015a5a0 0x7f63c015c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f63c006aaf0 0x7f63c0153610 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.058 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 --2- 172.21.15.154:0/379585849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63c0071030 0x7f63c0151170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 >> 172.21.15.154:0/379585849 conn(0x7f63c00cf720 msgr2=0x7f63c01570e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 shutdown_connections 2023-05-10T04:18:46.059 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.056+0000 7f63c83ff700 1 -- 172.21.15.154:0/379585849 wait complete. 2023-05-10T04:18:46.075 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --cluster ceph osd new 68ddbaf8-ce9c-4be2-9688-8379ee1a99e2 7 2023-05-10T04:18:46.190 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:46.189+0000 7f239dba4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T04:18:46.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.251+0000 7f0853bff700 1 Processor -- start 2023-05-10T04:18:46.253 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.251+0000 7f0853bff700 1 -- start start 2023-05-10T04:18:46.254 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.252+0000 7f0853bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f084c0b87a0 0x7f084c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.252+0000 7f0853bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c160d40 0x7f084c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f0853bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f084c0cdc60 con 0x7f084c1601e0 2023-05-10T04:18:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f0853bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f084c0d02d0 con 0x7f084c0b87a0 2023-05-10T04:18:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f0853bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0d0cb0 con 0x7f084c160d40 2023-05-10T04:18:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085199b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f084c0b87a0 0x7f084c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.255 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085219c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c160d40 0x7f084c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085199b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f084c0b87a0 0x7f084c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58910/0 (socket says 172.21.15.154:58910) 2023-05-10T04:18:46.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085219c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c160d40 0x7f084c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.154:52774/0 (socket says 172.21.15.154:52774) 2023-05-10T04:18:46.256 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085199b700 1 -- 172.21.15.154:0/909247006 learned_addr learned my addr 172.21.15.154:0/909247006 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085219c700 1 -- 172.21.15.154:0/909247006 >> v2:172.21.15.154:3300/0 conn(0x7f084c0b87a0 msgr2=0x7f084c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:18:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085219c700 1 --2- 172.21.15.154:0/909247006 >> v2:172.21.15.154:3300/0 conn(0x7f084c0b87a0 0x7f084c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085219c700 1 -- 172.21.15.154:0/909247006 >> v1:172.21.15.154:6789/0 conn(0x7f084c1601e0 legacy=0x7f084c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.257 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085219c700 1 -- 172.21.15.154:0/909247006 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f084c0cd6a0 con 0x7f084c160d40 2023-05-10T04:18:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f0850999700 1 -- 172.21.15.154:0/909247006 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2597235312 0 0) 0x7f084c0cdc60 con 0x7f084c1601e0 2023-05-10T04:18:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.253+0000 7f085199b700 1 --2- 172.21.15.154:0/909247006 >> v2:172.21.15.154:3300/0 conn(0x7f084c0b87a0 0x7f084c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.254+0000 7f085219c700 1 --2- 172.21.15.154:0/909247006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c160d40 0x7f084c0d1100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0844009d90 tx=0x7f084400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af4c3e562ff2c7dc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.254+0000 7f0850999700 1 -- 172.21.15.154:0/909247006 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084400e070 con 0x7f084c160d40 2023-05-10T04:18:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.254+0000 7f0850999700 1 -- 172.21.15.154:0/909247006 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084400bb20 con 0x7f084c160d40 2023-05-10T04:18:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.254+0000 7f0850999700 1 -- 172.21.15.154:0/909247006 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0844012430 con 0x7f084c160d40 2023-05-10T04:18:46.258 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.254+0000 7f0853bff700 1 -- 172.21.15.154:0/909247006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c160d40 msgr2=0x7f084c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.254+0000 7f0853bff700 1 --2- 172.21.15.154:0/909247006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c160d40 0x7f084c0d1100 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0844009d90 tx=0x7f084400b330 comp rx=0 tx=0).stop 2023-05-10T04:18:46.259 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.255+0000 7f0853bff700 1 -- 172.21.15.154:0/909247006 shutdown_connections 2023-05-10T04:18:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.255+0000 7f0853bff700 1 --2- 172.21.15.154:0/909247006 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c160d40 0x7f084c0d1100 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.255+0000 7f0853bff700 1 --2- 172.21.15.154:0/909247006 >> v2:172.21.15.154:3300/0 conn(0x7f084c0b87a0 0x7f084c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.255+0000 7f0853bff700 1 -- 172.21.15.154:0/909247006 >> 172.21.15.154:0/909247006 conn(0x7f084c071b10 msgr2=0x7f084c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.255+0000 7f0853bff700 1 -- 172.21.15.154:0/909247006 shutdown_connections 2023-05-10T04:18:46.262 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.255+0000 7f0853bff700 1 -- 172.21.15.154:0/909247006 wait complete. 2023-05-10T04:18:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.256+0000 7f0853bff700 1 Processor -- start 2023-05-10T04:18:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.257+0000 7f0853bff700 1 -- start start 2023-05-10T04:18:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.257+0000 7f0853bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c0b87a0 0x7f084c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.257+0000 7f0853bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c1601e0 0x7f084c151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.257+0000 7f0853bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f084c160d40 0x7f084c15f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.257+0000 7f0853bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c151970 con 0x7f084c160d40 2023-05-10T04:18:46.263 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.257+0000 7f0853bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0ca560 con 0x7f084c0b87a0 2023-05-10T04:18:46.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.257+0000 7f0853bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084c0ca840 con 0x7f084c1601e0 2023-05-10T04:18:46.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c0b87a0 0x7f084c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085119a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c1601e0 0x7f084c151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c0b87a0 0x7f084c0c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.154:58924/0 (socket says 172.21.15.154:58924) 2023-05-10T04:18:46.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 -- 172.21.15.154:0/1117545103 learned_addr learned my addr 172.21.15.154:0/1117545103 (peer_addr_for_me v2:172.21.15.154:0/0) 2023-05-10T04:18:46.264 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085219c700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f084c160d40 0x7f084c15f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 -- 172.21.15.154:0/1117545103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c1601e0 msgr2=0x7f084c151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c1601e0 0x7f084c151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 -- 172.21.15.154:0/1117545103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f084c160d40 msgr2=0x7f084c15f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f084c160d40 0x7f084c15f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 -- 172.21.15.154:0/1117545103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0848009550 con 0x7f084c0b87a0 2023-05-10T04:18:46.265 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085119a700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c1601e0 0x7f084c151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.258+0000 7f085199b700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c0b87a0 0x7f084c0c9f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f084800ebe0 tx=0x7f084800eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.259+0000 7f08427fc700 1 -- 172.21.15.154:0/1117545103 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800c850 con 0x7f084c0b87a0 2023-05-10T04:18:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.259+0000 7f08427fc700 1 -- 172.21.15.154:0/1117545103 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084800c9b0 con 0x7f084c0b87a0 2023-05-10T04:18:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.259+0000 7f08427fc700 1 -- 172.21.15.154:0/1117545103 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800cd40 con 0x7f084c0b87a0 2023-05-10T04:18:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.259+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0844009a70 con 0x7f084c0b87a0 2023-05-10T04:18:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.259+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f084c0d1640 con 0x7f084c0b87a0 2023-05-10T04:18:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.260+0000 7f08427fc700 1 -- 172.21.15.154:0/1117545103 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0848005d20 con 0x7f084c0b87a0 2023-05-10T04:18:46.266 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.260+0000 7f08427fc700 1 -- 172.21.15.154:0/1117545103 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f0848006840 con 0x7f084c0b87a0 2023-05-10T04:18:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.260+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f084c0cd980 con 0x7f084c0b87a0 2023-05-10T04:18:46.267 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.262+0000 7f08427fc700 1 -- 172.21.15.154:0/1117545103 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f0848021060 con 0x7f084c0b87a0 2023-05-10T04:18:46.287 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:46.285+0000 7f239dba4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-10T04:18:46.350 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.348+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd new", "uuid": "68ddbaf8-ce9c-4be2-9688-8379ee1a99e2", "id": 7} v 0) v1 -- 0x7f084c0cb450 con 0x7f084c0b87a0 2023-05-10T04:18:46.359 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.357+0000 7f08427fc700 1 -- 172.21.15.154:0/1117545103 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "68ddbaf8-ce9c-4be2-9688-8379ee1a99e2", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0848017070 con 0x7f084c0b87a0 2023-05-10T04:18:46.359 INFO:teuthology.orchestra.run.smithi154.stdout:7 2023-05-10T04:18:46.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c0b87a0 msgr2=0x7f084c0c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c0b87a0 0x7f084c0c9f80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f084800ebe0 tx=0x7f084800eef0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 shutdown_connections 2023-05-10T04:18:46.360 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f084c160d40 0x7f084c15f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f084c0b87a0 0x7f084c0c9f80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 --2- 172.21.15.154:0/1117545103 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f084c1601e0 0x7f084c151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 >> 172.21.15.154:0/1117545103 conn(0x7f084c071b10 msgr2=0x7f084c0b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:46.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 shutdown_connections 2023-05-10T04:18:46.361 INFO:teuthology.orchestra.run.smithi154.stderr:2023-05-10T04:18:46.358+0000 7f0853bff700 1 -- 172.21.15.154:0/1117545103 wait complete. 2023-05-10T04:18:46.376 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-10T04:18:46.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-10T04:18:46.380 INFO:tasks.ceph.osd.0:Started 2023-05-10T04:18:46.381 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-10T04:18:46.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-10T04:18:46.386 INFO:tasks.ceph.osd.1:Started 2023-05-10T04:18:46.386 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-10T04:18:46.386 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-10T04:18:46.390 INFO:tasks.ceph.osd.2:Started 2023-05-10T04:18:46.390 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-10T04:18:46.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-10T04:18:46.395 INFO:tasks.ceph.osd.3:Started 2023-05-10T04:18:46.395 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-10T04:18:46.395 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-10T04:18:46.399 INFO:tasks.ceph.osd.4:Started 2023-05-10T04:18:46.399 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-10T04:18:46.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-10T04:18:46.403 INFO:tasks.ceph.osd.5:Started 2023-05-10T04:18:46.403 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-10T04:18:46.403 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-10T04:18:46.407 INFO:tasks.ceph.osd.6:Started 2023-05-10T04:18:46.407 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-10T04:18:46.408 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-10T04:18:46.413 INFO:tasks.ceph.osd.7:Started 2023-05-10T04:18:46.413 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:18:46.495 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:46.493+0000 7f239dba4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T04:18:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.662+0000 7f9b029ff700 1 Processor -- start 2023-05-10T04:18:46.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.662+0000 7f9b029ff700 1 -- start start 2023-05-10T04:18:46.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.663+0000 7f9b029ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9afc0b87a0 0x7f9afc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.663+0000 7f9b029ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc0cdc60 con 0x7f9afc160d40 2023-05-10T04:18:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.663+0000 7f9b029ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9afc0cd6a0 con 0x7f9afc1601e0 2023-05-10T04:18:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.663+0000 7f9b029ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9afc0d02d0 con 0x7f9afc0b87a0 2023-05-10T04:18:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.664+0000 7f9afbfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9afc0b87a0 0x7f9afc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.664+0000 7f9afbfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9afc0b87a0 0x7f9afc0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47370/0 (socket says 172.21.15.132:47370) 2023-05-10T04:18:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.664+0000 7f9b00f9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9afc160d40 0x7f9afc0d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43170/0 (socket says 172.21.15.132:43170) 2023-05-10T04:18:46.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.664+0000 7f9afbfff700 1 -- 172.21.15.132:0/3263995207 learned_addr learned my addr 172.21.15.132:0/3263995207 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:18:46.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.664+0000 7f9afbfff700 1 -- 172.21.15.132:0/3263995207 >> v1:172.21.15.154:6789/0 conn(0x7f9afc1601e0 legacy=0x7f9afc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.664+0000 7f9afbfff700 1 -- 172.21.15.132:0/3263995207 >> v1:172.21.15.132:6789/0 conn(0x7f9afc160d40 legacy=0x7f9afc0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.664+0000 7f9afbfff700 1 -- 172.21.15.132:0/3263995207 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0cd980 con 0x7f9afc0b87a0 2023-05-10T04:18:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.664+0000 7f9afbfff700 1 --2- 172.21.15.132:0/3263995207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc0b87a0 0x7f9afc0cfbf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0098f0 tx=0x7f9aec009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=702b5161172be457 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9afaffd700 1 -- 172.21.15.132:0/3263995207 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00b8a0 con 0x7f9afc0b87a0 2023-05-10T04:18:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9afaffd700 1 -- 172.21.15.132:0/3263995207 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec00ba00 con 0x7f9afc0b87a0 2023-05-10T04:18:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9afaffd700 1 -- 172.21.15.132:0/3263995207 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec00bd90 con 0x7f9afc0b87a0 2023-05-10T04:18:46.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9b029ff700 1 -- 172.21.15.132:0/3263995207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc0b87a0 msgr2=0x7f9afc0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9b029ff700 1 --2- 172.21.15.132:0/3263995207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc0b87a0 0x7f9afc0cfbf0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9aec0098f0 tx=0x7f9aec009c00 comp rx=0 tx=0).stop 2023-05-10T04:18:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9b029ff700 1 -- 172.21.15.132:0/3263995207 shutdown_connections 2023-05-10T04:18:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9b029ff700 1 --2- 172.21.15.132:0/3263995207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc0b87a0 0x7f9afc0cfbf0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9b029ff700 1 -- 172.21.15.132:0/3263995207 >> 172.21.15.132:0/3263995207 conn(0x7f9afc071b10 msgr2=0x7f9afc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9b029ff700 1 -- 172.21.15.132:0/3263995207 shutdown_connections 2023-05-10T04:18:46.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.665+0000 7f9b029ff700 1 -- 172.21.15.132:0/3263995207 wait complete. 2023-05-10T04:18:46.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.667+0000 7f9b029ff700 1 Processor -- start 2023-05-10T04:18:46.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.667+0000 7f9b029ff700 1 -- start start 2023-05-10T04:18:46.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9b029ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9afc0b87a0 0x7f9afc15cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9b029ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc1601e0 0x7f9afc1e68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9b029ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9afc160d40 0x7f9afc15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:46.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9b029ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1e7120 con 0x7f9afc1601e0 2023-05-10T04:18:46.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9b029ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1e7400 con 0x7f9afc0b87a0 2023-05-10T04:18:46.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9b029ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9afc1e76e0 con 0x7f9afc160d40 2023-05-10T04:18:46.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9afb7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc1601e0 0x7f9afc1e68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9afb7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc1601e0 0x7f9afc1e68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47372/0 (socket says 172.21.15.132:47372) 2023-05-10T04:18:46.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9afb7fe700 1 -- 172.21.15.132:0/3782713436 learned_addr learned my addr 172.21.15.132:0/3782713436 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:18:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9afbfff700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9afc0b87a0 0x7f9afc15cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.668+0000 7f9b00f9c700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9afc160d40 0x7f9afc15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9afb7fe700 1 -- 172.21.15.132:0/3782713436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9afc160d40 msgr2=0x7f9afc15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9afb7fe700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9afc160d40 0x7f9afc15a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9afb7fe700 1 -- 172.21.15.132:0/3782713436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9afc0b87a0 msgr2=0x7f9afc15cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9afb7fe700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9afc0b87a0 0x7f9afc15cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9afb7fe700 1 -- 172.21.15.132:0/3782713436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec009550 con 0x7f9afc1601e0 2023-05-10T04:18:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9afb7fe700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc1601e0 0x7f9afc1e68f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c4e0 tx=0x7f9af000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9af8ff9700 1 -- 172.21.15.132:0/3782713436 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00052d0 con 0x7f9afc1601e0 2023-05-10T04:18:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9af8ff9700 1 -- 172.21.15.132:0/3782713436 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af0005430 con 0x7f9afc1601e0 2023-05-10T04:18:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9af8ff9700 1 -- 172.21.15.132:0/3782713436 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af00038c0 con 0x7f9afc1601e0 2023-05-10T04:18:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9afc0d19a0 con 0x7f9afc1601e0 2023-05-10T04:18:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.669+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9afc0d1810 con 0x7f9afc1601e0 2023-05-10T04:18:46.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.670+0000 7f9af8ff9700 1 -- 172.21.15.132:0/3782713436 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9af0003d20 con 0x7f9afc1601e0 2023-05-10T04:18:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.670+0000 7f9af8ff9700 1 -- 172.21.15.132:0/3782713436 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f9af0011d60 con 0x7f9afc1601e0 2023-05-10T04:18:46.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.670+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9afc0d1b30 con 0x7f9afc1601e0 2023-05-10T04:18:46.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.675+0000 7f9af8ff9700 1 -- 172.21.15.132:0/3782713436 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f9af0017070 con 0x7f9afc1601e0 2023-05-10T04:18:46.707 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:46.705+0000 7fbf38a38200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-10T04:18:46.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.747+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9afc0b52f0 con 0x7f9afc1601e0 2023-05-10T04:18:46.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.748+0000 7f9af8ff9700 1 -- 172.21.15.132:0/3782713436 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f9af0011590 con 0x7f9afc1601e0 2023-05-10T04:18:46.750 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:18:46.750 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":10,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:18:46.350802+0000","last_up_change":"0.000000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:18:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc1601e0 msgr2=0x7f9afc1e68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc1601e0 0x7f9afc1e68f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9af000c4e0 tx=0x7f9af000c7f0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 shutdown_connections 2023-05-10T04:18:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9afc160d40 0x7f9afc15a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9afc0b87a0 0x7f9afc15cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 --2- 172.21.15.132:0/3782713436 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9afc1601e0 0x7f9afc1e68f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 >> 172.21.15.132:0/3782713436 conn(0x7f9afc071b10 msgr2=0x7f9afc0cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 shutdown_connections 2023-05-10T04:18:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:18:46.749+0000 7f9b029ff700 1 -- 172.21.15.132:0/3782713436 wait complete. 2023-05-10T04:18:46.768 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-10T04:18:46.768 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-10T04:18:46.801 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:46.799+0000 7fbf38a38200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-10T04:18:46.837 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:46.835+0000 7f239dba4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-10T04:18:46.931 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:46.929+0000 7f239dba4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T04:18:46.972 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:46.970+0000 7fbf38a38200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-10T04:18:47.078 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-05-10T04:18:47.076+0000 7f73fbc80640 -1 Falling back to public interface 2023-05-10T04:18:47.078 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-05-10T04:18:47.076+0000 7f012b500640 -1 Falling back to public interface 2023-05-10T04:18:47.079 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-05-10T04:18:47.076+0000 7f011d3fd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-05-10T04:18:47.079 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-05-10T04:18:47.077+0000 7f73edbfd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6806/0: (98) Address already in use 2023-05-10T04:18:47.079 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T04:18:47.078+0000 7fb8e8189640 -1 Falling back to public interface 2023-05-10T04:18:47.085 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T04:18:47.084+0000 7f2fb1565640 -1 Falling back to public interface 2023-05-10T04:18:47.095 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T04:18:47.093+0000 7f5ed53b6640 -1 Falling back to public interface 2023-05-10T04:18:47.104 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T04:18:47.102+0000 7f1b4e339640 -1 Falling back to public interface 2023-05-10T04:18:47.109 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-05-10T04:18:47.108+0000 7f7d873fe640 -1 Falling back to public interface 2023-05-10T04:18:47.110 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-05-10T04:18:47.108+0000 7fa5e8126640 -1 Falling back to public interface 2023-05-10T04:18:47.251 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:47.249+0000 7f239dba4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T04:18:47.267 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:47.266+0000 7fbf38a38200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-05-10T04:18:47.359 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:47.357+0000 7fbf38a38200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-10T04:18:47.519 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:47.517+0000 7f239dba4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T04:18:47.573 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-10T04:18:47.683 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:47.681+0000 7fbf38a38200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-10T04:18:47.717 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:47.715+0000 7f239dba4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T04:18:47.740 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.739+0000 7f3aeb5ff700 1 Processor -- start 2023-05-10T04:18:47.741 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.739+0000 7f3aeb5ff700 1 -- start start 2023-05-10T04:18:47.742 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.740+0000 7f3aeb5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae406a3c0 0x7f3ae415cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:47.742 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3aeb5ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae415dda0 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.743 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3aeb5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae415d190 con 0x7f3ae40b1740 2023-05-10T04:18:47.743 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3aeb5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40ce560 con 0x7f3ae406a3c0 2023-05-10T04:18:47.743 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3ae9b9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3ae40cc6d0 0x7f3ae4160670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43184/0 (socket says 172.21.15.132:43184) 2023-05-10T04:18:47.743 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3ae9b9c700 1 -- 172.21.15.132:0/967604372 learned_addr learned my addr 172.21.15.132:0/967604372 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:18:47.743 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3ae8b9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f3ae40b1740 0x7f3ae406a790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:50830/0 (socket says 172.21.15.132:50830) 2023-05-10T04:18:47.744 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3ae939b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae406a3c0 0x7f3ae415cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:47.745 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3adbfff700 1 -- 172.21.15.132:0/967604372 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2401516945 0 0) 0x7f3ae415d190 con 0x7f3ae40b1740 2023-05-10T04:18:47.745 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3adbfff700 1 -- 172.21.15.132:0/967604372 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad00035b0 con 0x7f3ae40b1740 2023-05-10T04:18:47.745 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3adbfff700 1 -- 172.21.15.132:0/967604372 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226530802 0 0) 0x7f3ae415dda0 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.745 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3ae939b700 1 -- 172.21.15.132:0/967604372 >> v1:172.21.15.154:6789/0 conn(0x7f3ae40b1740 legacy=0x7f3ae406a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:47.745 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3ae939b700 1 -- 172.21.15.132:0/967604372 >> v1:172.21.15.132:6789/0 conn(0x7f3ae40cc6d0 legacy=0x7f3ae4160670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:47.746 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.741+0000 7f3ae939b700 1 -- 172.21.15.132:0/967604372 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae415d470 con 0x7f3ae406a3c0 2023-05-10T04:18:47.746 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.742+0000 7f3ae939b700 1 --2- 172.21.15.132:0/967604372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae406a3c0 0x7f3ae415cbb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009870 tx=0x7f3ae0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c8d2b271dffd15 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:47.746 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.742+0000 7f3adbfff700 1 -- 172.21.15.132:0/967604372 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0011830 con 0x7f3ae406a3c0 2023-05-10T04:18:47.746 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.742+0000 7f3adbfff700 1 -- 172.21.15.132:0/967604372 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae0011990 con 0x7f3ae406a3c0 2023-05-10T04:18:47.746 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.742+0000 7f3adbfff700 1 -- 172.21.15.132:0/967604372 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae0011d20 con 0x7f3ae406a3c0 2023-05-10T04:18:47.746 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.743+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/967604372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae406a3c0 msgr2=0x7f3ae415cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:47.746 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.743+0000 7f3aeb5ff700 1 --2- 172.21.15.132:0/967604372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae406a3c0 0x7f3ae415cbb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ae0009870 tx=0x7f3ae0009b80 comp rx=0 tx=0).stop 2023-05-10T04:18:47.746 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.743+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/967604372 shutdown_connections 2023-05-10T04:18:47.747 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.743+0000 7f3aeb5ff700 1 --2- 172.21.15.132:0/967604372 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae406a3c0 0x7f3ae415cbb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:47.747 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.743+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/967604372 >> 172.21.15.132:0/967604372 conn(0x7f3ae406b4d0 msgr2=0x7f3ae406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:47.747 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.743+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/967604372 shutdown_connections 2023-05-10T04:18:47.747 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.743+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/967604372 wait complete. 2023-05-10T04:18:47.748 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.744+0000 7f3aeb5ff700 1 Processor -- start 2023-05-10T04:18:47.749 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.745+0000 7f3aeb5ff700 1 -- start start 2023-05-10T04:18:47.749 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.745+0000 7f3aeb5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ae406a3c0 0x7f3ae41f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:47.749 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.745+0000 7f3aeb5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae40b1740 0x7f3ae40b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:47.749 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.745+0000 7f3aeb5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae40cc6d0 0x7f3ae41f30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:47.749 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3aeb5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40b3d90 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.749 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3aeb5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae41f35f0 con 0x7f3ae406a3c0 2023-05-10T04:18:47.750 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3aeb5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae40c6e30 con 0x7f3ae40b1740 2023-05-10T04:18:47.750 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae9b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae40cc6d0 0x7f3ae41f30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:47.750 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae939b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ae406a3c0 0x7f3ae41f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:47.750 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae9b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae40cc6d0 0x7f3ae41f30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47382/0 (socket says 172.21.15.132:47382) 2023-05-10T04:18:47.750 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae8b9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae40b1740 0x7f3ae40b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:47.750 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae9b9c700 1 -- 172.21.15.132:0/3712464197 learned_addr learned my addr 172.21.15.132:0/3712464197 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:18:47.750 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae9b9c700 1 -- 172.21.15.132:0/3712464197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae40b1740 msgr2=0x7f3ae40b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:47.751 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae9b9c700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae40b1740 0x7f3ae40b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:47.751 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae9b9c700 1 -- 172.21.15.132:0/3712464197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ae406a3c0 msgr2=0x7f3ae41f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:47.751 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae9b9c700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ae406a3c0 0x7f3ae41f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:47.751 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae9b9c700 1 -- 172.21.15.132:0/3712464197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00094a0 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.751 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae8b9a700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae40b1740 0x7f3ae40b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:47.751 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.746+0000 7f3ae939b700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ae406a3c0 0x7f3ae41f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:47.751 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.747+0000 7f3ae9b9c700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae40cc6d0 0x7f3ae41f30b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00cba0 tx=0x7f3adc00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:47.751 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.747+0000 7f3ad9ffb700 1 -- 172.21.15.132:0/3712464197 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc00aa40 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.752 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.747+0000 7f3ad9ffb700 1 -- 172.21.15.132:0/3712464197 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc00abc0 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.752 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.747+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae415da30 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.752 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.747+0000 7f3ad9ffb700 1 -- 172.21.15.132:0/3712464197 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc0070d0 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.752 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.747+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae415d750 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.753 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.747+0000 7f3ad9ffb700 1 -- 172.21.15.132:0/3712464197 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3adc007530 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.753 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.747+0000 7f3ad9ffb700 1 -- 172.21.15.132:0/3712464197 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3adc012ad0 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.753 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.748+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae40af1a0 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.753 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.750+0000 7f3ad9ffb700 1 -- 172.21.15.132:0/3712464197 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72437 (secure 0 0 0) 0x7f3adc018070 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.823 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.821+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ae40c6ff0 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.824 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.822+0000 7f3ad9ffb700 1 -- 172.21.15.132:0/3712464197 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f3adc007920 con 0x7f3ae40cc6d0 2023-05-10T04:18:47.824 INFO:teuthology.misc.health.smithi132.stdout: 2023-05-10T04:18:47.824 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":10,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:18:46.350802+0000","last_up_change":"0.000000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:18:47.825 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae40cc6d0 msgr2=0x7f3ae41f30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:47.825 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae40cc6d0 0x7f3ae41f30b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f3adc00cba0 tx=0x7f3adc00ceb0 comp rx=0 tx=0).stop 2023-05-10T04:18:47.826 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 shutdown_connections 2023-05-10T04:18:47.826 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae40cc6d0 0x7f3ae41f30b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:47.826 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3ae406a3c0 0x7f3ae41f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:47.826 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 --2- 172.21.15.132:0/3712464197 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3ae40b1740 0x7f3ae40b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:47.826 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 >> 172.21.15.132:0/3712464197 conn(0x7f3ae406b4d0 msgr2=0x7f3ae40af3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:47.826 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 shutdown_connections 2023-05-10T04:18:47.826 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:47.823+0000 7f3aeb5ff700 1 -- 172.21.15.132:0/3712464197 wait complete. 2023-05-10T04:18:47.839 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-10T04:18:47.866 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:47.864+0000 7f239dba4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T04:18:47.951 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:47.950+0000 7fbf38a38200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-10T04:18:48.144 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:48.142+0000 7fbf38a38200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-10T04:18:48.244 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:48.242+0000 7f239dba4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T04:18:48.286 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:48.284+0000 7fbf38a38200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-10T04:18:48.365 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:48.363+0000 7f239dba4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T04:18:48.590 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:48.589+0000 7f239dba4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T04:18:48.663 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:48.661+0000 7fbf38a38200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-10T04:18:48.787 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:48.785+0000 7fbf38a38200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-10T04:18:49.011 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:49.009+0000 7fbf38a38200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-10T04:18:49.301 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:49.298+0000 7f239dba4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T04:18:49.739 INFO:tasks.ceph.mgr.x.smithi154.stderr:2023-05-10T04:18:49.737+0000 7fbf38a38200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-10T04:18:50.321 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:50.318+0000 7f23515fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-10T04:18:50.322 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-05-10T04:18:50.320+0000 7f23515fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-10T04:18:50.600 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T04:18:50.598+0000 7fb8e8189640 -1 osd.6 0 log_to_monitors true 2023-05-10T04:18:50.632 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-05-10T04:18:50.629+0000 7f73fbc80640 -1 osd.1 0 log_to_monitors true 2023-05-10T04:18:50.667 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-05-10T04:18:50.664+0000 7f012b500640 -1 osd.2 0 log_to_monitors true 2023-05-10T04:18:50.668 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T04:18:50.666+0000 7f2fb1565640 -1 osd.5 0 log_to_monitors true 2023-05-10T04:18:50.685 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T04:18:50.683+0000 7f5ed53b6640 -1 osd.7 0 log_to_monitors true 2023-05-10T04:18:50.693 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T04:18:50.692+0000 7f1b4e339640 -1 osd.4 0 log_to_monitors true 2023-05-10T04:18:50.952 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-05-10T04:18:50.950+0000 7fa5e8126640 -1 osd.0 0 log_to_monitors true 2023-05-10T04:18:50.956 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-05-10T04:18:50.953+0000 7f7d873fe640 -1 osd.3 0 log_to_monitors true 2023-05-10T04:18:54.156 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T04:18:54.152+0000 7fb8d77f8700 -1 osd.6 0 waiting for initial osdmap 2023-05-10T04:18:54.187 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T04:18:54.185+0000 7fb8ce7fa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T04:18:54.303 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T04:18:54.301+0000 7f2fa03f7700 -1 osd.5 0 waiting for initial osdmap 2023-05-10T04:18:54.307 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T04:18:54.305+0000 7f5ec41f7700 -1 osd.7 0 waiting for initial osdmap 2023-05-10T04:18:54.333 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T04:18:54.331+0000 7f2f97bfa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T04:18:54.348 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T04:18:54.346+0000 7f5ebb9fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T04:18:54.481 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-05-10T04:18:54.478+0000 7f011a3f7700 -1 osd.2 0 waiting for initial osdmap 2023-05-10T04:18:54.501 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-05-10T04:18:54.498+0000 7f0111bfa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T04:18:54.504 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-05-10T04:18:54.499+0000 7f7d761f7700 -1 osd.3 0 waiting for initial osdmap 2023-05-10T04:18:54.510 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-05-10T04:18:54.507+0000 7f73eabf7700 -1 osd.1 0 waiting for initial osdmap 2023-05-10T04:18:54.521 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-05-10T04:18:54.518+0000 7f7d6d9fa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T04:18:54.528 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-05-10T04:18:54.526+0000 7f73e23fa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T04:18:54.646 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-10T04:18:54.653 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-05-10T04:18:54.651+0000 7fa5d6ff7700 -1 osd.0 0 waiting for initial osdmap 2023-05-10T04:18:54.672 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-05-10T04:18:54.669+0000 7fa5ce7fa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T04:18:54.809 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.807+0000 7fe8a41ff700 1 Processor -- start 2023-05-10T04:18:54.810 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.807+0000 7fe8a41ff700 1 -- start start 2023-05-10T04:18:54.811 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a41ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:54.811 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a41ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe89c15e5e0 0x7fe89c06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:54.811 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a41ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0cf940 con 0x7fe89c0cf570 2023-05-10T04:18:54.811 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a41ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c15b910 con 0x7fe89c15e5e0 2023-05-10T04:18:54.811 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a41ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c15ee10 con 0x7fe89c0c98a0 2023-05-10T04:18:54.811 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a1f9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe89c0cf570 0x7fe89c0c9190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55070/0 (socket says 172.21.15.132:55070) 2023-05-10T04:18:54.812 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a1f9b700 1 -- 172.21.15.132:0/79241111 learned_addr learned my addr 172.21.15.132:0/79241111 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:18:54.813 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a179a700 1 --2- 172.21.15.132:0/79241111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:54.813 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.808+0000 7fe8a279c700 1 --2- 172.21.15.132:0/79241111 >> v2:172.21.15.154:3300/0 conn(0x7fe89c15e5e0 0x7fe89c06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:54.813 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a0f99700 1 -- 172.21.15.132:0/79241111 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1648717778 0 0) 0x7fe89c0cf940 con 0x7fe89c0cf570 2023-05-10T04:18:54.813 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a0f99700 1 -- 172.21.15.132:0/79241111 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8880035b0 con 0x7fe89c0cf570 2023-05-10T04:18:54.814 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a179a700 1 -- 172.21.15.132:0/79241111 >> v2:172.21.15.154:3300/0 conn(0x7fe89c15e5e0 msgr2=0x7fe89c06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:18:54.814 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a179a700 1 --2- 172.21.15.132:0/79241111 >> v2:172.21.15.154:3300/0 conn(0x7fe89c15e5e0 0x7fe89c06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:54.814 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a179a700 1 -- 172.21.15.132:0/79241111 >> v1:172.21.15.132:6789/0 conn(0x7fe89c0cf570 legacy=0x7fe89c0c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:54.814 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a179a700 1 -- 172.21.15.132:0/79241111 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c15ab50 con 0x7fe89c0c98a0 2023-05-10T04:18:54.814 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a279c700 1 --2- 172.21.15.132:0/79241111 >> v2:172.21.15.154:3300/0 conn(0x7fe89c15e5e0 0x7fe89c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:54.814 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a179a700 1 --2- 172.21.15.132:0/79241111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c15e0a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009840 tx=0x7fe88c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36dbc1dd4fbb1e19 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:54.814 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a0f99700 1 -- 172.21.15.132:0/79241111 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c011830 con 0x7fe89c0c98a0 2023-05-10T04:18:54.815 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a0f99700 1 -- 172.21.15.132:0/79241111 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe88c011990 con 0x7fe89c0c98a0 2023-05-10T04:18:54.815 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.809+0000 7fe8a0f99700 1 -- 172.21.15.132:0/79241111 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe88c011d20 con 0x7fe89c0c98a0 2023-05-10T04:18:54.815 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.810+0000 7fe8a41ff700 1 -- 172.21.15.132:0/79241111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 msgr2=0x7fe89c15e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:54.815 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.810+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/79241111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c15e0a0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009840 tx=0x7fe88c009b50 comp rx=0 tx=0).stop 2023-05-10T04:18:54.815 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.810+0000 7fe8a41ff700 1 -- 172.21.15.132:0/79241111 shutdown_connections 2023-05-10T04:18:54.815 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.810+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/79241111 >> v2:172.21.15.154:3300/0 conn(0x7fe89c15e5e0 0x7fe89c06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:54.815 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.810+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/79241111 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c15e0a0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:54.815 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.810+0000 7fe8a41ff700 1 -- 172.21.15.132:0/79241111 >> 172.21.15.132:0/79241111 conn(0x7fe89c06a3c0 msgr2=0x7fe89c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:54.816 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.810+0000 7fe8a41ff700 1 -- 172.21.15.132:0/79241111 shutdown_connections 2023-05-10T04:18:54.816 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.810+0000 7fe8a41ff700 1 -- 172.21.15.132:0/79241111 wait complete. 2023-05-10T04:18:54.817 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.812+0000 7fe8a41ff700 1 Processor -- start 2023-05-10T04:18:54.818 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.812+0000 7fe8a41ff700 1 -- start start 2023-05-10T04:18:54.818 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a41ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:54.818 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a41ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe89c0cf570 0x7fe89c14a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:54.818 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a41ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe89c15e5e0 0x7fe89c1efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:54.818 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a41ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1f0600 con 0x7fe89c15e5e0 2023-05-10T04:18:54.818 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a41ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1f08e0 con 0x7fe89c0cf570 2023-05-10T04:18:54.818 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a41ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1f0bc0 con 0x7fe89c0c98a0 2023-05-10T04:18:54.818 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a279c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe89c15e5e0 0x7fe89c1efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:54.819 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a1f9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:54.819 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a279c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe89c15e5e0 0x7fe89c1efce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36358/0 (socket says 172.21.15.132:36358) 2023-05-10T04:18:54.819 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a279c700 1 -- 172.21.15.132:0/2975077040 learned_addr learned my addr 172.21.15.132:0/2975077040 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:18:54.819 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a179a700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe89c0cf570 0x7fe89c14a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:54.819 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a279c700 1 -- 172.21.15.132:0/2975077040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 msgr2=0x7fe89c152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:54.819 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a279c700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:54.819 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a279c700 1 -- 172.21.15.132:0/2975077040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe89c0cf570 msgr2=0x7fe89c14a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:54.820 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a279c700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe89c0cf570 0x7fe89c14a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:54.820 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a279c700 1 -- 172.21.15.132:0/2975077040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894009a70 con 0x7fe89c15e5e0 2023-05-10T04:18:54.820 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.813+0000 7fe8a1f9b700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:18:54.820 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.814+0000 7fe8a279c700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe89c15e5e0 0x7fe89c1efce0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe89400efc0 tx=0x7fe89400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:54.820 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.814+0000 7fe8927fc700 1 -- 172.21.15.132:0/2975077040 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400ca90 con 0x7fe89c15e5e0 2023-05-10T04:18:54.820 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.814+0000 7fe8927fc700 1 -- 172.21.15.132:0/2975077040 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89400f040 con 0x7fe89c15e5e0 2023-05-10T04:18:54.820 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.814+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88c0094a0 con 0x7fe89c15e5e0 2023-05-10T04:18:54.820 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.814+0000 7fe8927fc700 1 -- 172.21.15.132:0/2975077040 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89400ce10 con 0x7fe89c15e5e0 2023-05-10T04:18:54.821 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.814+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c15b110 con 0x7fe89c15e5e0 2023-05-10T04:18:54.821 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.815+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c15ae30 con 0x7fe89c15e5e0 2023-05-10T04:18:54.821 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.816+0000 7fe8927fc700 1 -- 172.21.15.132:0/2975077040 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fe894014480 con 0x7fe89c15e5e0 2023-05-10T04:18:54.822 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.817+0000 7fe8927fc700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe88006ac50 0x7fe88006d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:18:54.822 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.817+0000 7fe8927fc700 1 -- 172.21.15.132:0/2975077040 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fe894088ae0 con 0x7fe89c15e5e0 2023-05-10T04:18:54.822 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.817+0000 7fe8a1f9b700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe88006ac50 0x7fe88006d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:18:54.822 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.818+0000 7fe8a1f9b700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe88006ac50 0x7fe88006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe898007fd0 tx=0x7fe898007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:18:54.824 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:54.822+0000 7fe8927fc700 1 -- 172.21.15.132:0/2975077040 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe894054b50 con 0x7fe89c15e5e0 2023-05-10T04:18:55.022 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.020+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe89c15b3f0 con 0x7fe89c15e5e0 2023-05-10T04:18:55.023 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.020+0000 7fe8927fc700 1 -- 172.21.15.132:0/2975077040 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe894009d70 con 0x7fe89c15e5e0 2023-05-10T04:18:55.023 INFO:teuthology.misc.health.smithi132.stdout: 2023-05-10T04:18:55.024 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":12,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:18:52.313594+0000","last_up_change":"0.000000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:18:55.025 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.022+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe88006ac50 msgr2=0x7fe88006d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:55.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.022+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe88006ac50 0x7fe88006d100 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe898007fd0 tx=0x7fe898007dc0 comp rx=0 tx=0).stop 2023-05-10T04:18:55.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.022+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe89c15e5e0 msgr2=0x7fe89c1efce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:18:55.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.022+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe89c15e5e0 0x7fe89c1efce0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe89400efc0 tx=0x7fe89400c3a0 comp rx=0 tx=0).stop 2023-05-10T04:18:55.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.023+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 shutdown_connections 2023-05-10T04:18:55.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.023+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe88006ac50 0x7fe88006d100 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:55.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.023+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe89c15e5e0 0x7fe89c1efce0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:55.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.023+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe89c0c98a0 0x7fe89c152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:55.027 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.023+0000 7fe8a41ff700 1 --2- 172.21.15.132:0/2975077040 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe89c0cf570 0x7fe89c14a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:18:55.027 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.023+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 >> 172.21.15.132:0/2975077040 conn(0x7fe89c06a3c0 msgr2=0x7fe89c06de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:18:55.027 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.023+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 shutdown_connections 2023-05-10T04:18:55.027 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:18:55.023+0000 7fe8a41ff700 1 -- 172.21.15.132:0/2975077040 wait complete. 2023-05-10T04:18:55.040 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-10T04:18:57.502 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T04:18:57.500+0000 7f1b3d1f7700 -1 osd.4 0 waiting for initial osdmap 2023-05-10T04:18:57.521 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T04:18:57.519+0000 7f1b349fa700 -1 osd.4 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-10T04:19:01.847 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:01.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:19:01.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:19:02.023 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.021+0000 7feca11ff700 1 Processor -- start 2023-05-10T04:19:02.023 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.021+0000 7feca11ff700 1 -- start start 2023-05-10T04:19:02.025 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.022+0000 7feca11ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fec9c15c830 0x7fec9c0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.025 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.022+0000 7feca11ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0b5da0 0x7fec9c0d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.025 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.022+0000 7feca11ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9c15cc00 con 0x7fec9c0b61d0 2023-05-10T04:19:02.025 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.022+0000 7feca11ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec9c0cd640 con 0x7fec9c15c830 2023-05-10T04:19:02.025 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.022+0000 7feca11ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0cd8e0 con 0x7fec9c0b5da0 2023-05-10T04:19:02.025 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9b59e700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fec9c0b61d0 0x7fec9c0cf960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55086/0 (socket says 172.21.15.132:55086) 2023-05-10T04:19:02.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9b59e700 1 -- 172.21.15.132:0/1618750978 learned_addr learned my addr 172.21.15.132:0/1618750978 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:02.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/1618750978 >> v2:172.21.15.154:3300/0 conn(0x7fec9c15c830 0x7fec9c0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec93fff700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0b5da0 0x7fec9c0d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 352183329 0 0) 0x7fec9c15cc00 con 0x7fec9c0b61d0 2023-05-10T04:19:02.026 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec880035b0 con 0x7fec9c0b61d0 2023-05-10T04:19:02.028 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804049390 0 0) 0x7fec880035b0 con 0x7fec9c0b61d0 2023-05-10T04:19:02.028 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0b5da0 msgr2=0x7fec9c0d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:02.029 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0b5da0 0x7fec9c0d1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.029 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 >> v2:172.21.15.154:3300/0 conn(0x7fec9c15c830 msgr2=0x7fec9c0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:02.029 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 --2- 172.21.15.132:0/1618750978 >> v2:172.21.15.154:3300/0 conn(0x7fec9c15c830 0x7fec9c0cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.029 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0d15f0 con 0x7fec9c0b61d0 2023-05-10T04:19:02.029 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fec940019f0 con 0x7fec9c0b61d0 2023-05-10T04:19:02.029 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/1618750978 >> v2:172.21.15.154:3300/0 conn(0x7fec9c15c830 0x7fec9c0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:02.029 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.023+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 >> v1:172.21.15.132:6789/0 conn(0x7fec9c0b61d0 legacy=0x7fec9c0cf960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.030 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9a59c700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec88003a70 0x7fec88003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.030 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9a59c700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88004850 0x7fec88004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.030 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9a59c700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0b5da0 0x7fec88005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.030 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0cd640 con 0x7fec88003a70 2023-05-10T04:19:02.030 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0cd8e0 con 0x7fec88004850 2023-05-10T04:19:02.030 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8800ba10 con 0x7fec9c0b5da0 2023-05-10T04:19:02.030 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec88003a70 0x7fec88003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.031 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec93fff700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88004850 0x7fec88004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.031 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9b59e700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0b5da0 0x7fec88005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.031 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9ad9d700 1 -- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0b5da0 msgr2=0x7fec88005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:02.031 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0b5da0 0x7fec88005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.031 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9ad9d700 1 -- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88004850 msgr2=0x7fec88004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:02.031 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88004850 0x7fec88004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.031 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9ad9d700 1 -- 172.21.15.132:0/1618750978 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec880035b0 con 0x7fec88003a70 2023-05-10T04:19:02.031 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.024+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec88003a70 0x7fec88003e80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009d60 tx=0x7fec88005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13c34f26a81d687 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:02.032 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00e9a0 con 0x7fec88003a70 2023-05-10T04:19:02.032 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec8c00eb00 con 0x7fec88003a70 2023-05-10T04:19:02.032 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7fec9a59c700 1 -- 172.21.15.132:0/1618750978 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00eeb0 con 0x7fec88003a70 2023-05-10T04:19:02.032 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7feca11ff700 1 -- 172.21.15.132:0/1618750978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec88003a70 msgr2=0x7fec88003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.032 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7feca11ff700 1 --2- 172.21.15.132:0/1618750978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec88003a70 0x7fec88003e80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009d60 tx=0x7fec88005880 comp rx=0 tx=0).stop 2023-05-10T04:19:02.032 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7fec9b59e700 1 -- 172.21.15.132:0/1618750978 reap_dead start 2023-05-10T04:19:02.032 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7feca11ff700 1 -- 172.21.15.132:0/1618750978 shutdown_connections 2023-05-10T04:19:02.033 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7feca11ff700 1 -- 172.21.15.132:0/1618750978 >> 172.21.15.132:0/1618750978 conn(0x7fec9c071af0 msgr2=0x7fec9c071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:02.033 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7feca11ff700 1 -- 172.21.15.132:0/1618750978 shutdown_connections 2023-05-10T04:19:02.033 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.025+0000 7feca11ff700 1 -- 172.21.15.132:0/1618750978 wait complete. 2023-05-10T04:19:02.035 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.027+0000 7feca11ff700 1 Processor -- start 2023-05-10T04:19:02.035 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.027+0000 7feca11ff700 1 -- start start 2023-05-10T04:19:02.035 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7feca11ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88003a70 0x7fec9c1559f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.035 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7feca11ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0cc710 0x7fec9c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.035 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7feca11ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c15a770 0x7fec9c15abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.036 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7feca11ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c15b130 con 0x7fec9c15a770 2023-05-10T04:19:02.036 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7feca11ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c156550 con 0x7fec88003a70 2023-05-10T04:19:02.036 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7feca11ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9c0ccbf0 con 0x7fec9c0cc710 2023-05-10T04:19:02.036 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7fec9b59e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c15a770 0x7fec9c15abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.036 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7fec9b59e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c15a770 0x7fec9c15abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36412/0 (socket says 172.21.15.132:36412) 2023-05-10T04:19:02.036 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7fec9b59e700 1 -- 172.21.15.132:0/2138846237 learned_addr learned my addr 172.21.15.132:0/2138846237 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:02.036 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7fec93fff700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0cc710 0x7fec9c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.037 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.028+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88003a70 0x7fec9c1559f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.037 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec9b59e700 1 -- 172.21.15.132:0/2138846237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0cc710 msgr2=0x7fec9c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.037 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec9b59e700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0cc710 0x7fec9c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.037 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec9b59e700 1 -- 172.21.15.132:0/2138846237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88003a70 msgr2=0x7fec9c1559f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.037 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec9b59e700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88003a70 0x7fec9c1559f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.037 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec9b59e700 1 -- 172.21.15.132:0/2138846237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0b2740 con 0x7fec9c15a770 2023-05-10T04:19:02.037 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec9b59e700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c15a770 0x7fec9c15abf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0676c0 tx=0x7fec9400a640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:02.037 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec937fe700 1 -- 172.21.15.132:0/2138846237 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec940019e0 con 0x7fec9c15a770 2023-05-10T04:19:02.038 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec937fe700 1 -- 172.21.15.132:0/2138846237 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9400adb0 con 0x7fec9c15a770 2023-05-10T04:19:02.038 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9c0d18d0 con 0x7fec9c15a770 2023-05-10T04:19:02.038 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7fec937fe700 1 -- 172.21.15.132:0/2138846237 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec94013610 con 0x7fec9c15a770 2023-05-10T04:19:02.038 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.029+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec9c0cdbc0 con 0x7fec9c15a770 2023-05-10T04:19:02.038 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.030+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec9c0743d0 con 0x7fec9c15a770 2023-05-10T04:19:02.038 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.031+0000 7fec937fe700 1 -- 172.21.15.132:0/2138846237 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec94013770 con 0x7fec9c15a770 2023-05-10T04:19:02.038 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.033+0000 7fec937fe700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec7c06ace0 0x7fec7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.039 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.033+0000 7fec937fe700 1 -- 172.21.15.132:0/2138846237 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fec94089890 con 0x7fec9c15a770 2023-05-10T04:19:02.039 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.033+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec7c06ace0 0x7fec7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.039 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.033+0000 7fec9ad9d700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec7c06ace0 0x7fec7c06d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0090b0 tx=0x7fec8c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:02.039 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.038+0000 7fec937fe700 1 -- 172.21.15.132:0/2138846237 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fec94054d50 con 0x7fec9c15a770 2023-05-10T04:19:02.236 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.234+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec9c0b4ba0 con 0x7fec9c15a770 2023-05-10T04:19:02.237 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.235+0000 7fec937fe700 1 -- 172.21.15.132:0/2138846237 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12886 (secure 0 0 0) 0x7fec94058370 con 0x7fec9c15a770 2023-05-10T04:19:02.237 INFO:teuthology.misc.health.smithi132.stdout: 2023-05-10T04:19:02.237 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":17,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:18:59.216228+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:02.239 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.237+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec7c06ace0 msgr2=0x7fec7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.240 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.237+0000 7feca11ff700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec7c06ace0 0x7fec7c06d190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0090b0 tx=0x7fec8c008030 comp rx=0 tx=0).stop 2023-05-10T04:19:02.240 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.237+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c15a770 msgr2=0x7fec9c15abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.240 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.237+0000 7feca11ff700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c15a770 0x7fec9c15abf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec9c0676c0 tx=0x7fec9400a640 comp rx=0 tx=0).stop 2023-05-10T04:19:02.240 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.238+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 shutdown_connections 2023-05-10T04:19:02.240 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.238+0000 7feca11ff700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec7c06ace0 0x7fec7c06d190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.241 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.238+0000 7feca11ff700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec9c15a770 0x7fec9c15abf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.241 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.238+0000 7feca11ff700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec88003a70 0x7fec9c1559f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.241 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.238+0000 7feca11ff700 1 --2- 172.21.15.132:0/2138846237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec9c0cc710 0x7fec9c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.241 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.238+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 >> 172.21.15.132:0/2138846237 conn(0x7fec9c071af0 msgr2=0x7fec9c0b37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:02.241 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.238+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 shutdown_connections 2023-05-10T04:19:02.241 INFO:teuthology.misc.health.smithi132.stderr:2023-05-10T04:19:02.238+0000 7feca11ff700 1 -- 172.21.15.132:0/2138846237 wait complete. 2023-05-10T04:19:02.254 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-10T04:19:02.255 INFO:tasks.ceph:Creating RBD pool 2023-05-10T04:19:02.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-10T04:19:02.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.432+0000 7f973d3ff700 1 Processor -- start 2023-05-10T04:19:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.433+0000 7f973d3ff700 1 -- start start 2023-05-10T04:19:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f973d3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380cd760 0x7f97380cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f973d3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97380adf70 0x7f97380cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f973d3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97380cc9e0 con 0x7f973815cf10 2023-05-10T04:19:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f973d3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973815de20 con 0x7f97380adf70 2023-05-10T04:19:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f973d3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380ce070 con 0x7f97380cd760 2023-05-10T04:19:02.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f9736ffd700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380cd760 0x7f97380cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f97367fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97380adf70 0x7f97380cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f97367fc700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f97380adf70 0x7f97380cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:46082/0 (socket says 172.21.15.132:46082) 2023-05-10T04:19:02.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.434+0000 7f97367fc700 1 -- 172.21.15.132:0/493219980 learned_addr learned my addr 172.21.15.132:0/493219980 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:02.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f97367fc700 1 -- 172.21.15.132:0/493219980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380cd760 msgr2=0x7f97380cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:02.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f97367fc700 1 --2- 172.21.15.132:0/493219980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380cd760 0x7f97380cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f97367fc700 1 -- 172.21.15.132:0/493219980 >> v1:172.21.15.154:6789/0 conn(0x7f973815cf10 legacy=0x7f973806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f97367fc700 1 -- 172.21.15.132:0/493219980 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973815d860 con 0x7f97380adf70 2023-05-10T04:19:02.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f9735ffb700 1 -- 172.21.15.132:0/493219980 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882896291 0 0) 0x7f97380cc9e0 con 0x7f973815cf10 2023-05-10T04:19:02.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f97367fc700 1 --2- 172.21.15.132:0/493219980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380adf70 0x7f97380cce70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f972c006fd0 tx=0x7f972c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=511e730107a81b18 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:02.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f9735ffb700 1 -- 172.21.15.132:0/493219980 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c005e30 con 0x7f97380adf70 2023-05-10T04:19:02.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f9735ffb700 1 -- 172.21.15.132:0/493219980 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c004030 con 0x7f97380adf70 2023-05-10T04:19:02.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.435+0000 7f9735ffb700 1 -- 172.21.15.132:0/493219980 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0043e0 con 0x7f97380adf70 2023-05-10T04:19:02.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/493219980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380adf70 msgr2=0x7f97380cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/493219980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380adf70 0x7f97380cce70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f972c006fd0 tx=0x7f972c009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/493219980 shutdown_connections 2023-05-10T04:19:02.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/493219980 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380cd760 0x7f97380cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/493219980 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380adf70 0x7f97380cce70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/493219980 >> 172.21.15.132:0/493219980 conn(0x7f97380cf720 msgr2=0x7f97380cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:02.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/493219980 shutdown_connections 2023-05-10T04:19:02.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/493219980 wait complete. 2023-05-10T04:19:02.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.437+0000 7f973d3ff700 1 Processor -- start 2023-05-10T04:19:02.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.438+0000 7f973d3ff700 1 -- start start 2023-05-10T04:19:02.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.438+0000 7f973d3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380adf70 0x7f973814e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f973d3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380cd760 0x7f97380ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f973d3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f973815cf10 0x7f97380c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f973d3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380ac030 con 0x7f973815cf10 2023-05-10T04:19:02.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f973d3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97380ac310 con 0x7f97380cd760 2023-05-10T04:19:02.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f973d3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97380ac5f0 con 0x7f97380adf70 2023-05-10T04:19:02.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97377fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f973815cf10 0x7f97380c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97377fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f973815cf10 0x7f97380c8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36418/0 (socket says 172.21.15.132:36418) 2023-05-10T04:19:02.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97377fe700 1 -- 172.21.15.132:0/740612618 learned_addr learned my addr 172.21.15.132:0/740612618 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:02.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f9736ffd700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380adf70 0x7f973814e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97367fc700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380cd760 0x7f97380ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97377fe700 1 -- 172.21.15.132:0/740612618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380adf70 msgr2=0x7f973814e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97377fe700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380adf70 0x7f973814e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97377fe700 1 -- 172.21.15.132:0/740612618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380cd760 msgr2=0x7f97380ad0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:02.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97377fe700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380cd760 0x7f97380ad0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:02.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.439+0000 7f97377fe700 1 -- 172.21.15.132:0/740612618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c009500 con 0x7f973815cf10 2023-05-10T04:19:02.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.440+0000 7f97377fe700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f973815cf10 0x7f97380c8350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f973000c7a0 tx=0x7f973000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:02.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.440+0000 7f971f7fe700 1 -- 172.21.15.132:0/740612618 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730003e30 con 0x7f973815cf10 2023-05-10T04:19:02.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.440+0000 7f971f7fe700 1 -- 172.21.15.132:0/740612618 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9730005070 con 0x7f973815cf10 2023-05-10T04:19:02.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.440+0000 7f971f7fe700 1 -- 172.21.15.132:0/740612618 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730005420 con 0x7f973815cf10 2023-05-10T04:19:02.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.440+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97380cc670 con 0x7f973815cf10 2023-05-10T04:19:02.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.440+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973815db40 con 0x7f973815cf10 2023-05-10T04:19:02.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.441+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9738071600 con 0x7f973815cf10 2023-05-10T04:19:02.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.442+0000 7f971f7fe700 1 -- 172.21.15.132:0/740612618 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9730005580 con 0x7f973815cf10 2023-05-10T04:19:02.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.443+0000 7f971f7fe700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f972406ace0 0x7f972406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:02.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.443+0000 7f971f7fe700 1 -- 172.21.15.132:0/740612618 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9730088580 con 0x7f973815cf10 2023-05-10T04:19:02.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.443+0000 7f9736ffd700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f972406ace0 0x7f972406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:02.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.444+0000 7f9736ffd700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f972406ace0 0x7f972406d190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97381f5910 tx=0x7f9728009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:02.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.447+0000 7f971f7fe700 1 -- 172.21.15.132:0/740612618 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9730057570 con 0x7f973815cf10 2023-05-10T04:19:02.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:02.642+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f97380b4a10 con 0x7f973815cf10 2023-05-10T04:19:03.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.432+0000 7f971f7fe700 1 -- 172.21.15.132:0/740612618 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f97300170a0 con 0x7f973815cf10 2023-05-10T04:19:03.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f972406ace0 msgr2=0x7f972406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:03.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f972406ace0 0x7f972406d190 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97381f5910 tx=0x7f9728009210 comp rx=0 tx=0).stop 2023-05-10T04:19:03.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f973815cf10 msgr2=0x7f97380c8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:03.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f973815cf10 0x7f97380c8350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f973000c7a0 tx=0x7f973000cab0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 shutdown_connections 2023-05-10T04:19:03.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f972406ace0 0x7f972406d190 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f973815cf10 0x7f97380c8350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f97380adf70 0x7f973814e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 --2- 172.21.15.132:0/740612618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f97380cd760 0x7f97380ad0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 >> 172.21.15.132:0/740612618 conn(0x7f97380cf720 msgr2=0x7f97380cb220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:03.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.436+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 shutdown_connections 2023-05-10T04:19:03.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.437+0000 7f973d3ff700 1 -- 172.21.15.132:0/740612618 wait complete. 2023-05-10T04:19:03.440 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'rbd' created 2023-05-10T04:19:03.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-10T04:19:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.636+0000 7f6c26dff700 1 Processor -- start 2023-05-10T04:19:03.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.636+0000 7f6c26dff700 1 -- start start 2023-05-10T04:19:03.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.637+0000 7f6c26dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c200b87a0 0x7f6c200cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:03.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.637+0000 7f6c26dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c20160d40 0x7f6c200d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:03.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c26dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c200cdc60 con 0x7f6c201601e0 2023-05-10T04:19:03.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c26dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c200d02d0 con 0x7f6c200b87a0 2023-05-10T04:19:03.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c26dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c200d0cb0 con 0x7f6c20160d40 2023-05-10T04:19:03.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c24b9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c200b87a0 0x7f6c200cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:03.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c24b9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c200b87a0 0x7f6c200cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40120/0 (socket says 172.21.15.132:40120) 2023-05-10T04:19:03.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c24b9b700 1 -- 172.21.15.132:0/3960072750 learned_addr learned my addr 172.21.15.132:0/3960072750 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:03.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c2539c700 1 --2- 172.21.15.132:0/3960072750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c20160d40 0x7f6c200d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c24b9b700 1 -- 172.21.15.132:0/3960072750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c20160d40 msgr2=0x7f6c200d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c24b9b700 1 --2- 172.21.15.132:0/3960072750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c20160d40 0x7f6c200d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c24b9b700 1 -- 172.21.15.132:0/3960072750 >> v1:172.21.15.154:6789/0 conn(0x7f6c201601e0 legacy=0x7f6c20160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c24b9b700 1 -- 172.21.15.132:0/3960072750 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c200cd6a0 con 0x7f6c200b87a0 2023-05-10T04:19:03.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.638+0000 7f6c24b9b700 1 --2- 172.21.15.132:0/3960072750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200b87a0 0x7f6c200cfbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c140098f0 tx=0x7f6c14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59ae73ac31a017f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c1f7fe700 1 -- 172.21.15.132:0/3960072750 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14011830 con 0x7f6c200b87a0 2023-05-10T04:19:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c1f7fe700 1 -- 172.21.15.132:0/3960072750 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c14011990 con 0x7f6c200b87a0 2023-05-10T04:19:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c1f7fe700 1 -- 172.21.15.132:0/3960072750 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c14011d20 con 0x7f6c200b87a0 2023-05-10T04:19:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c26dff700 1 -- 172.21.15.132:0/3960072750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200b87a0 msgr2=0x7f6c200cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c26dff700 1 --2- 172.21.15.132:0/3960072750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200b87a0 0x7f6c200cfbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c140098f0 tx=0x7f6c14009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c26dff700 1 -- 172.21.15.132:0/3960072750 shutdown_connections 2023-05-10T04:19:03.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c26dff700 1 --2- 172.21.15.132:0/3960072750 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c20160d40 0x7f6c200d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c26dff700 1 --2- 172.21.15.132:0/3960072750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c200b87a0 0x7f6c200cfbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c26dff700 1 -- 172.21.15.132:0/3960072750 >> 172.21.15.132:0/3960072750 conn(0x7f6c20071b10 msgr2=0x7f6c20071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c26dff700 1 -- 172.21.15.132:0/3960072750 shutdown_connections 2023-05-10T04:19:03.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.639+0000 7f6c26dff700 1 -- 172.21.15.132:0/3960072750 wait complete. 2023-05-10T04:19:03.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.641+0000 7f6c26dff700 1 Processor -- start 2023-05-10T04:19:03.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.641+0000 7f6c26dff700 1 -- start start 2023-05-10T04:19:03.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c26dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c200b87a0 0x7f6c20151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:03.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c26dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c201601e0 0x7f6c200b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:03.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c26dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c20160d40 0x7f6c200b6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:03.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c26dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2015fbb0 con 0x7f6c20160d40 2023-05-10T04:19:03.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c26dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2015f030 con 0x7f6c201601e0 2023-05-10T04:19:03.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c26dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2015f310 con 0x7f6c200b87a0 2023-05-10T04:19:03.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c2539c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c20160d40 0x7f6c200b6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:03.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c2539c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c20160d40 0x7f6c200b6fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40132/0 (socket says 172.21.15.132:40132) 2023-05-10T04:19:03.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c2539c700 1 -- 172.21.15.132:0/4011204670 learned_addr learned my addr 172.21.15.132:0/4011204670 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:03.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c24b9b700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c200b87a0 0x7f6c20151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:03.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.642+0000 7f6c1ffff700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c201601e0 0x7f6c200b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:03.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c2539c700 1 -- 172.21.15.132:0/4011204670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c200b87a0 msgr2=0x7f6c20151330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:03.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c2539c700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c200b87a0 0x7f6c20151330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c2539c700 1 -- 172.21.15.132:0/4011204670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c201601e0 msgr2=0x7f6c200b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:03.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c2539c700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c201601e0 0x7f6c200b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:03.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c2539c700 1 -- 172.21.15.132:0/4011204670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c14009550 con 0x7f6c20160d40 2023-05-10T04:19:03.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c2539c700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c20160d40 0x7f6c200b6fd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800efc0 tx=0x7f6c1800c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:03.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c1d7fa700 1 -- 172.21.15.132:0/4011204670 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1800cad0 con 0x7f6c20160d40 2023-05-10T04:19:03.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c1d7fa700 1 -- 172.21.15.132:0/4011204670 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c1800f040 con 0x7f6c20160d40 2023-05-10T04:19:03.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c200d1640 con 0x7f6c20160d40 2023-05-10T04:19:03.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c1d7fa700 1 -- 172.21.15.132:0/4011204670 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1800ce70 con 0x7f6c20160d40 2023-05-10T04:19:03.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.643+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c200cd980 con 0x7f6c20160d40 2023-05-10T04:19:03.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.644+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c200d17d0 con 0x7f6c20160d40 2023-05-10T04:19:03.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.646+0000 7f6c1d7fa700 1 -- 172.21.15.132:0/4011204670 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c18014480 con 0x7f6c20160d40 2023-05-10T04:19:03.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.647+0000 7f6c1d7fa700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6c0406ace0 0x7f6c0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:03.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.647+0000 7f6c1d7fa700 1 -- 172.21.15.132:0/4011204670 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f6c1808a0f0 con 0x7f6c20160d40 2023-05-10T04:19:03.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.647+0000 7f6c24b9b700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6c0406ace0 0x7f6c0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:03.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.647+0000 7f6c24b9b700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6c0406ace0 0x7f6c0406d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009c40 tx=0x7f6c14008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:03.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.650+0000 7f6c1d7fa700 1 -- 172.21.15.132:0/4011204670 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6c18055570 con 0x7f6c20160d40 2023-05-10T04:19:03.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:03.845+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6c20074430 con 0x7f6c20160d40 2023-05-10T04:19:04.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.434+0000 7f6c1d7fa700 1 -- 172.21.15.132:0/4011204670 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f6c18058b90 con 0x7f6c20160d40 2023-05-10T04:19:04.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6c0406ace0 msgr2=0x7f6c0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6c0406ace0 0x7f6c0406d190 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6c14009c40 tx=0x7f6c14008030 comp rx=0 tx=0).stop 2023-05-10T04:19:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c20160d40 msgr2=0x7f6c200b6fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c20160d40 0x7f6c200b6fd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6c1800efc0 tx=0x7f6c1800c0c0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 shutdown_connections 2023-05-10T04:19:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6c0406ace0 0x7f6c0406d190 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c20160d40 0x7f6c200b6fd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6c200b87a0 0x7f6c20151330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 --2- 172.21.15.132:0/4011204670 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6c201601e0 0x7f6c200b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.438+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 >> 172.21.15.132:0/4011204670 conn(0x7f6c20071b10 msgr2=0x7f6c20071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.439+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 shutdown_connections 2023-05-10T04:19:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.439+0000 7f6c26dff700 1 -- 172.21.15.132:0/4011204670 wait complete. 2023-05-10T04:19:04.442 INFO:teuthology.orchestra.run.smithi132.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-10T04:19:04.460 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-10T04:19:04.461 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T04:19:04.462 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T04:19:04.465 INFO:tasks.ceph.mds.a:Started 2023-05-10T04:19:04.466 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T04:19:04.466 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T04:19:04.469 INFO:tasks.ceph.mds.c:Started 2023-05-10T04:19:04.470 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T04:19:04.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T04:19:04.474 INFO:tasks.ceph.mds.b:Started 2023-05-10T04:19:04.474 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T04:19:04.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T04:19:04.478 INFO:tasks.ceph.mds.d:Started 2023-05-10T04:19:04.479 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-10T04:19:04.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:04.605 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-05-10T04:19:04.608 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-05-10T04:19:04.617 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-05-10T04:19:04.618 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-05-10T04:19:04.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.677+0000 7f5d153ff700 1 Processor -- start 2023-05-10T04:19:04.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.677+0000 7f5d153ff700 1 -- start start 2023-05-10T04:19:04.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.678+0000 7f5d153ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d100b87a0 0x7f5d100cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:04.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.678+0000 7f5d153ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f5d10160d40 0x7f5d100d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:04.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.678+0000 7f5d153ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d100cdc60 con 0x7f5d101601e0 2023-05-10T04:19:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.678+0000 7f5d153ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d100d02d0 con 0x7f5d100b87a0 2023-05-10T04:19:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.678+0000 7f5d153ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d100d0cb0 con 0x7f5d10160d40 2023-05-10T04:19:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.678+0000 7f5d0effd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d100b87a0 0x7f5d100cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:04.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0effd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d100b87a0 0x7f5d100cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40172/0 (socket says 172.21.15.132:40172) 2023-05-10T04:19:04.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0effd700 1 -- 172.21.15.132:0/142006586 learned_addr learned my addr 172.21.15.132:0/142006586 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0f7fe700 1 --2- 172.21.15.132:0/142006586 >> v2:172.21.15.154:3300/0 conn(0x7f5d10160d40 0x7f5d100d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0effd700 1 -- 172.21.15.132:0/142006586 >> v2:172.21.15.154:3300/0 conn(0x7f5d10160d40 msgr2=0x7f5d100d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0effd700 1 --2- 172.21.15.132:0/142006586 >> v2:172.21.15.154:3300/0 conn(0x7f5d10160d40 0x7f5d100d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0effd700 1 -- 172.21.15.132:0/142006586 >> v1:172.21.15.154:6789/0 conn(0x7f5d101601e0 legacy=0x7f5d10160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:04.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0effd700 1 -- 172.21.15.132:0/142006586 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d100cd6a0 con 0x7f5d100b87a0 2023-05-10T04:19:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0effd700 1 --2- 172.21.15.132:0/142006586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d100b87a0 0x7f5d100cfbf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d100d0820 tx=0x7f5d00009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc543a458a2d36f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0dffb700 1 -- 172.21.15.132:0/142006586 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00004230 con 0x7f5d100b87a0 2023-05-10T04:19:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0dffb700 1 -- 172.21.15.132:0/142006586 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d00004390 con 0x7f5d100b87a0 2023-05-10T04:19:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.679+0000 7f5d0dffb700 1 -- 172.21.15.132:0/142006586 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d000036a0 con 0x7f5d100b87a0 2023-05-10T04:19:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.680+0000 7f5d153ff700 1 -- 172.21.15.132:0/142006586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d100b87a0 msgr2=0x7f5d100cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:04.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.680+0000 7f5d153ff700 1 --2- 172.21.15.132:0/142006586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d100b87a0 0x7f5d100cfbf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5d100d0820 tx=0x7f5d00009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.680+0000 7f5d153ff700 1 -- 172.21.15.132:0/142006586 shutdown_connections 2023-05-10T04:19:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.680+0000 7f5d153ff700 1 --2- 172.21.15.132:0/142006586 >> v2:172.21.15.154:3300/0 conn(0x7f5d10160d40 0x7f5d100d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.680+0000 7f5d153ff700 1 --2- 172.21.15.132:0/142006586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d100b87a0 0x7f5d100cfbf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.680+0000 7f5d153ff700 1 -- 172.21.15.132:0/142006586 >> 172.21.15.132:0/142006586 conn(0x7f5d10071b10 msgr2=0x7f5d10071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.680+0000 7f5d153ff700 1 -- 172.21.15.132:0/142006586 shutdown_connections 2023-05-10T04:19:04.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.680+0000 7f5d153ff700 1 -- 172.21.15.132:0/142006586 wait complete. 2023-05-10T04:19:04.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.682+0000 7f5d153ff700 1 Processor -- start 2023-05-10T04:19:04.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.683+0000 7f5d153ff700 1 -- start start 2023-05-10T04:19:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d153ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d100b87a0 0x7f5d10151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d153ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d101601e0 0x7f5d101524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d153ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d10160d40 0x7f5d1015b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d153ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d101530d0 con 0x7f5d10160d40 2023-05-10T04:19:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d153ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d10155c00 con 0x7f5d101601e0 2023-05-10T04:19:04.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d153ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d10152b10 con 0x7f5d100b87a0 2023-05-10T04:19:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d10160d40 0x7f5d1015b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d10160d40 0x7f5d1015b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40182/0 (socket says 172.21.15.132:40182) 2023-05-10T04:19:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0f7fe700 1 -- 172.21.15.132:0/3414224527 learned_addr learned my addr 172.21.15.132:0/3414224527 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0effd700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d100b87a0 0x7f5d10151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0e7fc700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d101601e0 0x7f5d101524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0f7fe700 1 -- 172.21.15.132:0/3414224527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d100b87a0 msgr2=0x7f5d10151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0f7fe700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d100b87a0 0x7f5d10151fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0f7fe700 1 -- 172.21.15.132:0/3414224527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d101601e0 msgr2=0x7f5d101524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0f7fe700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d101601e0 0x7f5d101524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.684+0000 7f5d0f7fe700 1 -- 172.21.15.132:0/3414224527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d00009550 con 0x7f5d10160d40 2023-05-10T04:19:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.685+0000 7f5d0f7fe700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d10160d40 0x7f5d1015b270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5d08007e60 tx=0x7f5d0800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.685+0000 7f5cf77fe700 1 -- 172.21.15.132:0/3414224527 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0800ed30 con 0x7f5d10160d40 2023-05-10T04:19:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.685+0000 7f5cf77fe700 1 -- 172.21.15.132:0/3414224527 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d08014420 con 0x7f5d10160d40 2023-05-10T04:19:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.685+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d100d1640 con 0x7f5d10160d40 2023-05-10T04:19:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.685+0000 7f5cf77fe700 1 -- 172.21.15.132:0/3414224527 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d080147d0 con 0x7f5d10160d40 2023-05-10T04:19:04.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.685+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d100cd980 con 0x7f5d10160d40 2023-05-10T04:19:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.686+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d100d17d0 con 0x7f5d10160d40 2023-05-10T04:19:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.687+0000 7f5cf77fe700 1 -- 172.21.15.132:0/3414224527 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d08014930 con 0x7f5d10160d40 2023-05-10T04:19:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.688+0000 7f5cf77fe700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5cfc06ace0 0x7f5cfc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.688+0000 7f5cf77fe700 1 -- 172.21.15.132:0/3414224527 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5d08089770 con 0x7f5d10160d40 2023-05-10T04:19:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.688+0000 7f5d0effd700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5cfc06ace0 0x7f5cfc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:04.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.688+0000 7f5d0effd700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5cfc06ace0 0x7f5cfc06d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009130 tx=0x7f5d00008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:04.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.692+0000 7f5cf77fe700 1 -- 172.21.15.132:0/3414224527 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5d08054c10 con 0x7f5d10160d40 2023-05-10T04:19:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.887+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5d10074430 con 0x7f5d10160d40 2023-05-10T04:19:04.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.888+0000 7f5cf77fe700 1 -- 172.21.15.132:0/3414224527 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14711 (secure 0 0 0) 0x7f5d08058230 con 0x7f5d10160d40 2023-05-10T04:19:04.890 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:04.890 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:04.430908+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.890+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5cfc06ace0 msgr2=0x7f5cfc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.890+0000 7f5d153ff700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5cfc06ace0 0x7f5cfc06d190 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5d00009130 tx=0x7f5d00008030 comp rx=0 tx=0).stop 2023-05-10T04:19:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.890+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d10160d40 msgr2=0x7f5d1015b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.890+0000 7f5d153ff700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d10160d40 0x7f5d1015b270 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f5d08007e60 tx=0x7f5d0800e3c0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.891+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 shutdown_connections 2023-05-10T04:19:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.891+0000 7f5d153ff700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5cfc06ace0 0x7f5cfc06d190 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.891+0000 7f5d153ff700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d10160d40 0x7f5d1015b270 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.891+0000 7f5d153ff700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d100b87a0 0x7f5d10151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.891+0000 7f5d153ff700 1 --2- 172.21.15.132:0/3414224527 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d101601e0 0x7f5d101524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:04.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.891+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 >> 172.21.15.132:0/3414224527 conn(0x7f5d10071b10 msgr2=0x7f5d100cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:04.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.891+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 shutdown_connections 2023-05-10T04:19:04.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:04.891+0000 7f5d153ff700 1 -- 172.21.15.132:0/3414224527 wait complete. 2023-05-10T04:19:04.910 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-10T04:19:04.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:19:05.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.094+0000 7f51495ff700 1 Processor -- start 2023-05-10T04:19:05.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.094+0000 7f51495ff700 1 -- start start 2023-05-10T04:19:05.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.095+0000 7f51495ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f51440cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.095+0000 7f51495ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51440cc9e0 con 0x7f514415cf10 2023-05-10T04:19:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.095+0000 7f51495ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f514415de20 con 0x7f51440adf70 2023-05-10T04:19:05.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.095+0000 7f51495ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51440cd580 con 0x7f51440cd760 2023-05-10T04:19:05.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.095+0000 7f51437fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f514415cf10 0x7f514406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45184/0 (socket says 172.21.15.132:45184) 2023-05-10T04:19:05.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.095+0000 7f51437fe700 1 -- 172.21.15.132:0/2045795081 learned_addr learned my addr 172.21.15.132:0/2045795081 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:05.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.095+0000 7f5142ffd700 1 --2- 172.21.15.132:0/2045795081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f51440cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5141ffb700 1 -- 172.21.15.132:0/2045795081 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1579434247 0 0) 0x7f51440cc9e0 con 0x7f514415cf10 2023-05-10T04:19:05.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5141ffb700 1 -- 172.21.15.132:0/2045795081 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f512c0035b0 con 0x7f514415cf10 2023-05-10T04:19:05.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5142ffd700 1 -- 172.21.15.132:0/2045795081 >> v1:172.21.15.154:6789/0 conn(0x7f51440adf70 legacy=0x7f51440cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5141ffb700 1 -- 172.21.15.132:0/2045795081 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354422857 0 0) 0x7f514415de20 con 0x7f51440adf70 2023-05-10T04:19:05.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5142ffd700 1 -- 172.21.15.132:0/2045795081 >> v1:172.21.15.132:6789/0 conn(0x7f514415cf10 legacy=0x7f514406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5142ffd700 1 -- 172.21.15.132:0/2045795081 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51440ce070 con 0x7f51440cd760 2023-05-10T04:19:05.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5142ffd700 1 --2- 172.21.15.132:0/2045795081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f51440cdb30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5134009870 tx=0x7f5134009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1280eab55160144 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5141ffb700 1 -- 172.21.15.132:0/2045795081 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134011830 con 0x7f51440cd760 2023-05-10T04:19:05.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5141ffb700 1 -- 172.21.15.132:0/2045795081 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5134011990 con 0x7f51440cd760 2023-05-10T04:19:05.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.096+0000 7f5141ffb700 1 -- 172.21.15.132:0/2045795081 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5134011d20 con 0x7f51440cd760 2023-05-10T04:19:05.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.097+0000 7f51495ff700 1 -- 172.21.15.132:0/2045795081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 msgr2=0x7f51440cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.097+0000 7f51495ff700 1 --2- 172.21.15.132:0/2045795081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f51440cdb30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f5134009870 tx=0x7f5134009b80 comp rx=0 tx=0).stop 2023-05-10T04:19:05.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.097+0000 7f51495ff700 1 -- 172.21.15.132:0/2045795081 shutdown_connections 2023-05-10T04:19:05.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.097+0000 7f51495ff700 1 --2- 172.21.15.132:0/2045795081 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f51440cdb30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.097+0000 7f51495ff700 1 -- 172.21.15.132:0/2045795081 >> 172.21.15.132:0/2045795081 conn(0x7f51440cf720 msgr2=0x7f51440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:05.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.097+0000 7f51495ff700 1 -- 172.21.15.132:0/2045795081 shutdown_connections 2023-05-10T04:19:05.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.097+0000 7f51495ff700 1 -- 172.21.15.132:0/2045795081 wait complete. 2023-05-10T04:19:05.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.099+0000 7f51495ff700 1 Processor -- start 2023-05-10T04:19:05.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.099+0000 7f51495ff700 1 -- start start 2023-05-10T04:19:05.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51495ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440adf70 0x7f51440c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51495ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f5144151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51495ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f514415cf10 0x7f514414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51495ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514414b650 con 0x7f514415cf10 2023-05-10T04:19:05.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51495ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51441521d0 con 0x7f51440adf70 2023-05-10T04:19:05.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51495ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5144150bf0 con 0x7f51440cd760 2023-05-10T04:19:05.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51437fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f514415cf10 0x7f514414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f5142ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440adf70 0x7f51440c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51427fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f5144151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51437fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f514415cf10 0x7f514414ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40196/0 (socket says 172.21.15.132:40196) 2023-05-10T04:19:05.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51427fc700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f5144151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:53206/0 (socket says 172.21.15.132:53206) 2023-05-10T04:19:05.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51437fe700 1 -- 172.21.15.132:0/3892976515 learned_addr learned my addr 172.21.15.132:0/3892976515 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:05.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f5142ffd700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440adf70 0x7f51440c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:57072/0 (socket says 172.21.15.132:57072) 2023-05-10T04:19:05.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51427fc700 1 -- 172.21.15.132:0/3892976515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440adf70 msgr2=0x7f51440c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51427fc700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440adf70 0x7f51440c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51427fc700 1 -- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f514415cf10 msgr2=0x7f514414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51427fc700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f514415cf10 0x7f514414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51427fc700 1 -- 172.21.15.132:0/3892976515 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340094a0 con 0x7f51440cd760 2023-05-10T04:19:05.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.100+0000 7f51437fe700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f514415cf10 0x7f514414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:05.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.101+0000 7f51427fc700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f5144151c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f513800c410 tx=0x7f513800c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.101+0000 7f512b7fe700 1 -- 172.21.15.132:0/3892976515 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380052d0 con 0x7f51440cd760 2023-05-10T04:19:05.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.101+0000 7f512b7fe700 1 -- 172.21.15.132:0/3892976515 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5138005450 con 0x7f51440cd760 2023-05-10T04:19:05.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.101+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514415db40 con 0x7f51440cd760 2023-05-10T04:19:05.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.101+0000 7f512b7fe700 1 -- 172.21.15.132:0/3892976515 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5138003910 con 0x7f51440cd760 2023-05-10T04:19:05.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.101+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514415d860 con 0x7f51440cd760 2023-05-10T04:19:05.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.102+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51440cc670 con 0x7f51440cd760 2023-05-10T04:19:05.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.103+0000 7f512b7fe700 1 -- 172.21.15.132:0/3892976515 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5138003c80 con 0x7f51440cd760 2023-05-10T04:19:05.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.104+0000 7f512b7fe700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f513006ace0 0x7f513006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.104+0000 7f512b7fe700 1 -- 172.21.15.132:0/3892976515 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f51380887c0 con 0x7f51440cd760 2023-05-10T04:19:05.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.104+0000 7f5142ffd700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f513006ace0 0x7f513006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.104+0000 7f5142ffd700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f513006ace0 0x7f513006d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51340097c0 tx=0x7f513401c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.109+0000 7f512b7fe700 1 -- 172.21.15.132:0/3892976515 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5138053aa0 con 0x7f51440cd760 2023-05-10T04:19:05.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.304+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5144071b50 con 0x7f51440cd760 2023-05-10T04:19:05.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.305+0000 7f512b7fe700 1 -- 172.21.15.132:0/3892976515 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51380570c0 con 0x7f51440cd760 2023-05-10T04:19:05.307 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:19:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f513006ace0 msgr2=0x7f513006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f513006ace0 0x7f513006d190 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f51340097c0 tx=0x7f513401c040 comp rx=0 tx=0).stop 2023-05-10T04:19:05.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 msgr2=0x7f5144151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f5144151c90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f513800c410 tx=0x7f513800c720 comp rx=0 tx=0).stop 2023-05-10T04:19:05.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 shutdown_connections 2023-05-10T04:19:05.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f513006ace0 0x7f513006d190 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f514415cf10 0x7f514414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51440adf70 0x7f51440c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 --2- 172.21.15.132:0/3892976515 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51440cd760 0x7f5144151c90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 >> 172.21.15.132:0/3892976515 conn(0x7f51440cf720 msgr2=0x7f51440cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:05.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 shutdown_connections 2023-05-10T04:19:05.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.307+0000 7f51495ff700 1 -- 172.21.15.132:0/3892976515 wait complete. 2023-05-10T04:19:05.326 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:19:05.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.512+0000 7f6f4c9ff700 1 Processor -- start 2023-05-10T04:19:05.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.512+0000 7f6f4c9ff700 1 -- start start 2023-05-10T04:19:05.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f4c9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480cfbf0 0x7f6f481608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f4c9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f480d1100 0x7f6f480d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f4c9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f480d0020 con 0x7f6f480b87a0 2023-05-10T04:19:05.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f4c9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f480d02d0 con 0x7f6f480d1100 2023-05-10T04:19:05.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f4c9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480d0cb0 con 0x7f6f480cfbf0 2023-05-10T04:19:05.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f4659c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6f480b87a0 0x7f6f481601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45186/0 (socket says 172.21.15.132:45186) 2023-05-10T04:19:05.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f4659c700 1 -- 172.21.15.132:0/3713061173 learned_addr learned my addr 172.21.15.132:0/3713061173 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:05.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f46d9d700 1 --2- 172.21.15.132:0/3713061173 >> v2:172.21.15.154:3300/0 conn(0x7f6f480d1100 0x7f6f480d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f3ffff700 1 --2- 172.21.15.132:0/3713061173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480cfbf0 0x7f6f481608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.513+0000 7f6f45d9b700 1 -- 172.21.15.132:0/3713061173 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946093511 0 0) 0x7f6f480d0020 con 0x7f6f480b87a0 2023-05-10T04:19:05.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f45d9b700 1 -- 172.21.15.132:0/3713061173 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f340035b0 con 0x7f6f480b87a0 2023-05-10T04:19:05.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f45d9b700 1 -- 172.21.15.132:0/3713061173 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 312908299 0 0) 0x7f6f340035b0 con 0x7f6f480b87a0 2023-05-10T04:19:05.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f46d9d700 1 -- 172.21.15.132:0/3713061173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480cfbf0 msgr2=0x7f6f481608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:05.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f46d9d700 1 --2- 172.21.15.132:0/3713061173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480cfbf0 0x7f6f481608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f46d9d700 1 -- 172.21.15.132:0/3713061173 >> v1:172.21.15.132:6789/0 conn(0x7f6f480b87a0 legacy=0x7f6f481601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f46d9d700 1 -- 172.21.15.132:0/3713061173 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480cdc60 con 0x7f6f480d1100 2023-05-10T04:19:05.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f46d9d700 1 --2- 172.21.15.132:0/3713061173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480d1100 0x7f6f480d1580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009d90 tx=0x7f6f4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a53c6b79aec20b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f45d9b700 1 -- 172.21.15.132:0/3713061173 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4000e070 con 0x7f6f480d1100 2023-05-10T04:19:05.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f45d9b700 1 -- 172.21.15.132:0/3713061173 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f40003a20 con 0x7f6f480d1100 2023-05-10T04:19:05.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.514+0000 7f6f45d9b700 1 -- 172.21.15.132:0/3713061173 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f38001670 con 0x7f6f480d1100 2023-05-10T04:19:05.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.515+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/3713061173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480d1100 msgr2=0x7f6f480d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.515+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/3713061173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480d1100 0x7f6f480d1580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009d90 tx=0x7f6f4000b330 comp rx=0 tx=0).stop 2023-05-10T04:19:05.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.515+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/3713061173 shutdown_connections 2023-05-10T04:19:05.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.515+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/3713061173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480d1100 0x7f6f480d1580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.515+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/3713061173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480cfbf0 0x7f6f481608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.515+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/3713061173 >> 172.21.15.132:0/3713061173 conn(0x7f6f48071b10 msgr2=0x7f6f48071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:05.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.515+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/3713061173 shutdown_connections 2023-05-10T04:19:05.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.515+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/3713061173 wait complete. 2023-05-10T04:19:05.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.517+0000 7f6f4c9ff700 1 Processor -- start 2023-05-10T04:19:05.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.517+0000 7f6f4c9ff700 1 -- start start 2023-05-10T04:19:05.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f4c9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480b87a0 0x7f6f480cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f4c9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480cfbf0 0x7f6f4814dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f4c9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480d1100 0x7f6f480d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f4c9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4814e1c0 con 0x7f6f480cfbf0 2023-05-10T04:19:05.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f4c9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4815d210 con 0x7f6f480b87a0 2023-05-10T04:19:05.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f4c9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4815d4f0 con 0x7f6f480d1100 2023-05-10T04:19:05.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f3ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480cfbf0 0x7f6f4814dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f3ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480cfbf0 0x7f6f4814dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40210/0 (socket says 172.21.15.132:40210) 2023-05-10T04:19:05.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f3ffff700 1 -- 172.21.15.132:0/1380562406 learned_addr learned my addr 172.21.15.132:0/1380562406 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:05.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f4659c700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480b87a0 0x7f6f480cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f46d9d700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480d1100 0x7f6f480d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f3ffff700 1 -- 172.21.15.132:0/1380562406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480d1100 msgr2=0x7f6f480d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f3ffff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480d1100 0x7f6f480d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f3ffff700 1 -- 172.21.15.132:0/1380562406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480b87a0 msgr2=0x7f6f480cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f3ffff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480b87a0 0x7f6f480cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.518+0000 7f6f3ffff700 1 -- 172.21.15.132:0/1380562406 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40009a70 con 0x7f6f480cfbf0 2023-05-10T04:19:05.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.519+0000 7f6f3ffff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480cfbf0 0x7f6f4814dc80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000e9b0 tx=0x7f6f3000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.519+0000 7f6f3effd700 1 -- 172.21.15.132:0/1380562406 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30009710 con 0x7f6f480cfbf0 2023-05-10T04:19:05.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.519+0000 7f6f3effd700 1 -- 172.21.15.132:0/1380562406 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f3000c850 con 0x7f6f480cfbf0 2023-05-10T04:19:05.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.519+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f480cd980 con 0x7f6f480cfbf0 2023-05-10T04:19:05.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.519+0000 7f6f3effd700 1 -- 172.21.15.132:0/1380562406 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000cbc0 con 0x7f6f480cfbf0 2023-05-10T04:19:05.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.519+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f480cd6a0 con 0x7f6f480cfbf0 2023-05-10T04:19:05.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.520+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f48160e30 con 0x7f6f480cfbf0 2023-05-10T04:19:05.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.521+0000 7f6f3effd700 1 -- 172.21.15.132:0/1380562406 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f3000cd20 con 0x7f6f480cfbf0 2023-05-10T04:19:05.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.522+0000 7f6f3effd700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f2806ace0 0x7f6f2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.522+0000 7f6f3effd700 1 -- 172.21.15.132:0/1380562406 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6f30089250 con 0x7f6f480cfbf0 2023-05-10T04:19:05.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.522+0000 7f6f4659c700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f2806ace0 0x7f6f2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.522+0000 7f6f4659c700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f2806ace0 0x7f6f2806d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001eb0 tx=0x7f6f38001c40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.526+0000 7f6f3effd700 1 -- 172.21.15.132:0/1380562406 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6f300580d0 con 0x7f6f480cfbf0 2023-05-10T04:19:05.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.725+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f4815eb00 con 0x7f6f480cfbf0 2023-05-10T04:19:05.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.726+0000 7f6f3effd700 1 -- 172.21.15.132:0/1380562406 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f30057c60 con 0x7f6f480cfbf0 2023-05-10T04:19:05.728 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:19:05.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f2806ace0 msgr2=0x7f6f2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f2806ace0 0x7f6f2806d190 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f38001eb0 tx=0x7f6f38001c40 comp rx=0 tx=0).stop 2023-05-10T04:19:05.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480cfbf0 msgr2=0x7f6f4814dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480cfbf0 0x7f6f4814dc80 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6f3000e9b0 tx=0x7f6f3000ed70 comp rx=0 tx=0).stop 2023-05-10T04:19:05.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 shutdown_connections 2023-05-10T04:19:05.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f2806ace0 0x7f6f2806d190 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f480d1100 0x7f6f480d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f480b87a0 0x7f6f480cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 --2- 172.21.15.132:0/1380562406 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480cfbf0 0x7f6f4814dc80 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 >> 172.21.15.132:0/1380562406 conn(0x7f6f48071b10 msgr2=0x7f6f480b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:05.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 shutdown_connections 2023-05-10T04:19:05.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.728+0000 7f6f4c9ff700 1 -- 172.21.15.132:0/1380562406 wait complete. 2023-05-10T04:19:05.749 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:19:05.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.929+0000 7fa57a5ff700 1 Processor -- start 2023-05-10T04:19:05.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.929+0000 7fa57a5ff700 1 -- start start 2023-05-10T04:19:05.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.930+0000 7fa57a5ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5740cd760 0x7fa5740cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.930+0000 7fa57a5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa57415cf10 0x7fa57406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.930+0000 7fa57a5ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5740cc9e0 con 0x7fa5740adf70 2023-05-10T04:19:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.930+0000 7fa57a5ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5740cd580 con 0x7fa5740cd760 2023-05-10T04:19:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.930+0000 7fa57a5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57415de20 con 0x7fa57415cf10 2023-05-10T04:19:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.930+0000 7fa573fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5740cd760 0x7fa5740cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa573fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa5740cd760 0x7fa5740cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40220/0 (socket says 172.21.15.132:40220) 2023-05-10T04:19:05.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa573fff700 1 -- 172.21.15.132:0/425738597 learned_addr learned my addr 172.21.15.132:0/425738597 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:05.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa578b9c700 1 --2- 172.21.15.132:0/425738597 >> v2:172.21.15.154:3300/0 conn(0x7fa57415cf10 0x7fa57406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa573fff700 1 -- 172.21.15.132:0/425738597 >> v2:172.21.15.154:3300/0 conn(0x7fa57415cf10 msgr2=0x7fa57406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:05.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa573fff700 1 --2- 172.21.15.132:0/425738597 >> v2:172.21.15.154:3300/0 conn(0x7fa57415cf10 0x7fa57406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa573fff700 1 -- 172.21.15.132:0/425738597 >> v1:172.21.15.132:6789/0 conn(0x7fa5740adf70 legacy=0x7fa5740cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa573fff700 1 -- 172.21.15.132:0/425738597 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5740ce070 con 0x7fa5740cd760 2023-05-10T04:19:05.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa578b9c700 1 --2- 172.21.15.132:0/425738597 >> v2:172.21.15.154:3300/0 conn(0x7fa57415cf10 0x7fa57406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:05.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa572ffd700 1 -- 172.21.15.132:0/425738597 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321051394 0 0) 0x7fa5740cc9e0 con 0x7fa5740adf70 2023-05-10T04:19:05.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa573fff700 1 --2- 172.21.15.132:0/425738597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740cd760 0x7fa5740cdb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa574072030 tx=0x7fa56400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b9294151a2ca65 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa572ffd700 1 -- 172.21.15.132:0/425738597 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa56400dd30 con 0x7fa5740cd760 2023-05-10T04:19:05.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa572ffd700 1 -- 172.21.15.132:0/425738597 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa56400de90 con 0x7fa5740cd760 2023-05-10T04:19:05.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.931+0000 7fa572ffd700 1 -- 172.21.15.132:0/425738597 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564010690 con 0x7fa5740cd760 2023-05-10T04:19:05.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.932+0000 7fa57a5ff700 1 -- 172.21.15.132:0/425738597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740cd760 msgr2=0x7fa5740cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.932+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/425738597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740cd760 0x7fa5740cdb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa574072030 tx=0x7fa56400be70 comp rx=0 tx=0).stop 2023-05-10T04:19:05.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.932+0000 7fa57a5ff700 1 -- 172.21.15.132:0/425738597 shutdown_connections 2023-05-10T04:19:05.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.932+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/425738597 >> v2:172.21.15.154:3300/0 conn(0x7fa57415cf10 0x7fa57406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.932+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/425738597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740cd760 0x7fa5740cdb30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.932+0000 7fa57a5ff700 1 -- 172.21.15.132:0/425738597 >> 172.21.15.132:0/425738597 conn(0x7fa5740cf720 msgr2=0x7fa5740cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:05.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.932+0000 7fa57a5ff700 1 -- 172.21.15.132:0/425738597 shutdown_connections 2023-05-10T04:19:05.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.932+0000 7fa57a5ff700 1 -- 172.21.15.132:0/425738597 wait complete. 2023-05-10T04:19:05.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.934+0000 7fa57a5ff700 1 Processor -- start 2023-05-10T04:19:05.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.934+0000 7fa57a5ff700 1 -- start start 2023-05-10T04:19:05.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa57a5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740adf70 0x7fa5741525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa57a5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5740cd760 0x7fa5740b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa57a5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57415cf10 0x7fa574157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa57a5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740b12e0 con 0x7fa5740adf70 2023-05-10T04:19:05.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa57a5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740b2670 con 0x7fa57415cf10 2023-05-10T04:19:05.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa57a5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5740b2950 con 0x7fa5740cd760 2023-05-10T04:19:05.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa573fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740adf70 0x7fa5741525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa573fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740adf70 0x7fa5741525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40222/0 (socket says 172.21.15.132:40222) 2023-05-10T04:19:05.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa573fff700 1 -- 172.21.15.132:0/527928281 learned_addr learned my addr 172.21.15.132:0/527928281 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:05.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa573fff700 1 -- 172.21.15.132:0/527928281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5740cd760 msgr2=0x7fa5740b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa573fff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5740cd760 0x7fa5740b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa578b9c700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57415cf10 0x7fa574157900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa573fff700 1 -- 172.21.15.132:0/527928281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57415cf10 msgr2=0x7fa574157900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:05.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa573fff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57415cf10 0x7fa574157900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:05.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa573fff700 1 -- 172.21.15.132:0/527928281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56400b7f0 con 0x7fa5740adf70 2023-05-10T04:19:05.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.935+0000 7fa578b9c700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57415cf10 0x7fa574157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:05.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.936+0000 7fa573fff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740adf70 0x7fa5741525b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa56400b7c0 tx=0x7fa564004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.936+0000 7fa570ff9700 1 -- 172.21.15.132:0/527928281 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564003d30 con 0x7fa5740adf70 2023-05-10T04:19:05.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.936+0000 7fa570ff9700 1 -- 172.21.15.132:0/527928281 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa564003e90 con 0x7fa5740adf70 2023-05-10T04:19:05.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.936+0000 7fa570ff9700 1 -- 172.21.15.132:0/527928281 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa564010670 con 0x7fa5740adf70 2023-05-10T04:19:05.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.936+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57415db40 con 0x7fa5740adf70 2023-05-10T04:19:05.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.936+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57415d860 con 0x7fa5740adf70 2023-05-10T04:19:05.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.937+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5740cc670 con 0x7fa5740adf70 2023-05-10T04:19:05.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.938+0000 7fa570ff9700 1 -- 172.21.15.132:0/527928281 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa564019400 con 0x7fa5740adf70 2023-05-10T04:19:05.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.939+0000 7fa570ff9700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa56006ace0 0x7fa56006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:05.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.939+0000 7fa570ff9700 1 -- 172.21.15.132:0/527928281 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa56408ace0 con 0x7fa5740adf70 2023-05-10T04:19:05.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.939+0000 7fa5737fe700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa56006ace0 0x7fa56006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:05.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.939+0000 7fa5737fe700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa56006ace0 0x7fa56006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa5740c21d0 tx=0x7fa568007910 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:05.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:05.943+0000 7fa570ff9700 1 -- 172.21.15.132:0/527928281 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa564056170 con 0x7fa5740adf70 2023-05-10T04:19:06.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.182+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa574071b50 con 0x7fa5740adf70 2023-05-10T04:19:06.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.183+0000 7fa570ff9700 1 -- 172.21.15.132:0/527928281 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3527 (secure 0 0 0) 0x7fa564059790 con 0x7fa5740adf70 2023-05-10T04:19:06.185 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:06.185 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4315,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-05-10T04:19:06.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa56006ace0 msgr2=0x7fa56006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa56006ace0 0x7fa56006d190 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa5740c21d0 tx=0x7fa568007910 comp rx=0 tx=0).stop 2023-05-10T04:19:06.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740adf70 msgr2=0x7fa5741525b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740adf70 0x7fa5741525b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa56400b7c0 tx=0x7fa564004750 comp rx=0 tx=0).stop 2023-05-10T04:19:06.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 shutdown_connections 2023-05-10T04:19:06.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa56006ace0 0x7fa56006d190 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa57415cf10 0x7fa574157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5740adf70 0x7fa5741525b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 --2- 172.21.15.132:0/527928281 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5740cd760 0x7fa5740b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 >> 172.21.15.132:0/527928281 conn(0x7fa5740cf720 msgr2=0x7fa574070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:06.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 shutdown_connections 2023-05-10T04:19:06.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.185+0000 7fa57a5ff700 1 -- 172.21.15.132:0/527928281 wait complete. 2023-05-10T04:19:06.189 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 3 2023-05-10T04:19:06.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:06.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.384+0000 7f3b02bff700 1 Processor -- start 2023-05-10T04:19:06.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.384+0000 7f3b02bff700 1 -- start start 2023-05-10T04:19:06.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b02bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3afc0b87a0 0x7f3afc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b02bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc0cdc60 con 0x7f3afc1601e0 2023-05-10T04:19:06.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b02bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3afc0cd6a0 con 0x7f3afc160d40 2023-05-10T04:19:06.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b02bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3afc0d02d0 con 0x7f3afc0b87a0 2023-05-10T04:19:06.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b0099b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3afc0b87a0 0x7f3afc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b0099b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3afc0b87a0 0x7f3afc0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40228/0 (socket says 172.21.15.132:40228) 2023-05-10T04:19:06.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3afbfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3afc1601e0 0x7f3afc160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45210/0 (socket says 172.21.15.132:45210) 2023-05-10T04:19:06.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b0099b700 1 -- 172.21.15.132:0/4099781098 learned_addr learned my addr 172.21.15.132:0/4099781098 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:06.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b0099b700 1 -- 172.21.15.132:0/4099781098 >> v1:172.21.15.154:6789/0 conn(0x7f3afc160d40 legacy=0x7f3afc0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:06.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b0099b700 1 -- 172.21.15.132:0/4099781098 >> v1:172.21.15.132:6789/0 conn(0x7f3afc1601e0 legacy=0x7f3afc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.386+0000 7f3b0099b700 1 -- 172.21.15.132:0/4099781098 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc0cd980 con 0x7f3afc0b87a0 2023-05-10T04:19:06.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3b0099b700 1 --2- 172.21.15.132:0/4099781098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0b87a0 0x7f3afc0cfbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3af00098f0 tx=0x7f3af0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4bb11e55863821 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:06.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3afb7fe700 1 -- 172.21.15.132:0/4099781098 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0004230 con 0x7f3afc0b87a0 2023-05-10T04:19:06.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3afb7fe700 1 -- 172.21.15.132:0/4099781098 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0004390 con 0x7f3afc0b87a0 2023-05-10T04:19:06.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3afb7fe700 1 -- 172.21.15.132:0/4099781098 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af00036a0 con 0x7f3afc0b87a0 2023-05-10T04:19:06.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3b02bff700 1 -- 172.21.15.132:0/4099781098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0b87a0 msgr2=0x7f3afc0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3b02bff700 1 --2- 172.21.15.132:0/4099781098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0b87a0 0x7f3afc0cfbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3af00098f0 tx=0x7f3af0009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:06.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3b02bff700 1 -- 172.21.15.132:0/4099781098 shutdown_connections 2023-05-10T04:19:06.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3b02bff700 1 --2- 172.21.15.132:0/4099781098 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc0b87a0 0x7f3afc0cfbf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3b02bff700 1 -- 172.21.15.132:0/4099781098 >> 172.21.15.132:0/4099781098 conn(0x7f3afc071b10 msgr2=0x7f3afc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:06.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3b02bff700 1 -- 172.21.15.132:0/4099781098 shutdown_connections 2023-05-10T04:19:06.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.387+0000 7f3b02bff700 1 -- 172.21.15.132:0/4099781098 wait complete. 2023-05-10T04:19:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.389+0000 7f3b02bff700 1 Processor -- start 2023-05-10T04:19:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.389+0000 7f3b02bff700 1 -- start start 2023-05-10T04:19:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b02bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0b87a0 0x7f3afc0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b02bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc1601e0 0x7f3afc15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b02bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc160d40 0x7f3afc15f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b02bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc15abb0 con 0x7f3afc160d40 2023-05-10T04:19:06.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b02bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1f2460 con 0x7f3afc0b87a0 2023-05-10T04:19:06.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b02bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3afc1f2740 con 0x7f3afc1601e0 2023-05-10T04:19:06.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b0119c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc160d40 0x7f3afc15f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b0119c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc160d40 0x7f3afc15f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40234/0 (socket says 172.21.15.132:40234) 2023-05-10T04:19:06.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b0119c700 1 -- 172.21.15.132:0/3137421654 learned_addr learned my addr 172.21.15.132:0/3137421654 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:06.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3b0099b700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0b87a0 0x7f3afc0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.390+0000 7f3afbfff700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc1601e0 0x7f3afc15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b0119c700 1 -- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc1601e0 msgr2=0x7f3afc15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b0119c700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc1601e0 0x7f3afc15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b0119c700 1 -- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0b87a0 msgr2=0x7f3afc0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b0119c700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0b87a0 0x7f3afc0b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b0119c700 1 -- 172.21.15.132:0/3137421654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af0009550 con 0x7f3afc160d40 2023-05-10T04:19:06.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b0099b700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0b87a0 0x7f3afc0b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:06.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3afbfff700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc1601e0 0x7f3afc15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:06.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b0119c700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc160d40 0x7f3afc15f090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b970 tx=0x7f3af400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:06.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3af97fa700 1 -- 172.21.15.132:0/3137421654 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af400c9b0 con 0x7f3afc160d40 2023-05-10T04:19:06.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3af97fa700 1 -- 172.21.15.132:0/3137421654 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af400cb10 con 0x7f3afc160d40 2023-05-10T04:19:06.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3afc0d19a0 con 0x7f3afc160d40 2023-05-10T04:19:06.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3af97fa700 1 -- 172.21.15.132:0/3137421654 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4014440 con 0x7f3afc160d40 2023-05-10T04:19:06.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.391+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3afc0d1810 con 0x7f3afc160d40 2023-05-10T04:19:06.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.393+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3afc0d1b30 con 0x7f3afc160d40 2023-05-10T04:19:06.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.393+0000 7f3af97fa700 1 -- 172.21.15.132:0/3137421654 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3af401d3b0 con 0x7f3afc160d40 2023-05-10T04:19:06.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.394+0000 7f3af97fa700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ae006ace0 0x7f3ae006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.394+0000 7f3af97fa700 1 -- 172.21.15.132:0/3137421654 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3af4088d50 con 0x7f3afc160d40 2023-05-10T04:19:06.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.395+0000 7f3b0099b700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ae006ace0 0x7f3ae006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.395+0000 7f3b0099b700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ae006ace0 0x7f3ae006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009130 tx=0x7f3af0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:06.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.398+0000 7f3af97fa700 1 -- 172.21.15.132:0/3137421654 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3af408c030 con 0x7f3afc160d40 2023-05-10T04:19:06.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.596+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3afc0b52f0 con 0x7f3afc160d40 2023-05-10T04:19:06.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.597+0000 7f3af97fa700 1 -- 172.21.15.132:0/3137421654 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+14698 (secure 0 0 0) 0x7f3af40541e0 con 0x7f3afc160d40 2023-05-10T04:19:06.599 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:06.600 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:05.438245+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:06.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ae006ace0 msgr2=0x7f3ae006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ae006ace0 0x7f3ae006d190 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009130 tx=0x7f3af0008030 comp rx=0 tx=0).stop 2023-05-10T04:19:06.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc160d40 msgr2=0x7f3afc15f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc160d40 0x7f3afc15f090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b970 tx=0x7f3af400bd30 comp rx=0 tx=0).stop 2023-05-10T04:19:06.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 shutdown_connections 2023-05-10T04:19:06.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ae006ace0 0x7f3ae006d190 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3afc160d40 0x7f3afc15f090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3afc0b87a0 0x7f3afc0b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 --2- 172.21.15.132:0/3137421654 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3afc1601e0 0x7f3afc15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 >> 172.21.15.132:0/3137421654 conn(0x7f3afc071b10 msgr2=0x7f3afc0b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:06.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 shutdown_connections 2023-05-10T04:19:06.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.600+0000 7f3b02bff700 1 -- 172.21.15.132:0/3137421654 wait complete. 2023-05-10T04:19:06.619 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-10T04:19:06.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:19:06.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.803+0000 7f1ab8bff700 1 Processor -- start 2023-05-10T04:19:06.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.804+0000 7f1ab8bff700 1 -- start start 2023-05-10T04:19:06.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1ab8bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1ab40cfbf0 0x7f1ab41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1ab8bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40d0020 con 0x7f1ab40b87a0 2023-05-10T04:19:06.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1ab8bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ab40cdc60 con 0x7f1ab40d1100 2023-05-10T04:19:06.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1ab8bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ab40d02d0 con 0x7f1ab40cfbf0 2023-05-10T04:19:06.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1ab259c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1ab40b87a0 0x7f1ab41601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45226/0 (socket says 172.21.15.132:45226) 2023-05-10T04:19:06.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1ab259c700 1 -- 172.21.15.132:0/3439945610 learned_addr learned my addr 172.21.15.132:0/3439945610 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:06.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1aabfff700 1 --2- 172.21.15.132:0/3439945610 >> v2:172.21.15.154:3300/0 conn(0x7f1ab40cfbf0 0x7f1ab41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200270203 0 0) 0x7f1ab40d0020 con 0x7f1ab40b87a0 2023-05-10T04:19:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.805+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1aa00035b0 con 0x7f1ab40b87a0 2023-05-10T04:19:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2748218968 0 0) 0x7f1aa00035b0 con 0x7f1ab40b87a0 2023-05-10T04:19:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 >> v2:172.21.15.154:3300/0 conn(0x7f1ab40cfbf0 msgr2=0x7f1ab41608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 --2- 172.21.15.132:0/3439945610 >> v2:172.21.15.154:3300/0 conn(0x7f1ab40cfbf0 0x7f1ab41608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 >> v1:172.21.15.154:6789/0 conn(0x7f1ab40d1100 legacy=0x7f1ab40d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab40cd6a0 con 0x7f1ab40b87a0 2023-05-10T04:19:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f1aa4001670 con 0x7f1ab40b87a0 2023-05-10T04:19:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 >> v1:172.21.15.132:6789/0 conn(0x7f1ab40b87a0 legacy=0x7f1ab41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1aa0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1aa0004850 0x7f1aa0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1aa0005200 0x7f1aa000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40d02d0 con 0x7f1aa0003a50 2023-05-10T04:19:06.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000c0e0 con 0x7f1aa0004850 2023-05-10T04:19:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa000c2a0 con 0x7f1aa0005200 2023-05-10T04:19:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab259c700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1aa0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1aabfff700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1aa0004850 0x7f1aa0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab2d9d700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1aa0005200 0x7f1aa000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab259c700 1 -- 172.21.15.132:0/3439945610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1aa0005200 msgr2=0x7f1aa000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:06.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab259c700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1aa0005200 0x7f1aa000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab259c700 1 -- 172.21.15.132:0/3439945610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1aa0004850 msgr2=0x7f1aa0004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab259c700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1aa0004850 0x7f1aa0004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab259c700 1 -- 172.21.15.132:0/3439945610 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa00035b0 con 0x7f1aa0003a50 2023-05-10T04:19:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.806+0000 7f1ab2d9d700 1 -- 172.21.15.132:0/3439945610 reap_dead start 2023-05-10T04:19:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab259c700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1aa0003e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4001eb0 tx=0x7f1aa0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1826f0f4e8c7060 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4007b70 con 0x7f1aa0003a50 2023-05-10T04:19:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa400ccf0 con 0x7f1aa0003a50 2023-05-10T04:19:06.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab1d9b700 1 -- 172.21.15.132:0/3439945610 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4005ba0 con 0x7f1aa0003a50 2023-05-10T04:19:06.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3439945610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 msgr2=0x7f1aa0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab8bff700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1aa0003e60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4001eb0 tx=0x7f1aa0005880 comp rx=0 tx=0).stop 2023-05-10T04:19:06.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3439945610 shutdown_connections 2023-05-10T04:19:06.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab8bff700 1 --2- 172.21.15.132:0/3439945610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1aa0003e60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3439945610 >> 172.21.15.132:0/3439945610 conn(0x7f1ab4071b10 msgr2=0x7f1ab4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:06.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3439945610 shutdown_connections 2023-05-10T04:19:06.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.807+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3439945610 wait complete. 2023-05-10T04:19:06.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.809+0000 7f1ab8bff700 1 Processor -- start 2023-05-10T04:19:06.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.809+0000 7f1ab8bff700 1 -- start start 2023-05-10T04:19:06.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab8bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1ab40caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab8bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab41f5860 0x7f1ab40b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab8bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ab40d3090 0x7f1ab40d3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab8bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab40d3a40 con 0x7f1aa0003a50 2023-05-10T04:19:06.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab8bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab415d720 con 0x7f1ab41f5860 2023-05-10T04:19:06.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab8bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ab41f60b0 con 0x7f1ab40d3090 2023-05-10T04:19:06.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab259c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1ab40caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab259c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1ab40caff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40246/0 (socket says 172.21.15.132:40246) 2023-05-10T04:19:06.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.810+0000 7f1ab259c700 1 -- 172.21.15.132:0/3673537385 learned_addr learned my addr 172.21.15.132:0/3673537385 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1aabfff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab41f5860 0x7f1ab40b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab2d9d700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ab40d3090 0x7f1ab40d3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab259c700 1 -- 172.21.15.132:0/3673537385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ab40d3090 msgr2=0x7f1ab40d3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab259c700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ab40d3090 0x7f1ab40d3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab259c700 1 -- 172.21.15.132:0/3673537385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab41f5860 msgr2=0x7f1ab40b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:06.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab259c700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab41f5860 0x7f1ab40b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:06.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab259c700 1 -- 172.21.15.132:0/3673537385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab41601e0 con 0x7f1aa0003a50 2023-05-10T04:19:06.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab259c700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1ab40caff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c720 tx=0x7f1aa4001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1aaaffd700 1 -- 172.21.15.132:0/3673537385 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4004c80 con 0x7f1aa0003a50 2023-05-10T04:19:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1aaaffd700 1 -- 172.21.15.132:0/3673537385 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1aa4004de0 con 0x7f1aa0003a50 2023-05-10T04:19:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ab40cd980 con 0x7f1aa0003a50 2023-05-10T04:19:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1aaaffd700 1 -- 172.21.15.132:0/3673537385 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1aa4007310 con 0x7f1aa0003a50 2023-05-10T04:19:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.811+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ab4160370 con 0x7f1aa0003a50 2023-05-10T04:19:06.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.812+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ab415dd30 con 0x7f1aa0003a50 2023-05-10T04:19:06.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.813+0000 7f1aaaffd700 1 -- 172.21.15.132:0/3673537385 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1aa4007470 con 0x7f1aa0003a50 2023-05-10T04:19:06.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.814+0000 7f1aaaffd700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a9406ace0 0x7f1a9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:06.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.814+0000 7f1aaaffd700 1 -- 172.21.15.132:0/3673537385 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f1aa4089b60 con 0x7f1aa0003a50 2023-05-10T04:19:06.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.814+0000 7f1aabfff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a9406ace0 0x7f1a9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:06.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.814+0000 7f1aabfff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a9406ace0 0x7f1a9406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4072500 tx=0x7f1a9c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:06.818+0000 7f1aaaffd700 1 -- 172.21.15.132:0/3673537385 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1aa4054f50 con 0x7f1aa0003a50 2023-05-10T04:19:07.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.011+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1ab40b52f0 con 0x7f1aa0003a50 2023-05-10T04:19:07.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.011+0000 7f1aaaffd700 1 -- 172.21.15.132:0/3673537385 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1aa40170a0 con 0x7f1aa0003a50 2023-05-10T04:19:07.013 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:19:07.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.013+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a9406ace0 msgr2=0x7f1a9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.013+0000 7f1ab8bff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a9406ace0 0x7f1a9406d190 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1ab4072500 tx=0x7f1a9c008040 comp rx=0 tx=0).stop 2023-05-10T04:19:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.013+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 msgr2=0x7f1ab40caff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.013+0000 7f1ab8bff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1ab40caff0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1aa400c720 tx=0x7f1aa4001930 comp rx=0 tx=0).stop 2023-05-10T04:19:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.014+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 shutdown_connections 2023-05-10T04:19:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.014+0000 7f1ab8bff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a9406ace0 0x7f1a9406d190 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.014+0000 7f1ab8bff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1ab40d3090 0x7f1ab40d3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.014+0000 7f1ab8bff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa0003a50 0x7f1ab40caff0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.014+0000 7f1ab8bff700 1 --2- 172.21.15.132:0/3673537385 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1ab41f5860 0x7f1ab40b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.014+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 >> 172.21.15.132:0/3673537385 conn(0x7f1ab4071b10 msgr2=0x7f1ab415b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.014+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 shutdown_connections 2023-05-10T04:19:07.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.014+0000 7f1ab8bff700 1 -- 172.21.15.132:0/3673537385 wait complete. 2023-05-10T04:19:07.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:19:07.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.216+0000 7f856e7ff700 1 Processor -- start 2023-05-10T04:19:07.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.216+0000 7f856e7ff700 1 -- start start 2023-05-10T04:19:07.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.217+0000 7f856e7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f85680b87a0 0x7f85680cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.217+0000 7f856e7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85680cdc60 con 0x7f85681601e0 2023-05-10T04:19:07.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.217+0000 7f856e7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85680cd6a0 con 0x7f8568160d40 2023-05-10T04:19:07.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.217+0000 7f856e7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85680d02d0 con 0x7f85680b87a0 2023-05-10T04:19:07.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f85677fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f85681601e0 0x7f8568160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45230/0 (socket says 172.21.15.132:45230) 2023-05-10T04:19:07.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f85677fe700 1 -- 172.21.15.132:0/3735824316 learned_addr learned my addr 172.21.15.132:0/3735824316 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:07.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f8567fff700 1 --2- 172.21.15.132:0/3735824316 >> v2:172.21.15.154:3300/0 conn(0x7f85680b87a0 0x7f85680cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f8566ffd700 1 -- 172.21.15.132:0/3735824316 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397001296 0 0) 0x7f85680cdc60 con 0x7f85681601e0 2023-05-10T04:19:07.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f8566ffd700 1 -- 172.21.15.132:0/3735824316 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85500035b0 con 0x7f85681601e0 2023-05-10T04:19:07.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f8567fff700 1 -- 172.21.15.132:0/3735824316 >> v1:172.21.15.154:6789/0 conn(0x7f8568160d40 legacy=0x7f85680d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f8566ffd700 1 -- 172.21.15.132:0/3735824316 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2959467143 0 0) 0x7f85500035b0 con 0x7f85681601e0 2023-05-10T04:19:07.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f8567fff700 1 -- 172.21.15.132:0/3735824316 >> v1:172.21.15.132:6789/0 conn(0x7f85681601e0 legacy=0x7f8568160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.218+0000 7f8567fff700 1 -- 172.21.15.132:0/3735824316 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85680cd980 con 0x7f85680b87a0 2023-05-10T04:19:07.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f8567fff700 1 --2- 172.21.15.132:0/3735824316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85680b87a0 0x7f85680cfbf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8558009840 tx=0x7f8558009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0a68b87098dd089 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:07.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f8566ffd700 1 -- 172.21.15.132:0/3735824316 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c001670 con 0x7f85680b87a0 2023-05-10T04:19:07.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f8566ffd700 1 -- 172.21.15.132:0/3735824316 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8558004030 con 0x7f85680b87a0 2023-05-10T04:19:07.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f8566ffd700 1 -- 172.21.15.132:0/3735824316 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85580043c0 con 0x7f85680b87a0 2023-05-10T04:19:07.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f856e7ff700 1 -- 172.21.15.132:0/3735824316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85680b87a0 msgr2=0x7f85680cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f856e7ff700 1 --2- 172.21.15.132:0/3735824316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85680b87a0 0x7f85680cfbf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8558009840 tx=0x7f8558009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:07.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f856e7ff700 1 -- 172.21.15.132:0/3735824316 shutdown_connections 2023-05-10T04:19:07.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f856e7ff700 1 --2- 172.21.15.132:0/3735824316 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85680b87a0 0x7f85680cfbf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.219+0000 7f856e7ff700 1 -- 172.21.15.132:0/3735824316 >> 172.21.15.132:0/3735824316 conn(0x7f8568071b10 msgr2=0x7f8568071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:07.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.220+0000 7f856e7ff700 1 -- 172.21.15.132:0/3735824316 shutdown_connections 2023-05-10T04:19:07.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.220+0000 7f856e7ff700 1 -- 172.21.15.132:0/3735824316 wait complete. 2023-05-10T04:19:07.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.221+0000 7f856e7ff700 1 Processor -- start 2023-05-10T04:19:07.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.221+0000 7f856e7ff700 1 -- start start 2023-05-10T04:19:07.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f856e7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85680b87a0 0x7f856815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f856e7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85681601e0 0x7f85680c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f856e7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568160d40 0x7f85680b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f856e7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85680c9790 con 0x7f85681601e0 2023-05-10T04:19:07.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f856e7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85680c8b80 con 0x7f8568160d40 2023-05-10T04:19:07.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f856e7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85680c8e60 con 0x7f85680b87a0 2023-05-10T04:19:07.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f85677fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85681601e0 0x7f85680c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f85677fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85681601e0 0x7f85680c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40258/0 (socket says 172.21.15.132:40258) 2023-05-10T04:19:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.222+0000 7f85677fe700 1 -- 172.21.15.132:0/3577669900 learned_addr learned my addr 172.21.15.132:0/3577669900 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f8567fff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85680b87a0 0x7f856815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f856cd9c700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568160d40 0x7f85680b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f85677fe700 1 -- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85680b87a0 msgr2=0x7f856815a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f85677fe700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85680b87a0 0x7f856815a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f85677fe700 1 -- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568160d40 msgr2=0x7f85680b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f85677fe700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568160d40 0x7f85680b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f85677fe700 1 -- 172.21.15.132:0/3577669900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580094a0 con 0x7f85681601e0 2023-05-10T04:19:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f856cd9c700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568160d40 0x7f85680b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:07.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f8567fff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85680b87a0 0x7f856815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:07.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f85677fe700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85681601e0 0x7f85680c8130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f855c0011e0 tx=0x7f855c00cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:07.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f8564ff9700 1 -- 172.21.15.132:0/3577669900 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c007560 con 0x7f85681601e0 2023-05-10T04:19:07.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f8564ff9700 1 -- 172.21.15.132:0/3577669900 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f855c0076c0 con 0x7f85681601e0 2023-05-10T04:19:07.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f8564ff9700 1 -- 172.21.15.132:0/3577669900 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f855c004a90 con 0x7f85681601e0 2023-05-10T04:19:07.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.223+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85680d19a0 con 0x7f85681601e0 2023-05-10T04:19:07.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.224+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85680d1810 con 0x7f85681601e0 2023-05-10T04:19:07.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.225+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85680d1b30 con 0x7f85681601e0 2023-05-10T04:19:07.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.226+0000 7f8564ff9700 1 -- 172.21.15.132:0/3577669900 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f855c004bf0 con 0x7f85681601e0 2023-05-10T04:19:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.227+0000 7f8564ff9700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f855406ace0 0x7f855406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.227+0000 7f8564ff9700 1 -- 172.21.15.132:0/3577669900 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f855c088290 con 0x7f85681601e0 2023-05-10T04:19:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.227+0000 7f8567fff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f855406ace0 0x7f855406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.228+0000 7f8567fff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f855406ace0 0x7f855406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85580090b0 tx=0x7f8558008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:07.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.231+0000 7f8564ff9700 1 -- 172.21.15.132:0/3577669900 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f855c053680 con 0x7f85681601e0 2023-05-10T04:19:07.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.426+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f85680c98d0 con 0x7f85681601e0 2023-05-10T04:19:07.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.427+0000 7f8564ff9700 1 -- 172.21.15.132:0/3577669900 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f855c056ca0 con 0x7f85681601e0 2023-05-10T04:19:07.429 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:19:07.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.429+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f855406ace0 msgr2=0x7f855406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.429+0000 7f856e7ff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f855406ace0 0x7f855406d190 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f85580090b0 tx=0x7f8558008030 comp rx=0 tx=0).stop 2023-05-10T04:19:07.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85681601e0 msgr2=0x7f85680c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85681601e0 0x7f85680c8130 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f855c0011e0 tx=0x7f855c00cb00 comp rx=0 tx=0).stop 2023-05-10T04:19:07.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 shutdown_connections 2023-05-10T04:19:07.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f855406ace0 0x7f855406d190 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8568160d40 0x7f85680b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f85680b87a0 0x7f856815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 --2- 172.21.15.132:0/3577669900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85681601e0 0x7f85680c8130 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 >> 172.21.15.132:0/3577669900 conn(0x7f8568071b10 msgr2=0x7f85680b4310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:07.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 shutdown_connections 2023-05-10T04:19:07.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.430+0000 7f856e7ff700 1 -- 172.21.15.132:0/3577669900 wait complete. 2023-05-10T04:19:07.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T04:19:07.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.631+0000 7f78873ff700 1 Processor -- start 2023-05-10T04:19:07.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.632+0000 7f78873ff700 1 -- start start 2023-05-10T04:19:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f78873ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800d2110 0x7f7880167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f78873ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7880161000 con 0x7f78800b87a0 2023-05-10T04:19:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f78873ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78800d0020 con 0x7f78800cfbf0 2023-05-10T04:19:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f78873ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78800d02d0 con 0x7f78800d2110 2023-05-10T04:19:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f788519b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f78800b87a0 0x7f78801601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45234/0 (socket says 172.21.15.132:45234) 2023-05-10T04:19:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f788519b700 1 -- 172.21.15.132:0/1350059540 learned_addr learned my addr 172.21.15.132:0/1350059540 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f788599c700 1 --2- 172.21.15.132:0/1350059540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800d2110 0x7f7880167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f7877fff700 1 -- 172.21.15.132:0/1350059540 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849977238 0 0) 0x7f7880161000 con 0x7f78800b87a0 2023-05-10T04:19:07.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f7877fff700 1 -- 172.21.15.132:0/1350059540 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f786c0035b0 con 0x7f78800b87a0 2023-05-10T04:19:07.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.633+0000 7f7877fff700 1 -- 172.21.15.132:0/1350059540 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058077489 0 0) 0x7f78800d0020 con 0x7f78800cfbf0 2023-05-10T04:19:07.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.634+0000 7f7877fff700 1 -- 172.21.15.132:0/1350059540 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7880161000 con 0x7f78800cfbf0 2023-05-10T04:19:07.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.634+0000 7f788599c700 1 -- 172.21.15.132:0/1350059540 >> v1:172.21.15.154:6789/0 conn(0x7f78800cfbf0 legacy=0x7f78801608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.634+0000 7f788599c700 1 -- 172.21.15.132:0/1350059540 >> v1:172.21.15.132:6789/0 conn(0x7f78800b87a0 legacy=0x7f78801601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.634+0000 7f788599c700 1 -- 172.21.15.132:0/1350059540 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78800cdc60 con 0x7f78800d2110 2023-05-10T04:19:07.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.634+0000 7f788599c700 1 --2- 172.21.15.132:0/1350059540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800d2110 0x7f7880167550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7878009dc0 tx=0x7f787800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c4698346c4c93fc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:07.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.634+0000 7f7877fff700 1 -- 172.21.15.132:0/1350059540 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787800e070 con 0x7f78800d2110 2023-05-10T04:19:07.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.634+0000 7f7877fff700 1 -- 172.21.15.132:0/1350059540 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787800bb20 con 0x7f78800d2110 2023-05-10T04:19:07.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.634+0000 7f7877fff700 1 -- 172.21.15.132:0/1350059540 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7878012430 con 0x7f78800d2110 2023-05-10T04:19:07.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.635+0000 7f78873ff700 1 -- 172.21.15.132:0/1350059540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800d2110 msgr2=0x7f7880167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.635+0000 7f78873ff700 1 --2- 172.21.15.132:0/1350059540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800d2110 0x7f7880167550 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7878009dc0 tx=0x7f787800b330 comp rx=0 tx=0).stop 2023-05-10T04:19:07.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.635+0000 7f78873ff700 1 -- 172.21.15.132:0/1350059540 shutdown_connections 2023-05-10T04:19:07.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.635+0000 7f78873ff700 1 --2- 172.21.15.132:0/1350059540 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800d2110 0x7f7880167550 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.635+0000 7f78873ff700 1 -- 172.21.15.132:0/1350059540 >> 172.21.15.132:0/1350059540 conn(0x7f7880071b10 msgr2=0x7f7880071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:07.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.635+0000 7f78873ff700 1 -- 172.21.15.132:0/1350059540 shutdown_connections 2023-05-10T04:19:07.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.635+0000 7f78873ff700 1 -- 172.21.15.132:0/1350059540 wait complete. 2023-05-10T04:19:07.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.636+0000 7f78873ff700 1 Processor -- start 2023-05-10T04:19:07.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.637+0000 7f78873ff700 1 -- start start 2023-05-10T04:19:07.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.637+0000 7f78873ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800b87a0 0x7f788014d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.637+0000 7f78873ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800cfbf0 0x7f78800c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.637+0000 7f78873ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78800d2110 0x7f788014d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f78873ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880155610 con 0x7f78800d2110 2023-05-10T04:19:07.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f78873ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7880154e00 con 0x7f78800b87a0 2023-05-10T04:19:07.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f78873ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7880155960 con 0x7f78800cfbf0 2023-05-10T04:19:07.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78800d2110 0x7f788014d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78800d2110 0x7f788014d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40262/0 (socket says 172.21.15.132:40262) 2023-05-10T04:19:07.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 -- 172.21.15.132:0/269946950 learned_addr learned my addr 172.21.15.132:0/269946950 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:07.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788519b700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800b87a0 0x7f788014d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788499a700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800cfbf0 0x7f78800c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 -- 172.21.15.132:0/269946950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800cfbf0 msgr2=0x7f78800c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800cfbf0 0x7f78800c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 -- 172.21.15.132:0/269946950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800b87a0 msgr2=0x7f788014d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800b87a0 0x7f788014d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 -- 172.21.15.132:0/269946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7878009a70 con 0x7f78800d2110 2023-05-10T04:19:07.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.638+0000 7f788599c700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78800d2110 0x7f788014d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f787800b370 tx=0x7f7878004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:07.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.639+0000 7f7875ffb700 1 -- 172.21.15.132:0/269946950 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787801b810 con 0x7f78800d2110 2023-05-10T04:19:07.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.639+0000 7f7875ffb700 1 -- 172.21.15.132:0/269946950 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7878020070 con 0x7f78800d2110 2023-05-10T04:19:07.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.639+0000 7f7875ffb700 1 -- 172.21.15.132:0/269946950 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787801bbb0 con 0x7f78800d2110 2023-05-10T04:19:07.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.639+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78800cd980 con 0x7f78800d2110 2023-05-10T04:19:07.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.639+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78800cd6a0 con 0x7f78800d2110 2023-05-10T04:19:07.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.640+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7880167a90 con 0x7f78800d2110 2023-05-10T04:19:07.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.641+0000 7f7875ffb700 1 -- 172.21.15.132:0/269946950 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f787801bd10 con 0x7f78800d2110 2023-05-10T04:19:07.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.642+0000 7f7875ffb700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f786406ace0 0x7f786406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:07.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.642+0000 7f7875ffb700 1 -- 172.21.15.132:0/269946950 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7878022070 con 0x7f78800d2110 2023-05-10T04:19:07.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.642+0000 7f788519b700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f786406ace0 0x7f786406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:07.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.642+0000 7f788519b700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f786406ace0 0x7f786406d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f787c007fd0 tx=0x7f787c007e00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:07.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.646+0000 7f7875ffb700 1 -- 172.21.15.132:0/269946950 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f78780564a0 con 0x7f78800d2110 2023-05-10T04:19:07.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.843+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f78801557c0 con 0x7f78800d2110 2023-05-10T04:19:07.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.843+0000 7f7875ffb700 1 -- 172.21.15.132:0/269946950 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7f78801557c0 con 0x7f78800d2110 2023-05-10T04:19:07.845 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:07.846 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-05-10T04:19:07.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:19:07.846 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-05-10T04:19:07.846 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-05-10T04:19:07.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:07.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:19:07.846 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 2, 2023-05-10T04:19:07.847 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": "rbd" 2023-05-10T04:19:07.847 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:19:07.847 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-05-10T04:19:07.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.845+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f786406ace0 msgr2=0x7f786406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.845+0000 7f78873ff700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f786406ace0 0x7f786406d190 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f787c007fd0 tx=0x7f787c007e00 comp rx=0 tx=0).stop 2023-05-10T04:19:07.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.845+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78800d2110 msgr2=0x7f788014d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:07.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.845+0000 7f78873ff700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78800d2110 0x7f788014d0c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f787800b370 tx=0x7f7878004ad0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.846+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 shutdown_connections 2023-05-10T04:19:07.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.846+0000 7f78873ff700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f786406ace0 0x7f786406d190 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.846+0000 7f78873ff700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78800d2110 0x7f788014d0c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.846+0000 7f78873ff700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f78800b87a0 0x7f788014d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.846+0000 7f78873ff700 1 --2- 172.21.15.132:0/269946950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f78800cfbf0 0x7f78800c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:07.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.846+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 >> 172.21.15.132:0/269946950 conn(0x7f7880071b10 msgr2=0x7f78801582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:07.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.846+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 shutdown_connections 2023-05-10T04:19:07.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:07.846+0000 7f78873ff700 1 -- 172.21.15.132:0/269946950 wait complete. 2023-05-10T04:19:07.865 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T04:19:07.866 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-10T04:19:08.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.051+0000 7f166e5ff700 1 Processor -- start 2023-05-10T04:19:08.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.052+0000 7f166e5ff700 1 -- start start 2023-05-10T04:19:08.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f166e5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680cfbf0 0x7f16681608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f166e5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16680d1100 0x7f16680d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f166e5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16680d0020 con 0x7f16680b87a0 2023-05-10T04:19:08.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f166e5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16680d02d0 con 0x7f16680d1100 2023-05-10T04:19:08.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f166e5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16680d0cb0 con 0x7f16680cfbf0 2023-05-10T04:19:08.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f166cb9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16680d1100 0x7f16680d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f16677fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680cfbf0 0x7f16681608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f1667fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f16680b87a0 0x7f16681601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:42988/0 (socket says 172.21.15.132:42988) 2023-05-10T04:19:08.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f166cb9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f16680d1100 0x7f16680d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:57160/0 (socket says 172.21.15.132:57160) 2023-05-10T04:19:08.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.053+0000 7f1667fff700 1 -- 172.21.15.132:0/2824105107 learned_addr learned my addr 172.21.15.132:0/2824105107 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:08.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f16677fe700 1 -- 172.21.15.132:0/2824105107 >> v2:172.21.15.154:3300/0 conn(0x7f16680d1100 msgr2=0x7f16680d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:08.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f16677fe700 1 --2- 172.21.15.132:0/2824105107 >> v2:172.21.15.154:3300/0 conn(0x7f16680d1100 0x7f16680d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f16677fe700 1 -- 172.21.15.132:0/2824105107 >> v1:172.21.15.154:6789/0 conn(0x7f16680b87a0 legacy=0x7f16681601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f16677fe700 1 -- 172.21.15.132:0/2824105107 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16680cdc60 con 0x7f16680cfbf0 2023-05-10T04:19:08.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f1666ffd700 1 -- 172.21.15.132:0/2824105107 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4233158678 0 0) 0x7f16680d0020 con 0x7f16680b87a0 2023-05-10T04:19:08.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f16677fe700 1 --2- 172.21.15.132:0/2824105107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680cfbf0 0x7f16681608f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f165c009840 tx=0x7f165c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97c217f3b05f2fbe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:08.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f1666ffd700 1 -- 172.21.15.132:0/2824105107 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c011830 con 0x7f16680cfbf0 2023-05-10T04:19:08.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f1666ffd700 1 -- 172.21.15.132:0/2824105107 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c011990 con 0x7f16680cfbf0 2023-05-10T04:19:08.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.054+0000 7f1666ffd700 1 -- 172.21.15.132:0/2824105107 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c011d20 con 0x7f16680cfbf0 2023-05-10T04:19:08.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.055+0000 7f166e5ff700 1 -- 172.21.15.132:0/2824105107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680cfbf0 msgr2=0x7f16681608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.055+0000 7f166e5ff700 1 --2- 172.21.15.132:0/2824105107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680cfbf0 0x7f16681608f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f165c009840 tx=0x7f165c009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:08.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.055+0000 7f166e5ff700 1 -- 172.21.15.132:0/2824105107 shutdown_connections 2023-05-10T04:19:08.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.055+0000 7f166e5ff700 1 --2- 172.21.15.132:0/2824105107 >> v2:172.21.15.154:3300/0 conn(0x7f16680d1100 0x7f16680d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.055+0000 7f166e5ff700 1 --2- 172.21.15.132:0/2824105107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680cfbf0 0x7f16681608f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.055+0000 7f166e5ff700 1 -- 172.21.15.132:0/2824105107 >> 172.21.15.132:0/2824105107 conn(0x7f1668071b10 msgr2=0x7f1668071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:08.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.055+0000 7f166e5ff700 1 -- 172.21.15.132:0/2824105107 shutdown_connections 2023-05-10T04:19:08.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.055+0000 7f166e5ff700 1 -- 172.21.15.132:0/2824105107 wait complete. 2023-05-10T04:19:08.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.057+0000 7f166e5ff700 1 Processor -- start 2023-05-10T04:19:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.057+0000 7f166e5ff700 1 -- start start 2023-05-10T04:19:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f166e5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680b87a0 0x7f1668151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f166e5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16680cfbf0 0x7f16680cb230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f166e5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16680d1100 0x7f16680d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f166e5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16680cc320 con 0x7f16680cfbf0 2023-05-10T04:19:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f166e5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1668151a90 con 0x7f16680d1100 2023-05-10T04:19:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f166e5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16681557b0 con 0x7f16680b87a0 2023-05-10T04:19:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f16677fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16680cfbf0 0x7f16680cb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f16677fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16680cfbf0 0x7f16680cb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40268/0 (socket says 172.21.15.132:40268) 2023-05-10T04:19:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f16677fe700 1 -- 172.21.15.132:0/2485817448 learned_addr learned my addr 172.21.15.132:0/2485817448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f1667fff700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680b87a0 0x7f1668151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f166cb9c700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16680d1100 0x7f16680d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f16677fe700 1 -- 172.21.15.132:0/2485817448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680b87a0 msgr2=0x7f1668151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f16677fe700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680b87a0 0x7f1668151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f16677fe700 1 -- 172.21.15.132:0/2485817448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16680d1100 msgr2=0x7f16680d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f16677fe700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16680d1100 0x7f16680d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.058+0000 7f16677fe700 1 -- 172.21.15.132:0/2485817448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165c0094a0 con 0x7f16680cfbf0 2023-05-10T04:19:08.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.059+0000 7f16677fe700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16680cfbf0 0x7f16680cb230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f165c009fd0 tx=0x7f165c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:08.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.059+0000 7f1664ff9700 1 -- 172.21.15.132:0/2485817448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c0036a0 con 0x7f16680cfbf0 2023-05-10T04:19:08.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.059+0000 7f1664ff9700 1 -- 172.21.15.132:0/2485817448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165c01f070 con 0x7f16680cfbf0 2023-05-10T04:19:08.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.059+0000 7f1664ff9700 1 -- 172.21.15.132:0/2485817448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f165c003a60 con 0x7f16680cfbf0 2023-05-10T04:19:08.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.059+0000 7f166e5ff700 1 -- 172.21.15.132:0/2485817448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16680cd980 con 0x7f16680cfbf0 2023-05-10T04:19:08.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.059+0000 7f166e5ff700 1 -- 172.21.15.132:0/2485817448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16680cd6a0 con 0x7f16680cfbf0 2023-05-10T04:19:08.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.061+0000 7f164effd700 1 -- 172.21.15.132:0/2485817448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16400052f0 con 0x7f16680cfbf0 2023-05-10T04:19:08.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.061+0000 7f1664ff9700 1 -- 172.21.15.132:0/2485817448 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f165c003bc0 con 0x7f16680cfbf0 2023-05-10T04:19:08.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.062+0000 7f1664ff9700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f165406ace0 0x7f165406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.062+0000 7f1664ff9700 1 -- 172.21.15.132:0/2485817448 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f165c021070 con 0x7f16680cfbf0 2023-05-10T04:19:08.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.062+0000 7f1667fff700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f165406ace0 0x7f165406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.063+0000 7f1667fff700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f165406ace0 0x7f165406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1658000f60 tx=0x7f1658007e70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:08.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.067+0000 7f1664ff9700 1 -- 172.21.15.132:0/2485817448 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f165c055d20 con 0x7f16680cfbf0 2023-05-10T04:19:08.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.263+0000 7f164effd700 1 -- 172.21.15.132:0/2485817448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1640005b20 con 0x7f16680cfbf0 2023-05-10T04:19:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.460+0000 7f1664ff9700 1 -- 172.21.15.132:0/2485817448 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f165c059340 con 0x7f16680cfbf0 2023-05-10T04:19:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 -- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f165406ace0 msgr2=0x7f165406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f165406ace0 0x7f165406d190 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1658000f60 tx=0x7f1658007e70 comp rx=0 tx=0).stop 2023-05-10T04:19:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 -- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16680cfbf0 msgr2=0x7f16680cb230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16680cfbf0 0x7f16680cb230 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f165c009fd0 tx=0x7f165c004750 comp rx=0 tx=0).stop 2023-05-10T04:19:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 -- 172.21.15.132:0/2485817448 shutdown_connections 2023-05-10T04:19:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f165406ace0 0x7f165406d190 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f16680d1100 0x7f16680d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f16680b87a0 0x7f1668151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 --2- 172.21.15.132:0/2485817448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16680cfbf0 0x7f16680cb230 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f165c009fd0 tx=0x7f165c004750 comp rx=0 tx=0).stop 2023-05-10T04:19:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 -- 172.21.15.132:0/2485817448 >> 172.21.15.132:0/2485817448 conn(0x7f1668071b10 msgr2=0x7f166815c340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 -- 172.21.15.132:0/2485817448 shutdown_connections 2023-05-10T04:19:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.467+0000 7f164effd700 1 -- 172.21.15.132:0/2485817448 wait complete. 2023-05-10T04:19:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-05-10T04:19:08.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-05-10T04:19:08.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.675+0000 7f4c5f7ff700 1 Processor -- start 2023-05-10T04:19:08.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.675+0000 7f4c5f7ff700 1 -- start start 2023-05-10T04:19:08.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.676+0000 7f4c5f7ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c580cf010 0x7f4c58160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.676+0000 7f4c5f7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cff50 0x7f4c580d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.676+0000 7f4c5f7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c580cd520 con 0x7f4c5815c590 2023-05-10T04:19:08.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.676+0000 7f4c5f7ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c580d2640 con 0x7f4c580cf010 2023-05-10T04:19:08.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.676+0000 7f4c5f7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c581610d0 con 0x7f4c580cff50 2023-05-10T04:19:08.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5cd9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c580cf010 0x7f4c58160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5cd9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c580cf010 0x7f4c58160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40278/0 (socket says 172.21.15.132:40278) 2023-05-10T04:19:08.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5cd9a700 1 -- 172.21.15.132:0/1837704477 learned_addr learned my addr 172.21.15.132:0/1837704477 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:08.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5dd9c700 1 --2- 172.21.15.132:0/1837704477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cff50 0x7f4c580d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5cd9a700 1 -- 172.21.15.132:0/1837704477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cff50 msgr2=0x7f4c580d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:08.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5cd9a700 1 --2- 172.21.15.132:0/1837704477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cff50 0x7f4c580d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5cd9a700 1 -- 172.21.15.132:0/1837704477 >> v1:172.21.15.154:6789/0 conn(0x7f4c5815c590 legacy=0x7f4c580cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5cd9a700 1 -- 172.21.15.132:0/1837704477 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c580b23c0 con 0x7f4c580cf010 2023-05-10T04:19:08.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.677+0000 7f4c5cd9a700 1 --2- 172.21.15.132:0/1837704477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c580cf010 0x7f4c58160b90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c480098f0 tx=0x7f4c48009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ca07a1d8502efc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:08.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c4ffff700 1 -- 172.21.15.132:0/1837704477 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48011830 con 0x7f4c580cf010 2023-05-10T04:19:08.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c4ffff700 1 -- 172.21.15.132:0/1837704477 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48011990 con 0x7f4c580cf010 2023-05-10T04:19:08.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c4ffff700 1 -- 172.21.15.132:0/1837704477 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c48011d20 con 0x7f4c580cf010 2023-05-10T04:19:08.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/1837704477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c580cf010 msgr2=0x7f4c58160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/1837704477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c580cf010 0x7f4c58160b90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4c480098f0 tx=0x7f4c48009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:08.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/1837704477 shutdown_connections 2023-05-10T04:19:08.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/1837704477 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cff50 0x7f4c580d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/1837704477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c580cf010 0x7f4c58160b90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/1837704477 >> 172.21.15.132:0/1837704477 conn(0x7f4c58071b10 msgr2=0x7f4c58071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:08.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/1837704477 shutdown_connections 2023-05-10T04:19:08.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.678+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/1837704477 wait complete. 2023-05-10T04:19:08.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.680+0000 7f4c5f7ff700 1 Processor -- start 2023-05-10T04:19:08.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.680+0000 7f4c5f7ff700 1 -- start start 2023-05-10T04:19:08.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5f7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cf010 0x7f4c580b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5f7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c580cff50 0x7f4c581e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5f7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c5815c590 0x7f4c5815b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5f7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580b61d0 con 0x7f4c5815c590 2023-05-10T04:19:08.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5f7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5815d220 con 0x7f4c580cff50 2023-05-10T04:19:08.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5f7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c580b8660 con 0x7f4c580cf010 2023-05-10T04:19:08.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5dd9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c5815c590 0x7f4c5815b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5dd9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c5815c590 0x7f4c5815b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40284/0 (socket says 172.21.15.132:40284) 2023-05-10T04:19:08.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5dd9c700 1 -- 172.21.15.132:0/2429193754 learned_addr learned my addr 172.21.15.132:0/2429193754 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:08.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.681+0000 7f4c5d59b700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cf010 0x7f4c580b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5cd9a700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c580cff50 0x7f4c581e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5dd9c700 1 -- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cf010 msgr2=0x7f4c580b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5dd9c700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cf010 0x7f4c580b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5dd9c700 1 -- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c580cff50 msgr2=0x7f4c581e77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:08.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5dd9c700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c580cff50 0x7f4c581e77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:08.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5dd9c700 1 -- 172.21.15.132:0/2429193754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009550 con 0x7f4c5815c590 2023-05-10T04:19:08.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5cd9a700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c580cff50 0x7f4c581e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:08.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5d59b700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cf010 0x7f4c580b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:08.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5dd9c700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c5815c590 0x7f4c5815b050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000efc0 tx=0x7f4c5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:08.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c4dffb700 1 -- 172.21.15.132:0/2429193754 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000cd40 con 0x7f4c5815c590 2023-05-10T04:19:08.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c4dffb700 1 -- 172.21.15.132:0/2429193754 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c5000f040 con 0x7f4c5815c590 2023-05-10T04:19:08.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c580cd770 con 0x7f4c5815c590 2023-05-10T04:19:08.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c4dffb700 1 -- 172.21.15.132:0/2429193754 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c500146c0 con 0x7f4c5815c590 2023-05-10T04:19:08.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.682+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c580cf560 con 0x7f4c5815c590 2023-05-10T04:19:08.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.683+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5815c960 con 0x7f4c5815c590 2023-05-10T04:19:08.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.684+0000 7f4c4dffb700 1 -- 172.21.15.132:0/2429193754 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c50014820 con 0x7f4c5815c590 2023-05-10T04:19:08.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.685+0000 7f4c4dffb700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c3c06ace0 0x7f4c3c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:08.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.686+0000 7f4c4dffb700 1 -- 172.21.15.132:0/2429193754 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f4c50089b70 con 0x7f4c5815c590 2023-05-10T04:19:08.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.686+0000 7f4c5d59b700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c3c06ace0 0x7f4c3c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:08.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.686+0000 7f4c5d59b700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c3c06ace0 0x7f4c3c06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c54000f60 tx=0x7f4c54009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:08.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.690+0000 7f4c4dffb700 1 -- 172.21.15.132:0/2429193754 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4c50058920 con 0x7f4c5815c590 2023-05-10T04:19:08.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:08.885+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f4c580b6310 con 0x7f4c5815c590 2023-05-10T04:19:09.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.461+0000 7f4c4dffb700 1 -- 172.21.15.132:0/2429193754 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v22) v1 ==== 171+0+0 (secure 0 0 0) 0x7f4c5000cea0 con 0x7f4c5815c590 2023-05-10T04:19:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.470+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c3c06ace0 msgr2=0x7f4c3c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.470+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c3c06ace0 0x7f4c3c06d190 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4c54000f60 tx=0x7f4c54009040 comp rx=0 tx=0).stop 2023-05-10T04:19:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.471+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c5815c590 msgr2=0x7f4c5815b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.471+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c5815c590 0x7f4c5815b050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000efc0 tx=0x7f4c5000c3a0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.471+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 shutdown_connections 2023-05-10T04:19:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.471+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c3c06ace0 0x7f4c3c06d190 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.471+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c5815c590 0x7f4c5815b050 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.471+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c580cf010 0x7f4c580b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.471+0000 7f4c5f7ff700 1 --2- 172.21.15.132:0/2429193754 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c580cff50 0x7f4c581e77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.471+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 >> 172.21.15.132:0/2429193754 conn(0x7f4c58071b10 msgr2=0x7f4c580b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:09.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.473+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 shutdown_connections 2023-05-10T04:19:09.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.473+0000 7f4c5f7ff700 1 -- 172.21.15.132:0/2429193754 wait complete. 2023-05-10T04:19:09.487 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-05-10T04:19:09.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T04:19:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.689+0000 7f2ea6fff700 1 Processor -- start 2023-05-10T04:19:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.689+0000 7f2ea6fff700 1 -- start start 2023-05-10T04:19:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.690+0000 7f2ea6fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00b87a0 0x7f2ea00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.690+0000 7f2ea6fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ea01601e0 0x7f2ea0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.690+0000 7f2ea6fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2ea0160b70 0x7f2ea00d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.690+0000 7f2ea6fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea00d02d0 con 0x7f2ea01601e0 2023-05-10T04:19:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.690+0000 7f2ea6fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea00d0cb0 con 0x7f2ea0160b70 2023-05-10T04:19:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.690+0000 7f2ea6fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00b2730 con 0x7f2ea00b87a0 2023-05-10T04:19:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ea01601e0 0x7f2ea0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ea01601e0 0x7f2ea0160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40298/0 (socket says 172.21.15.132:40298) 2023-05-10T04:19:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 -- 172.21.15.132:0/1939645221 learned_addr learned my addr 172.21.15.132:0/1939645221 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2ea4d9b700 1 --2- 172.21.15.132:0/1939645221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00b87a0 0x7f2ea00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2ea559c700 1 --2- 172.21.15.132:0/1939645221 >> v2:172.21.15.154:3300/0 conn(0x7f2ea0160b70 0x7f2ea00d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 -- 172.21.15.132:0/1939645221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00b87a0 msgr2=0x7f2ea00cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 --2- 172.21.15.132:0/1939645221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00b87a0 0x7f2ea00cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 -- 172.21.15.132:0/1939645221 >> v2:172.21.15.154:3300/0 conn(0x7f2ea0160b70 msgr2=0x7f2ea00d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:09.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 --2- 172.21.15.132:0/1939645221 >> v2:172.21.15.154:3300/0 conn(0x7f2ea0160b70 0x7f2ea00d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 -- 172.21.15.132:0/1939645221 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0160ff0 con 0x7f2ea01601e0 2023-05-10T04:19:09.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9ffff700 1 --2- 172.21.15.132:0/1939645221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea0160630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ea008be30 tx=0x7f2e8c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64902f70d9f5f76a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:09.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9f7fe700 1 -- 172.21.15.132:0/1939645221 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00b870 con 0x7f2ea01601e0 2023-05-10T04:19:09.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9f7fe700 1 -- 172.21.15.132:0/1939645221 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c00b9d0 con 0x7f2ea01601e0 2023-05-10T04:19:09.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.691+0000 7f2e9f7fe700 1 -- 172.21.15.132:0/1939645221 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00bd60 con 0x7f2ea01601e0 2023-05-10T04:19:09.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 -- 172.21.15.132:0/1939645221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 msgr2=0x7f2ea0160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:09.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/1939645221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea0160630 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f2ea008be30 tx=0x7f2e8c009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 -- 172.21.15.132:0/1939645221 shutdown_connections 2023-05-10T04:19:09.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/1939645221 >> v2:172.21.15.154:3300/0 conn(0x7f2ea0160b70 0x7f2ea00d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/1939645221 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea00b87a0 0x7f2ea00cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/1939645221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea0160630 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 -- 172.21.15.132:0/1939645221 >> 172.21.15.132:0/1939645221 conn(0x7f2ea0071b10 msgr2=0x7f2ea0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:09.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 -- 172.21.15.132:0/1939645221 shutdown_connections 2023-05-10T04:19:09.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.692+0000 7f2ea6fff700 1 -- 172.21.15.132:0/1939645221 wait complete. 2023-05-10T04:19:09.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.694+0000 7f2ea6fff700 1 Processor -- start 2023-05-10T04:19:09.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.694+0000 7f2ea6fff700 1 -- start start 2023-05-10T04:19:09.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2ea6fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00b87a0 0x7f2ea0151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:09.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2ea6fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:09.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2ea6fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0160b70 0x7f2ea015e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:09.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2ea6fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0151970 con 0x7f2ea01601e0 2023-05-10T04:19:09.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2ea6fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00c9f80 con 0x7f2ea00b87a0 2023-05-10T04:19:09.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2ea6fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea015d4f0 con 0x7f2ea0160b70 2023-05-10T04:19:09.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2e9ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:09.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2e9ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea015ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40304/0 (socket says 172.21.15.132:40304) 2023-05-10T04:19:09.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2e9ffff700 1 -- 172.21.15.132:0/3487791544 learned_addr learned my addr 172.21.15.132:0/3487791544 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:09.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2ea4d9b700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00b87a0 0x7f2ea0151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:09.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.695+0000 7f2ea559c700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0160b70 0x7f2ea015e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:09.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9ffff700 1 -- 172.21.15.132:0/3487791544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0160b70 msgr2=0x7f2ea015e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:09.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9ffff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0160b70 0x7f2ea015e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9ffff700 1 -- 172.21.15.132:0/3487791544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00b87a0 msgr2=0x7f2ea0151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:09.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9ffff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00b87a0 0x7f2ea0151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9ffff700 1 -- 172.21.15.132:0/3487791544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8c009550 con 0x7f2ea01601e0 2023-05-10T04:19:09.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9ffff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea015ccc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c000c00 tx=0x7f2e8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:09.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9d7fa700 1 -- 172.21.15.132:0/3487791544 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c004480 con 0x7f2ea01601e0 2023-05-10T04:19:09.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9d7fa700 1 -- 172.21.15.132:0/3487791544 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8c0045e0 con 0x7f2ea01601e0 2023-05-10T04:19:09.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea00cd6a0 con 0x7f2ea01601e0 2023-05-10T04:19:09.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2e9d7fa700 1 -- 172.21.15.132:0/3487791544 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0038e0 con 0x7f2ea01601e0 2023-05-10T04:19:09.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.696+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea00cdc60 con 0x7f2ea01601e0 2023-05-10T04:19:09.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.697+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea00cd980 con 0x7f2ea01601e0 2023-05-10T04:19:09.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.698+0000 7f2e9d7fa700 1 -- 172.21.15.132:0/3487791544 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e8c021070 con 0x7f2ea01601e0 2023-05-10T04:19:09.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.699+0000 7f2e9d7fa700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e8406ace0 0x7f2e8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:09.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.699+0000 7f2e9d7fa700 1 -- 172.21.15.132:0/3487791544 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f2e8c08aa80 con 0x7f2ea01601e0 2023-05-10T04:19:09.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.700+0000 7f2ea4d9b700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e8406ace0 0x7f2e8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:09.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.700+0000 7f2ea4d9b700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e8406ace0 0x7f2e8406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e940045f0 tx=0x7f2e94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:09.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.704+0000 7f2e9d7fa700 1 -- 172.21.15.132:0/3487791544 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2e8c055d40 con 0x7f2ea01601e0 2023-05-10T04:19:09.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.942+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2ea0074430 con 0x7f2ea01601e0 2023-05-10T04:19:09.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.948+0000 7f2e9d7fa700 1 -- 172.21.15.132:0/3487791544 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2e8c0150c0 con 0x7f2ea01601e0 2023-05-10T04:19:09.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.952+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e8406ace0 msgr2=0x7f2e8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:09.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.952+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e8406ace0 0x7f2e8406d190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e940045f0 tx=0x7f2e94008040 comp rx=0 tx=0).stop 2023-05-10T04:19:09.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.952+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 msgr2=0x7f2ea015ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:09.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.952+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea015ccc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c000c00 tx=0x7f2e8c004750 comp rx=0 tx=0).stop 2023-05-10T04:19:09.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.953+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 shutdown_connections 2023-05-10T04:19:09.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.953+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e8406ace0 0x7f2e8406d190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.953+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2ea0160b70 0x7f2ea015e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.954+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2ea00b87a0 0x7f2ea0151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.954+0000 7f2ea6fff700 1 --2- 172.21.15.132:0/3487791544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ea01601e0 0x7f2ea015ccc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:09.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.954+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 >> 172.21.15.132:0/3487791544 conn(0x7f2ea0071b10 msgr2=0x7f2ea00cf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:09.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.954+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 shutdown_connections 2023-05-10T04:19:09.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:09.954+0000 7f2ea6fff700 1 -- 172.21.15.132:0/3487791544 wait complete. 2023-05-10T04:19:09.965 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 3 and data pool 4 2023-05-10T04:19:09.994 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-05-10T04:19:09.994 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-05-10T04:19:10.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.179+0000 7fa5a3bff700 1 Processor -- start 2023-05-10T04:19:10.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.179+0000 7fa5a3bff700 1 -- start start 2023-05-10T04:19:10.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.180+0000 7fa5a3bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa59c0b87a0 0x7fa59c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:10.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.180+0000 7fa5a3bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1601e0 0x7fa59c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:10.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.180+0000 7fa5a3bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa59c160ff0 con 0x7fa59c160b70 2023-05-10T04:19:10.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.180+0000 7fa5a3bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa59c0d02d0 con 0x7fa59c0b87a0 2023-05-10T04:19:10.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.180+0000 7fa5a3bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c0d0cb0 con 0x7fa59c1601e0 2023-05-10T04:19:10.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.180+0000 7fa5a199b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa59c0b87a0 0x7fa59c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:10.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a199b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa59c0b87a0 0x7fa59c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40314/0 (socket says 172.21.15.132:40314) 2023-05-10T04:19:10.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a199b700 1 -- 172.21.15.132:0/144983101 learned_addr learned my addr 172.21.15.132:0/144983101 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:10.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a119a700 1 --2- 172.21.15.132:0/144983101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1601e0 0x7fa59c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:10.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a199b700 1 -- 172.21.15.132:0/144983101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1601e0 msgr2=0x7fa59c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:10.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a199b700 1 --2- 172.21.15.132:0/144983101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1601e0 0x7fa59c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a199b700 1 -- 172.21.15.132:0/144983101 >> v1:172.21.15.154:6789/0 conn(0x7fa59c160b70 legacy=0x7fa59c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:10.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a199b700 1 -- 172.21.15.132:0/144983101 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c0cdc60 con 0x7fa59c0b87a0 2023-05-10T04:19:10.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a199b700 1 --2- 172.21.15.132:0/144983101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c0b87a0 0x7fa59c0cfbf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5980098f0 tx=0x7fa598009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b092836b839cc1e2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:10.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a0999700 1 -- 172.21.15.132:0/144983101 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598011830 con 0x7fa59c0b87a0 2023-05-10T04:19:10.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a0999700 1 -- 172.21.15.132:0/144983101 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa598011990 con 0x7fa59c0b87a0 2023-05-10T04:19:10.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.181+0000 7fa5a0999700 1 -- 172.21.15.132:0/144983101 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa598011d20 con 0x7fa59c0b87a0 2023-05-10T04:19:10.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.182+0000 7fa5a3bff700 1 -- 172.21.15.132:0/144983101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c0b87a0 msgr2=0x7fa59c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:10.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.182+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/144983101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c0b87a0 0x7fa59c0cfbf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5980098f0 tx=0x7fa598009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:10.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.182+0000 7fa5a3bff700 1 -- 172.21.15.132:0/144983101 shutdown_connections 2023-05-10T04:19:10.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.182+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/144983101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c0b87a0 0x7fa59c0cfbf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.182+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/144983101 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c1601e0 0x7fa59c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.182+0000 7fa5a3bff700 1 -- 172.21.15.132:0/144983101 >> 172.21.15.132:0/144983101 conn(0x7fa59c071b10 msgr2=0x7fa59c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:10.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.182+0000 7fa5a3bff700 1 -- 172.21.15.132:0/144983101 shutdown_connections 2023-05-10T04:19:10.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.182+0000 7fa5a3bff700 1 -- 172.21.15.132:0/144983101 wait complete. 2023-05-10T04:19:10.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.184+0000 7fa5a3bff700 1 Processor -- start 2023-05-10T04:19:10.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.184+0000 7fa5a3bff700 1 -- start start 2023-05-10T04:19:10.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a3bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c0b87a0 0x7fa59c1544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:10.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a3bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c1601e0 0x7fa59c1592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:10.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a3bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c160b70 0x7fa59c159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:10.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a3bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c15e880 con 0x7fa59c1601e0 2023-05-10T04:19:10.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a3bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c15dc00 con 0x7fa59c0b87a0 2023-05-10T04:19:10.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a3bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c15dee0 con 0x7fa59c160b70 2023-05-10T04:19:10.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c1601e0 0x7fa59c1592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:10.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c1601e0 0x7fa59c1592e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40324/0 (socket says 172.21.15.132:40324) 2023-05-10T04:19:10.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 -- 172.21.15.132:0/2599116890 learned_addr learned my addr 172.21.15.132:0/2599116890 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:10.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a199b700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c0b87a0 0x7fa59c1544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:10.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a219c700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c160b70 0x7fa59c159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:10.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 -- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c160b70 msgr2=0x7fa59c159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:10.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c160b70 0x7fa59c159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 -- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c0b87a0 msgr2=0x7fa59c1544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:10.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c0b87a0 0x7fa59c1544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 -- 172.21.15.132:0/2599116890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa598009550 con 0x7fa59c1601e0 2023-05-10T04:19:10.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a199b700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c0b87a0 0x7fa59c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:10.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a219c700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c160b70 0x7fa59c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:10.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.185+0000 7fa5a119a700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c1601e0 0x7fa59c1592e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00e9b0 tx=0x7fa58c00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:10.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.186+0000 7fa5927fc700 1 -- 172.21.15.132:0/2599116890 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c009710 con 0x7fa59c1601e0 2023-05-10T04:19:10.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.186+0000 7fa5927fc700 1 -- 172.21.15.132:0/2599116890 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c00c850 con 0x7fa59c1601e0 2023-05-10T04:19:10.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.186+0000 7fa5927fc700 1 -- 172.21.15.132:0/2599116890 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c00cbc0 con 0x7fa59c1601e0 2023-05-10T04:19:10.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.186+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa59c0cd980 con 0x7fa59c1601e0 2023-05-10T04:19:10.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.186+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa59c0cd6a0 con 0x7fa59c1601e0 2023-05-10T04:19:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.187+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59c0d2110 con 0x7fa59c1601e0 2023-05-10T04:19:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.188+0000 7fa5927fc700 1 -- 172.21.15.132:0/2599116890 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa58c00cd20 con 0x7fa59c1601e0 2023-05-10T04:19:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.189+0000 7fa5927fc700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa58006ace0 0x7fa58006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.189+0000 7fa5927fc700 1 -- 172.21.15.132:0/2599116890 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa58c089630 con 0x7fa59c1601e0 2023-05-10T04:19:10.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.189+0000 7fa5a199b700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa58006ace0 0x7fa58006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:10.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.189+0000 7fa5a199b700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa58006ace0 0x7fa58006d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5980098f0 tx=0x7fa598008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:10.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.193+0000 7fa5927fc700 1 -- 172.21.15.132:0/2599116890 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa58c0580d0 con 0x7fa59c1601e0 2023-05-10T04:19:10.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.400+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa59c15eba0 con 0x7fa59c1601e0 2023-05-10T04:19:10.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.955+0000 7fa5927fc700 1 -- 172.21.15.132:0/2599116890 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 157+0+0 (secure 0 0 0) 0x7fa58c057c60 con 0x7fa59c1601e0 2023-05-10T04:19:10.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.957+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa58006ace0 msgr2=0x7fa58006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:10.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.957+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa58006ace0 0x7fa58006d190 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa5980098f0 tx=0x7fa598008030 comp rx=0 tx=0).stop 2023-05-10T04:19:10.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c1601e0 msgr2=0x7fa59c1592e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:10.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c1601e0 0x7fa59c1592e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa58c00e9b0 tx=0x7fa58c00ed70 comp rx=0 tx=0).stop 2023-05-10T04:19:10.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 shutdown_connections 2023-05-10T04:19:10.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa58006ace0 0x7fa58006d190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa59c160b70 0x7fa59c159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa59c0b87a0 0x7fa59c1544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 --2- 172.21.15.132:0/2599116890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa59c1601e0 0x7fa59c1592e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:10.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 >> 172.21.15.132:0/2599116890 conn(0x7fa59c071b10 msgr2=0x7fa59c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:10.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 shutdown_connections 2023-05-10T04:19:10.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:10.958+0000 7fa5a3bff700 1 -- 172.21.15.132:0/2599116890 wait complete. 2023-05-10T04:19:10.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T04:19:11.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.166+0000 7f94f71ff700 1 Processor -- start 2023-05-10T04:19:11.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.166+0000 7f94f71ff700 1 -- start start 2023-05-10T04:19:11.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94f71ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94f00cfbf0 0x7f94f01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:11.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94f71ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f00d0020 con 0x7f94f00d1100 2023-05-10T04:19:11.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94f71ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f00cdc60 con 0x7f94f00b87a0 2023-05-10T04:19:11.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94f71ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f00d02d0 con 0x7f94f00cfbf0 2023-05-10T04:19:11.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94effff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94f00cfbf0 0x7f94f01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:11.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94effff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94f00cfbf0 0x7f94f01608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40330/0 (socket says 172.21.15.132:40330) 2023-05-10T04:19:11.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94f579c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f94f00d1100 0x7f94f00d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45242/0 (socket says 172.21.15.132:45242) 2023-05-10T04:19:11.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94effff700 1 -- 172.21.15.132:0/4186083913 learned_addr learned my addr 172.21.15.132:0/4186083913 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:11.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94effff700 1 -- 172.21.15.132:0/4186083913 >> v1:172.21.15.154:6789/0 conn(0x7f94f00b87a0 legacy=0x7f94f01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:11.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94effff700 1 -- 172.21.15.132:0/4186083913 >> v1:172.21.15.132:6789/0 conn(0x7f94f00d1100 legacy=0x7f94f00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:11.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94effff700 1 -- 172.21.15.132:0/4186083913 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f00cd6a0 con 0x7f94f00cfbf0 2023-05-10T04:19:11.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.168+0000 7f94ef7fe700 1 -- 172.21.15.132:0/4186083913 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001470978 0 0) 0x7f94f00d0020 con 0x7f94f00d1100 2023-05-10T04:19:11.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94effff700 1 --2- 172.21.15.132:0/4186083913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01608f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0098f0 tx=0x7f94dc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21958eed3d5f3d41 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:11.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94ef7fe700 1 -- 172.21.15.132:0/4186083913 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00b8a0 con 0x7f94f00cfbf0 2023-05-10T04:19:11.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94ef7fe700 1 -- 172.21.15.132:0/4186083913 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc00ba00 con 0x7f94f00cfbf0 2023-05-10T04:19:11.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94ef7fe700 1 -- 172.21.15.132:0/4186083913 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc00bd90 con 0x7f94f00cfbf0 2023-05-10T04:19:11.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94f71ff700 1 -- 172.21.15.132:0/4186083913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 msgr2=0x7f94f01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:11.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94f71ff700 1 --2- 172.21.15.132:0/4186083913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01608f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0098f0 tx=0x7f94dc009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:11.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94f71ff700 1 -- 172.21.15.132:0/4186083913 shutdown_connections 2023-05-10T04:19:11.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94f71ff700 1 --2- 172.21.15.132:0/4186083913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01608f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:11.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94f71ff700 1 -- 172.21.15.132:0/4186083913 >> 172.21.15.132:0/4186083913 conn(0x7f94f0071b10 msgr2=0x7f94f0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:11.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.169+0000 7f94f71ff700 1 -- 172.21.15.132:0/4186083913 shutdown_connections 2023-05-10T04:19:11.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.170+0000 7f94f71ff700 1 -- 172.21.15.132:0/4186083913 wait complete. 2023-05-10T04:19:11.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.171+0000 7f94f71ff700 1 Processor -- start 2023-05-10T04:19:11.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.171+0000 7f94f71ff700 1 -- start start 2023-05-10T04:19:11.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94f71ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94f00b87a0 0x7f94f015eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:11.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94f71ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01f63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:11.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94f71ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f00d1100 0x7f94f00cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:11.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94f71ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01f6900 con 0x7f94f00cfbf0 2023-05-10T04:19:11.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94f71ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01e63c0 con 0x7f94f00d1100 2023-05-10T04:19:11.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94f71ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f01e66a0 con 0x7f94f00b87a0 2023-05-10T04:19:11.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94effff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01f63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:11.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94effff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01f63c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40332/0 (socket says 172.21.15.132:40332) 2023-05-10T04:19:11.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94effff700 1 -- 172.21.15.132:0/3330735284 learned_addr learned my addr 172.21.15.132:0/3330735284 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:11.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94f4f9b700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94f00b87a0 0x7f94f015eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:11.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.172+0000 7f94f579c700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f00d1100 0x7f94f00cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:11.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94effff700 1 -- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94f00b87a0 msgr2=0x7f94f015eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:11.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94effff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94f00b87a0 0x7f94f015eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:11.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94effff700 1 -- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f00d1100 msgr2=0x7f94f00cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:11.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94effff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f00d1100 0x7f94f00cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:11.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94effff700 1 -- 172.21.15.132:0/3330735284 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94dc009550 con 0x7f94f00cfbf0 2023-05-10T04:19:11.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94f579c700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f00d1100 0x7f94f00cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:11.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94effff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01f63c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94f0072760 tx=0x7f94dc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:11.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94ed7fa700 1 -- 172.21.15.132:0/3330735284 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc011970 con 0x7f94f00cfbf0 2023-05-10T04:19:11.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94ed7fa700 1 -- 172.21.15.132:0/3330735284 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc01f070 con 0x7f94f00cfbf0 2023-05-10T04:19:11.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94ed7fa700 1 -- 172.21.15.132:0/3330735284 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc011cd0 con 0x7f94f00cfbf0 2023-05-10T04:19:11.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f0160e30 con 0x7f94f00cfbf0 2023-05-10T04:19:11.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.173+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f00cd980 con 0x7f94f00cfbf0 2023-05-10T04:19:11.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.174+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f0160fc0 con 0x7f94f00cfbf0 2023-05-10T04:19:11.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.175+0000 7f94ed7fa700 1 -- 172.21.15.132:0/3330735284 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94dc026480 con 0x7f94f00cfbf0 2023-05-10T04:19:11.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.176+0000 7f94ed7fa700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94d406ace0 0x7f94d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:11.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.176+0000 7f94ed7fa700 1 -- 172.21.15.132:0/3330735284 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f94dc021070 con 0x7f94f00cfbf0 2023-05-10T04:19:11.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.177+0000 7f94f4f9b700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94d406ace0 0x7f94d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:11.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.177+0000 7f94f4f9b700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94d406ace0 0x7f94d406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94e4007fd0 tx=0x7f94e4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:11.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.181+0000 7f94ed7fa700 1 -- 172.21.15.132:0/3330735284 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f94dc055ed0 con 0x7f94f00cfbf0 2023-05-10T04:19:11.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:11.376+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f94f00b52f0 con 0x7f94f00cfbf0 2023-05-10T04:19:12.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.962+0000 7f94ed7fa700 1 -- 172.21.15.132:0/3330735284 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v26) v1 ==== 228+0+0 (secure 0 0 0) 0x7f94dc0594f0 con 0x7f94f00cfbf0 2023-05-10T04:19:12.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.968+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94d406ace0 msgr2=0x7f94d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:12.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.968+0000 7f94f71ff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94d406ace0 0x7f94d406d190 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f94e4007fd0 tx=0x7f94e4009040 comp rx=0 tx=0).stop 2023-05-10T04:19:12.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.968+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 msgr2=0x7f94f01f63c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:12.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.968+0000 7f94f71ff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01f63c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94f0072760 tx=0x7f94dc004750 comp rx=0 tx=0).stop 2023-05-10T04:19:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.969+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 shutdown_connections 2023-05-10T04:19:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.969+0000 7f94f71ff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94d406ace0 0x7f94d406d190 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.969+0000 7f94f71ff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f94f00d1100 0x7f94f00cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.969+0000 7f94f71ff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f94f00b87a0 0x7f94f015eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:12.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.969+0000 7f94f71ff700 1 --2- 172.21.15.132:0/3330735284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94f00cfbf0 0x7f94f01f63c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:12.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.969+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 >> 172.21.15.132:0/3330735284 conn(0x7f94f0071b10 msgr2=0x7f94f00b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:12.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.973+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 shutdown_connections 2023-05-10T04:19:12.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:12.975+0000 7f94f71ff700 1 -- 172.21.15.132:0/3330735284 wait complete. 2023-05-10T04:19:12.980 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data_ec' created 2023-05-10T04:19:12.998 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-05-10T04:19:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.187+0000 7f41c75ff700 1 Processor -- start 2023-05-10T04:19:13.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.187+0000 7f41c75ff700 1 -- start start 2023-05-10T04:19:13.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.188+0000 7f41c75ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41c00b87a0 0x7f41c00cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:13.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.188+0000 7f41c75ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f41c01601e0 0x7f41c0160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:13.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.188+0000 7f41c75ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c00cdc60 con 0x7f41c0160b70 2023-05-10T04:19:13.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.188+0000 7f41c75ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c00d02d0 con 0x7f41c00b87a0 2023-05-10T04:19:13.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.188+0000 7f41c75ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c00d0cb0 con 0x7f41c01601e0 2023-05-10T04:19:13.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.188+0000 7f41c539b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41c00b87a0 0x7f41c00cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:13.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41c539b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f41c00b87a0 0x7f41c00cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37490/0 (socket says 172.21.15.132:37490) 2023-05-10T04:19:13.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41c539b700 1 -- 172.21.15.132:0/1736864662 learned_addr learned my addr 172.21.15.132:0/1736864662 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:13.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41c4b9a700 1 --2- 172.21.15.132:0/1736864662 >> v2:172.21.15.154:3300/0 conn(0x7f41c01601e0 0x7f41c0160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:13.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41c539b700 1 -- 172.21.15.132:0/1736864662 >> v2:172.21.15.154:3300/0 conn(0x7f41c01601e0 msgr2=0x7f41c0160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:13.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41c539b700 1 --2- 172.21.15.132:0/1736864662 >> v2:172.21.15.154:3300/0 conn(0x7f41c01601e0 0x7f41c0160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:13.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41c539b700 1 -- 172.21.15.132:0/1736864662 >> v1:172.21.15.154:6789/0 conn(0x7f41c0160b70 legacy=0x7f41c00d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:13.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41c539b700 1 -- 172.21.15.132:0/1736864662 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00cd6a0 con 0x7f41c00b87a0 2023-05-10T04:19:13.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41c539b700 1 --2- 172.21.15.132:0/1736864662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c00cfbf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41c00b8f60 tx=0x7f41bc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ce08a7a3fc5162f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:13.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41b7fff700 1 -- 172.21.15.132:0/1736864662 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc004230 con 0x7f41c00b87a0 2023-05-10T04:19:13.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41b7fff700 1 -- 172.21.15.132:0/1736864662 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc004390 con 0x7f41c00b87a0 2023-05-10T04:19:13.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.189+0000 7f41b7fff700 1 -- 172.21.15.132:0/1736864662 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0036a0 con 0x7f41c00b87a0 2023-05-10T04:19:13.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.190+0000 7f41c75ff700 1 -- 172.21.15.132:0/1736864662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 msgr2=0x7f41c00cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:13.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.190+0000 7f41c75ff700 1 --2- 172.21.15.132:0/1736864662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c00cfbf0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41c00b8f60 tx=0x7f41bc009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:13.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.190+0000 7f41c75ff700 1 -- 172.21.15.132:0/1736864662 shutdown_connections 2023-05-10T04:19:13.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.190+0000 7f41c75ff700 1 --2- 172.21.15.132:0/1736864662 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c00cfbf0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:13.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.190+0000 7f41c75ff700 1 --2- 172.21.15.132:0/1736864662 >> v2:172.21.15.154:3300/0 conn(0x7f41c01601e0 0x7f41c0160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:13.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.190+0000 7f41c75ff700 1 -- 172.21.15.132:0/1736864662 >> 172.21.15.132:0/1736864662 conn(0x7f41c0071b10 msgr2=0x7f41c0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:13.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.190+0000 7f41c75ff700 1 -- 172.21.15.132:0/1736864662 shutdown_connections 2023-05-10T04:19:13.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.190+0000 7f41c75ff700 1 -- 172.21.15.132:0/1736864662 wait complete. 2023-05-10T04:19:13.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.192+0000 7f41c75ff700 1 Processor -- start 2023-05-10T04:19:13.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.192+0000 7f41c75ff700 1 -- start start 2023-05-10T04:19:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c75ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c0150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c75ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c01601e0 0x7f41c00b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c75ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c0160b70 0x7f41c00b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c75ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015e2f0 con 0x7f41c00b87a0 2023-05-10T04:19:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c75ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015d6e0 con 0x7f41c0160b70 2023-05-10T04:19:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c75ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c015d9c0 con 0x7f41c01601e0 2023-05-10T04:19:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c539b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c0150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c539b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c0150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37492/0 (socket says 172.21.15.132:37492) 2023-05-10T04:19:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c539b700 1 -- 172.21.15.132:0/441517595 learned_addr learned my addr 172.21.15.132:0/441517595 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c4b9a700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c01601e0 0x7f41c00b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:13.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.193+0000 7f41c5b9c700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c0160b70 0x7f41c00b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:13.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41c539b700 1 -- 172.21.15.132:0/441517595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c01601e0 msgr2=0x7f41c00b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:13.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41c539b700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c01601e0 0x7f41c00b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:13.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41c539b700 1 -- 172.21.15.132:0/441517595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c0160b70 msgr2=0x7f41c00b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:13.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41c539b700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c0160b70 0x7f41c00b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:13.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41c539b700 1 -- 172.21.15.132:0/441517595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc009550 con 0x7f41c00b87a0 2023-05-10T04:19:13.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41c539b700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c0150ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009870 tx=0x7f41bc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:13.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41b5ffb700 1 -- 172.21.15.132:0/441517595 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc003c10 con 0x7f41c00b87a0 2023-05-10T04:19:13.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41b5ffb700 1 -- 172.21.15.132:0/441517595 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc01f070 con 0x7f41c00b87a0 2023-05-10T04:19:13.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c0160f90 con 0x7f41c00b87a0 2023-05-10T04:19:13.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41b5ffb700 1 -- 172.21.15.132:0/441517595 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc011630 con 0x7f41c00b87a0 2023-05-10T04:19:13.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.194+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c00cd980 con 0x7f41c00b87a0 2023-05-10T04:19:13.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.195+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c00d2110 con 0x7f41c00b87a0 2023-05-10T04:19:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.196+0000 7f41b5ffb700 1 -- 172.21.15.132:0/441517595 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f41bc021030 con 0x7f41c00b87a0 2023-05-10T04:19:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.197+0000 7f41b5ffb700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f41a406ace0 0x7f41a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.198+0000 7f41b5ffb700 1 -- 172.21.15.132:0/441517595 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f41bc08aca0 con 0x7f41c00b87a0 2023-05-10T04:19:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.198+0000 7f41c4b9a700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f41a406ace0 0x7f41a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.198+0000 7f41c4b9a700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f41a406ace0 0x7f41a406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41c00cafb0 tx=0x7f41b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:13.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.202+0000 7f41b5ffb700 1 -- 172.21.15.132:0/441517595 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f41bc055b10 con 0x7f41c00b87a0 2023-05-10T04:19:13.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.402+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f41c00d2110 con 0x7f41c00b87a0 2023-05-10T04:19:13.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.969+0000 7f41b5ffb700 1 -- 172.21.15.132:0/441517595 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f41bc059130 con 0x7f41c00b87a0 2023-05-10T04:19:13.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f41a406ace0 msgr2=0x7f41a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:13.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f41a406ace0 0x7f41a406d190 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41c00cafb0 tx=0x7f41b0008040 comp rx=0 tx=0).stop 2023-05-10T04:19:13.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 msgr2=0x7f41c0150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:13.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c0150ee0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009870 tx=0x7f41bc004750 comp rx=0 tx=0).stop 2023-05-10T04:19:13.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 shutdown_connections 2023-05-10T04:19:13.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f41a406ace0 0x7f41a406d190 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f41c00cafb0 tx=0x7f41b0008040 comp rx=0 tx=0).stop 2023-05-10T04:19:13.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f41c0160b70 0x7f41c00b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:13.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f41c00b87a0 0x7f41c0150ee0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:13.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 --2- 172.21.15.132:0/441517595 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f41c01601e0 0x7f41c00b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:13.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.976+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 >> 172.21.15.132:0/441517595 conn(0x7f41c0071b10 msgr2=0x7f41c015b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:13.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.979+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 shutdown_connections 2023-05-10T04:19:13.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:13.979+0000 7f41c75ff700 1 -- 172.21.15.132:0/441517595 wait complete. 2023-05-10T04:19:13.997 INFO:teuthology.orchestra.run.smithi132.stderr:set pool 5 allow_ec_overwrites to true 2023-05-10T04:19:14.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-05-10T04:19:14.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.206+0000 7f8a8b9ff700 1 Processor -- start 2023-05-10T04:19:14.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.207+0000 7f8a8b9ff700 1 -- start start 2023-05-10T04:19:14.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a8b9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8a8415d090 0x7f8a840cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a8b9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a840cd4c0 con 0x7f8a8415d460 2023-05-10T04:19:14.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a8b9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a840cd7a0 con 0x7f8a8415d8d0 2023-05-10T04:19:14.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a8b9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a840cda80 con 0x7f8a8415d090 2023-05-10T04:19:14.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a88f9a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8a8415d460 0x7f8a840d2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36980/0 (socket says 172.21.15.132:36980) 2023-05-10T04:19:14.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a88f9a700 1 -- 172.21.15.132:0/3271658918 learned_addr learned my addr 172.21.15.132:0/3271658918 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:14.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a8979b700 1 --2- 172.21.15.132:0/3271658918 >> v2:172.21.15.154:3300/0 conn(0x7f8a8415d090 0x7f8a840cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a7bfff700 1 -- 172.21.15.132:0/3271658918 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057946459 0 0) 0x7f8a840cd4c0 con 0x7f8a8415d460 2023-05-10T04:19:14.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.208+0000 7f8a7bfff700 1 -- 172.21.15.132:0/3271658918 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a700035b0 con 0x7f8a8415d460 2023-05-10T04:19:14.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a7bfff700 1 -- 172.21.15.132:0/3271658918 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408165659 0 0) 0x7f8a840cd7a0 con 0x7f8a8415d8d0 2023-05-10T04:19:14.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a7bfff700 1 -- 172.21.15.132:0/3271658918 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a840cd4c0 con 0x7f8a8415d8d0 2023-05-10T04:19:14.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a8979b700 1 -- 172.21.15.132:0/3271658918 >> v1:172.21.15.154:6789/0 conn(0x7f8a8415d8d0 legacy=0x7f8a840d0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a8979b700 1 -- 172.21.15.132:0/3271658918 >> v1:172.21.15.132:6789/0 conn(0x7f8a8415d460 legacy=0x7f8a840d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a7bfff700 1 -- 172.21.15.132:0/3271658918 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3377487492 0 0) 0x7f8a700035b0 con 0x7f8a8415d460 2023-05-10T04:19:14.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a8979b700 1 -- 172.21.15.132:0/3271658918 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a840cf440 con 0x7f8a8415d090 2023-05-10T04:19:14.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a8979b700 1 --2- 172.21.15.132:0/3271658918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 0x7f8a840cfc40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009840 tx=0x7f8a80009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8d9f23bf5f78425 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:14.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a7bfff700 1 -- 172.21.15.132:0/3271658918 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80011830 con 0x7f8a8415d090 2023-05-10T04:19:14.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a7bfff700 1 -- 172.21.15.132:0/3271658918 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a80011990 con 0x7f8a8415d090 2023-05-10T04:19:14.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.209+0000 7f8a7bfff700 1 -- 172.21.15.132:0/3271658918 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80011d20 con 0x7f8a8415d090 2023-05-10T04:19:14.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.210+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/3271658918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 msgr2=0x7f8a840cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.210+0000 7f8a8b9ff700 1 --2- 172.21.15.132:0/3271658918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 0x7f8a840cfc40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009840 tx=0x7f8a80009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.210+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/3271658918 shutdown_connections 2023-05-10T04:19:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.210+0000 7f8a8b9ff700 1 --2- 172.21.15.132:0/3271658918 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 0x7f8a840cfc40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.210+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/3271658918 >> 172.21.15.132:0/3271658918 conn(0x7f8a84071b10 msgr2=0x7f8a84071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.210+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/3271658918 shutdown_connections 2023-05-10T04:19:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.210+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/3271658918 wait complete. 2023-05-10T04:19:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.212+0000 7f8a8b9ff700 1 Processor -- start 2023-05-10T04:19:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.212+0000 7f8a8b9ff700 1 -- start start 2023-05-10T04:19:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a8b9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 0x7f8a8415f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a8b9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415d460 0x7f8a840ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a8b9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a840ca630 0x7f8a840cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a8b9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84160600 con 0x7f8a8415d460 2023-05-10T04:19:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a8b9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840c6740 con 0x7f8a8415d090 2023-05-10T04:19:14.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a8b9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840caab0 con 0x7f8a840ca630 2023-05-10T04:19:14.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a88f9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415d460 0x7f8a840ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a88f9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415d460 0x7f8a840ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37500/0 (socket says 172.21.15.132:37500) 2023-05-10T04:19:14.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a88f9a700 1 -- 172.21.15.132:0/2821818988 learned_addr learned my addr 172.21.15.132:0/2821818988 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:14.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a89f9c700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a840ca630 0x7f8a840cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a8979b700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 0x7f8a8415f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a88f9a700 1 -- 172.21.15.132:0/2821818988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a840ca630 msgr2=0x7f8a840cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a88f9a700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a840ca630 0x7f8a840cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a88f9a700 1 -- 172.21.15.132:0/2821818988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 msgr2=0x7f8a8415f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a88f9a700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 0x7f8a8415f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.213+0000 7f8a88f9a700 1 -- 172.21.15.132:0/2821818988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a800094a0 con 0x7f8a8415d460 2023-05-10T04:19:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.214+0000 7f8a88f9a700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415d460 0x7f8a840ca0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c780 tx=0x7f8a7400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.214+0000 7f8a79ffb700 1 -- 172.21.15.132:0/2821818988 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74005d70 con 0x7f8a8415d460 2023-05-10T04:19:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.214+0000 7f8a79ffb700 1 -- 172.21.15.132:0/2821818988 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a740070d0 con 0x7f8a8415d460 2023-05-10T04:19:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.214+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a840d0180 con 0x7f8a8415d460 2023-05-10T04:19:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.214+0000 7f8a79ffb700 1 -- 172.21.15.132:0/2821818988 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74007480 con 0x7f8a8415d460 2023-05-10T04:19:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.214+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a840cf720 con 0x7f8a8415d460 2023-05-10T04:19:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.215+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a840cf0c0 con 0x7f8a8415d460 2023-05-10T04:19:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.216+0000 7f8a79ffb700 1 -- 172.21.15.132:0/2821818988 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a740075e0 con 0x7f8a8415d460 2023-05-10T04:19:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.217+0000 7f8a79ffb700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a6806ace0 0x7f8a6806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.217+0000 7f8a79ffb700 1 -- 172.21.15.132:0/2821818988 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f8a74088c40 con 0x7f8a8415d460 2023-05-10T04:19:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.217+0000 7f8a8979b700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a6806ace0 0x7f8a6806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.217+0000 7f8a8979b700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a6806ace0 0x7f8a6806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009fd0 tx=0x7f8a8001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:14.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.221+0000 7f8a79ffb700 1 -- 172.21.15.132:0/2821818988 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8a74053980 con 0x7f8a8415d460 2023-05-10T04:19:14.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.461+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f8a84160740 con 0x7f8a8415d460 2023-05-10T04:19:14.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.466+0000 7f8a79ffb700 1 -- 172.21.15.132:0/2821818988 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f8a84160740 con 0x7f8a8415d460 2023-05-10T04:19:14.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a6806ace0 msgr2=0x7f8a6806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a6806ace0 0x7f8a6806d190 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8a80009fd0 tx=0x7f8a8001c040 comp rx=0 tx=0).stop 2023-05-10T04:19:14.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415d460 msgr2=0x7f8a840ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415d460 0x7f8a840ca0f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c780 tx=0x7f8a7400ca90 comp rx=0 tx=0).stop 2023-05-10T04:19:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 shutdown_connections 2023-05-10T04:19:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a6806ace0 0x7f8a6806d190 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a840ca630 0x7f8a840cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a8415d090 0x7f8a8415f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 --2- 172.21.15.132:0/2821818988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415d460 0x7f8a840ca0f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 >> 172.21.15.132:0/2821818988 conn(0x7f8a84071b10 msgr2=0x7f8a840b3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 shutdown_connections 2023-05-10T04:19:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.469+0000 7f8a8b9ff700 1 -- 172.21.15.132:0/2821818988 wait complete. 2023-05-10T04:19:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:added data pool 5 to fsmap 2023-05-10T04:19:14.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:19:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.670+0000 7fc87ffff700 1 Processor -- start 2023-05-10T04:19:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.670+0000 7fc87ffff700 1 -- start start 2023-05-10T04:19:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.671+0000 7fc87ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87815a140 0x7fc8780cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.671+0000 7fc87ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc878160ba0 0x7fc8780cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.671+0000 7fc87ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc8780cfe20 0x7fc8780b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.671+0000 7fc87ffff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8780d02a0 con 0x7fc878160ba0 2023-05-10T04:19:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.671+0000 7fc87ffff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87815d660 con 0x7fc8780cfe20 2023-05-10T04:19:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.671+0000 7fc87ffff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87815cd70 con 0x7fc87815a140 2023-05-10T04:19:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.671+0000 7fc87d59a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc878160ba0 0x7fc8780cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87d59a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc878160ba0 0x7fc8780cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37508/0 (socket says 172.21.15.132:37508) 2023-05-10T04:19:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87d59a700 1 -- 172.21.15.132:0/1191684724 learned_addr learned my addr 172.21.15.132:0/1191684724 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87dd9b700 1 --2- 172.21.15.132:0/1191684724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87815a140 0x7fc8780cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87e59c700 1 --2- 172.21.15.132:0/1191684724 >> v2:172.21.15.154:3300/0 conn(0x7fc8780cfe20 0x7fc8780b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87d59a700 1 -- 172.21.15.132:0/1191684724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87815a140 msgr2=0x7fc8780cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87d59a700 1 --2- 172.21.15.132:0/1191684724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87815a140 0x7fc8780cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87d59a700 1 -- 172.21.15.132:0/1191684724 >> v2:172.21.15.154:3300/0 conn(0x7fc8780cfe20 msgr2=0x7fc8780b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87d59a700 1 --2- 172.21.15.132:0/1191684724 >> v2:172.21.15.154:3300/0 conn(0x7fc8780cfe20 0x7fc8780b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87d59a700 1 -- 172.21.15.132:0/1191684724 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87815d010 con 0x7fc878160ba0 2023-05-10T04:19:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87e59c700 1 --2- 172.21.15.132:0/1191684724 >> v2:172.21.15.154:3300/0 conn(0x7fc8780cfe20 0x7fc8780b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87d59a700 1 --2- 172.21.15.132:0/1191684724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780cf8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc8780b4ee0 tx=0x7fc868009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56daac518164e3bf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87cd99700 1 -- 172.21.15.132:0/1191684724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868011830 con 0x7fc878160ba0 2023-05-10T04:19:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87cd99700 1 -- 172.21.15.132:0/1191684724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc868011990 con 0x7fc878160ba0 2023-05-10T04:19:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.672+0000 7fc87cd99700 1 -- 172.21.15.132:0/1191684724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc868011d20 con 0x7fc878160ba0 2023-05-10T04:19:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 -- 172.21.15.132:0/1191684724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 msgr2=0x7fc8780cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 --2- 172.21.15.132:0/1191684724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780cf8e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc8780b4ee0 tx=0x7fc868009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 -- 172.21.15.132:0/1191684724 shutdown_connections 2023-05-10T04:19:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 --2- 172.21.15.132:0/1191684724 >> v2:172.21.15.154:3300/0 conn(0x7fc8780cfe20 0x7fc8780b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 --2- 172.21.15.132:0/1191684724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc87815a140 0x7fc8780cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 --2- 172.21.15.132:0/1191684724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780cf8e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 -- 172.21.15.132:0/1191684724 >> 172.21.15.132:0/1191684724 conn(0x7fc878071b10 msgr2=0x7fc878071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 -- 172.21.15.132:0/1191684724 shutdown_connections 2023-05-10T04:19:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.673+0000 7fc87ffff700 1 -- 172.21.15.132:0/1191684724 wait complete. 2023-05-10T04:19:14.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.675+0000 7fc87ffff700 1 Processor -- start 2023-05-10T04:19:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.675+0000 7fc87ffff700 1 -- start start 2023-05-10T04:19:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfe20 0x7fc8781e5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87815a140 0x7fc8781411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87ffff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc878141700 con 0x7fc878160ba0 2023-05-10T04:19:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc87814e390 con 0x7fc87815a140 2023-05-10T04:19:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87ffff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8780d2590 con 0x7fc8780cfe20 2023-05-10T04:19:14.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87d59a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87815a140 0x7fc8781411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780b7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37520/0 (socket says 172.21.15.132:37520) 2023-05-10T04:19:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87e59c700 1 -- 172.21.15.132:0/594565272 learned_addr learned my addr 172.21.15.132:0/594565272 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87dd9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfe20 0x7fc8781e5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87e59c700 1 -- 172.21.15.132:0/594565272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfe20 msgr2=0x7fc8781e5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87e59c700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfe20 0x7fc8781e5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87e59c700 1 -- 172.21.15.132:0/594565272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87815a140 msgr2=0x7fc8781411c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87e59c700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87815a140 0x7fc8781411c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.676+0000 7fc87e59c700 1 -- 172.21.15.132:0/594565272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868009550 con 0x7fc878160ba0 2023-05-10T04:19:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.677+0000 7fc87e59c700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780b7b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc870007e70 tx=0x7fc87000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.677+0000 7fc86e7fc700 1 -- 172.21.15.132:0/594565272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87000dd20 con 0x7fc878160ba0 2023-05-10T04:19:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.677+0000 7fc86e7fc700 1 -- 172.21.15.132:0/594565272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc87000f040 con 0x7fc878160ba0 2023-05-10T04:19:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.677+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc87815daf0 con 0x7fc878160ba0 2023-05-10T04:19:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.677+0000 7fc86e7fc700 1 -- 172.21.15.132:0/594565272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87000dea0 con 0x7fc878160ba0 2023-05-10T04:19:14.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.677+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc87815d2f0 con 0x7fc878160ba0 2023-05-10T04:19:14.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.678+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8780cdb00 con 0x7fc878160ba0 2023-05-10T04:19:14.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.679+0000 7fc86e7fc700 1 -- 172.21.15.132:0/594565272 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc870003c60 con 0x7fc878160ba0 2023-05-10T04:19:14.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.680+0000 7fc86e7fc700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc85c06ace0 0x7fc85c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:14.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.680+0000 7fc86e7fc700 1 -- 172.21.15.132:0/594565272 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc8700897b0 con 0x7fc878160ba0 2023-05-10T04:19:14.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.680+0000 7fc87dd9b700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc85c06ace0 0x7fc85c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:14.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.681+0000 7fc87dd9b700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc85c06ace0 0x7fc85c06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc874009b60 tx=0x7fc874009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:14.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.684+0000 7fc86e7fc700 1 -- 172.21.15.132:0/594565272 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc870054570 con 0x7fc878160ba0 2023-05-10T04:19:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.924+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8781e8c40 con 0x7fc878160ba0 2023-05-10T04:19:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.925+0000 7fc86e7fc700 1 -- 172.21.15.132:0/594565272 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fc870057b90 con 0x7fc878160ba0 2023-05-10T04:19:14.927 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:14.927 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:14.463352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-10T04:19:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc85c06ace0 msgr2=0x7fc85c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc85c06ace0 0x7fc85c06d190 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc874009b60 tx=0x7fc874009210 comp rx=0 tx=0).stop 2023-05-10T04:19:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 msgr2=0x7fc8780b7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780b7b20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc870007e70 tx=0x7fc87000d3b0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 shutdown_connections 2023-05-10T04:19:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc85c06ace0 0x7fc85c06d190 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc878160ba0 0x7fc8780b7b20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc8780cfe20 0x7fc8781e5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 --2- 172.21.15.132:0/594565272 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc87815a140 0x7fc8781411c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 >> 172.21.15.132:0/594565272 conn(0x7fc878071b10 msgr2=0x7fc87815f730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 shutdown_connections 2023-05-10T04:19:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:14.927+0000 7fc87ffff700 1 -- 172.21.15.132:0/594565272 wait complete. 2023-05-10T04:19:14.931 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-05-10T04:19:14.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:15.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.127+0000 7f3fba5ff700 1 Processor -- start 2023-05-10T04:19:15.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.127+0000 7f3fba5ff700 1 -- start start 2023-05-10T04:19:15.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fba5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3fb40b87a0 0x7f3fb40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fba5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb41601e0 0x7f3fb4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fba5ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fb4160b70 0x7f3fb40d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fba5ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40d02d0 con 0x7f3fb4160b70 2023-05-10T04:19:15.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fba5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40d0cb0 con 0x7f3fb40b87a0 2023-05-10T04:19:15.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fba5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40b2730 con 0x7f3fb41601e0 2023-05-10T04:19:15.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fb8b9c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fb4160b70 0x7f3fb40d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fb8b9c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3fb4160b70 0x7f3fb40d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37534/0 (socket says 172.21.15.132:37534) 2023-05-10T04:19:15.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fb8b9c700 1 -- 172.21.15.132:0/377722636 learned_addr learned my addr 172.21.15.132:0/377722636 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:15.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fabfff700 1 --2- 172.21.15.132:0/377722636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb41601e0 0x7f3fb4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.128+0000 7f3fb3fff700 1 --2- 172.21.15.132:0/377722636 >> v2:172.21.15.154:3300/0 conn(0x7f3fb40b87a0 0x7f3fb40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb8b9c700 1 -- 172.21.15.132:0/377722636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb41601e0 msgr2=0x7f3fb4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:15.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb8b9c700 1 --2- 172.21.15.132:0/377722636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb41601e0 0x7f3fb4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb8b9c700 1 -- 172.21.15.132:0/377722636 >> v2:172.21.15.154:3300/0 conn(0x7f3fb40b87a0 msgr2=0x7f3fb40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:15.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb8b9c700 1 --2- 172.21.15.132:0/377722636 >> v2:172.21.15.154:3300/0 conn(0x7f3fb40b87a0 0x7f3fb40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb8b9c700 1 -- 172.21.15.132:0/377722636 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4160ff0 con 0x7f3fb4160b70 2023-05-10T04:19:15.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb8b9c700 1 --2- 172.21.15.132:0/377722636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb4160b70 0x7f3fb40d2de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40b4ac0 tx=0x7f3fac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f00ab5e2df9855 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:15.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb37fe700 1 -- 172.21.15.132:0/377722636 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00e070 con 0x7f3fb4160b70 2023-05-10T04:19:15.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb37fe700 1 -- 172.21.15.132:0/377722636 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac00b910 con 0x7f3fb4160b70 2023-05-10T04:19:15.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.129+0000 7f3fb37fe700 1 -- 172.21.15.132:0/377722636 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00bcc0 con 0x7f3fb4160b70 2023-05-10T04:19:15.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 -- 172.21.15.132:0/377722636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb4160b70 msgr2=0x7f3fb40d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/377722636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb4160b70 0x7f3fb40d2de0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40b4ac0 tx=0x7f3fac00b330 comp rx=0 tx=0).stop 2023-05-10T04:19:15.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 -- 172.21.15.132:0/377722636 shutdown_connections 2023-05-10T04:19:15.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/377722636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb4160b70 0x7f3fb40d2de0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/377722636 >> v2:172.21.15.154:3300/0 conn(0x7f3fb40b87a0 0x7f3fb40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/377722636 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb41601e0 0x7f3fb4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 -- 172.21.15.132:0/377722636 >> 172.21.15.132:0/377722636 conn(0x7f3fb4071b10 msgr2=0x7f3fb4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:15.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 -- 172.21.15.132:0/377722636 shutdown_connections 2023-05-10T04:19:15.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.130+0000 7f3fba5ff700 1 -- 172.21.15.132:0/377722636 wait complete. 2023-05-10T04:19:15.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.132+0000 7f3fba5ff700 1 Processor -- start 2023-05-10T04:19:15.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.132+0000 7f3fba5ff700 1 -- start start 2023-05-10T04:19:15.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fba5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb40b87a0 0x7f3fb4150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fba5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb41601e0 0x7f3fb41570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fba5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb4160b70 0x7f3fb4157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fba5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40c6e00 con 0x7f3fb41601e0 2023-05-10T04:19:15.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fba5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4150db0 con 0x7f3fb40b87a0 2023-05-10T04:19:15.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fba5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4159160 con 0x7f3fb4160b70 2023-05-10T04:19:15.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb41601e0 0x7f3fb41570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb41601e0 0x7f3fb41570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37540/0 (socket says 172.21.15.132:37540) 2023-05-10T04:19:15.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 -- 172.21.15.132:0/541741565 learned_addr learned my addr 172.21.15.132:0/541741565 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:15.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fb3fff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb40b87a0 0x7f3fb4150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fb8b9c700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb4160b70 0x7f3fb4157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 -- 172.21.15.132:0/541741565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb4160b70 msgr2=0x7f3fb4157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb4160b70 0x7f3fb4157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 -- 172.21.15.132:0/541741565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb40b87a0 msgr2=0x7f3fb4150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb40b87a0 0x7f3fb4150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 -- 172.21.15.132:0/541741565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fac009b30 con 0x7f3fb41601e0 2023-05-10T04:19:15.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.133+0000 7f3fabfff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb41601e0 0x7f3fb41570f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00e9e0 tx=0x7f3f9c00eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:15.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.134+0000 7f3fb17fa700 1 -- 172.21.15.132:0/541741565 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c009710 con 0x7f3fb41601e0 2023-05-10T04:19:15.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.134+0000 7f3fb17fa700 1 -- 172.21.15.132:0/541741565 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c00c850 con 0x7f3fb41601e0 2023-05-10T04:19:15.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.134+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb40cd6a0 con 0x7f3fb41601e0 2023-05-10T04:19:15.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.134+0000 7f3fb17fa700 1 -- 172.21.15.132:0/541741565 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c00cbc0 con 0x7f3fb41601e0 2023-05-10T04:19:15.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.134+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb40cdc60 con 0x7f3fb41601e0 2023-05-10T04:19:15.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.135+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb40cd980 con 0x7f3fb41601e0 2023-05-10T04:19:15.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.136+0000 7f3fb17fa700 1 -- 172.21.15.132:0/541741565 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f9c00cd20 con 0x7f3fb41601e0 2023-05-10T04:19:15.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.137+0000 7f3fb17fa700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3f9406ace0 0x7f3f9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.137+0000 7f3fb17fa700 1 -- 172.21.15.132:0/541741565 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3f9c0898d0 con 0x7f3fb41601e0 2023-05-10T04:19:15.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.137+0000 7f3fb3fff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3f9406ace0 0x7f3f9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.138+0000 7f3fb3fff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3f9406ace0 0x7f3f9406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009a50 tx=0x7f3fa4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:15.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.141+0000 7f3fb17fa700 1 -- 172.21.15.132:0/541741565 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3f9c058110 con 0x7f3fb41601e0 2023-05-10T04:19:15.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.345+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fb4074430 con 0x7f3fb41601e0 2023-05-10T04:19:15.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.346+0000 7f3fb17fa700 1 -- 172.21.15.132:0/541741565 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f3f9c057ca0 con 0x7f3fb41601e0 2023-05-10T04:19:15.348 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:15.349 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:15.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3f9406ace0 msgr2=0x7f3f9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3f9406ace0 0x7f3f9406d190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4009a50 tx=0x7f3fa4008040 comp rx=0 tx=0).stop 2023-05-10T04:19:15.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb41601e0 msgr2=0x7f3fb41570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb41601e0 0x7f3fb41570f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c00e9e0 tx=0x7f3f9c00eda0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 shutdown_connections 2023-05-10T04:19:15.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3f9406ace0 0x7f3f9406d190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3fb4160b70 0x7f3fb4157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3fb40b87a0 0x7f3fb4150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 --2- 172.21.15.132:0/541741565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fb41601e0 0x7f3fb41570f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 >> 172.21.15.132:0/541741565 conn(0x7f3fb4071b10 msgr2=0x7f3fb40b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:15.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 shutdown_connections 2023-05-10T04:19:15.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.349+0000 7f3fba5ff700 1 -- 172.21.15.132:0/541741565 wait complete. 2023-05-10T04:19:15.369 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.550+0000 7fde657ff700 1 Processor -- start 2023-05-10T04:19:15.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.550+0000 7fde657ff700 1 -- start start 2023-05-10T04:19:15.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.551+0000 7fde657ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fde600cfbf0 0x7fde601608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.551+0000 7fde657ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde600d0020 con 0x7fde600d1100 2023-05-10T04:19:15.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.551+0000 7fde657ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde600cdc60 con 0x7fde600b87a0 2023-05-10T04:19:15.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.551+0000 7fde657ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde600d02d0 con 0x7fde600cfbf0 2023-05-10T04:19:15.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.551+0000 7fde5e7fc700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fde600cfbf0 0x7fde601608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.551+0000 7fde5f7fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fde600d1100 0x7fde600d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36990/0 (socket says 172.21.15.132:36990) 2023-05-10T04:19:15.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5e7fc700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fde600cfbf0 0x7fde601608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37546/0 (socket says 172.21.15.132:37546) 2023-05-10T04:19:15.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5f7fe700 1 -- 172.21.15.132:0/1819523619 learned_addr learned my addr 172.21.15.132:0/1819523619 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:15.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5e7fc700 1 -- 172.21.15.132:0/1819523619 >> v1:172.21.15.154:6789/0 conn(0x7fde600b87a0 legacy=0x7fde601601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5e7fc700 1 -- 172.21.15.132:0/1819523619 >> v1:172.21.15.132:6789/0 conn(0x7fde600d1100 legacy=0x7fde600d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5e7fc700 1 -- 172.21.15.132:0/1819523619 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600cd6a0 con 0x7fde600cfbf0 2023-05-10T04:19:15.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5dffb700 1 -- 172.21.15.132:0/1819523619 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311140525 0 0) 0x7fde600d0020 con 0x7fde600d1100 2023-05-10T04:19:15.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5e7fc700 1 --2- 172.21.15.132:0/1819523619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601608f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde54009840 tx=0x7fde54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311253600ff6ef62 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:15.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5dffb700 1 -- 172.21.15.132:0/1819523619 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54011830 con 0x7fde600cfbf0 2023-05-10T04:19:15.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5dffb700 1 -- 172.21.15.132:0/1819523619 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde54011990 con 0x7fde600cfbf0 2023-05-10T04:19:15.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.552+0000 7fde5dffb700 1 -- 172.21.15.132:0/1819523619 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54011d20 con 0x7fde600cfbf0 2023-05-10T04:19:15.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.553+0000 7fde657ff700 1 -- 172.21.15.132:0/1819523619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 msgr2=0x7fde601608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.553+0000 7fde657ff700 1 --2- 172.21.15.132:0/1819523619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601608f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde54009840 tx=0x7fde54009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:15.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.553+0000 7fde657ff700 1 -- 172.21.15.132:0/1819523619 shutdown_connections 2023-05-10T04:19:15.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.553+0000 7fde657ff700 1 --2- 172.21.15.132:0/1819523619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601608f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.553+0000 7fde657ff700 1 -- 172.21.15.132:0/1819523619 >> 172.21.15.132:0/1819523619 conn(0x7fde60071b10 msgr2=0x7fde60071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:15.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.553+0000 7fde657ff700 1 -- 172.21.15.132:0/1819523619 shutdown_connections 2023-05-10T04:19:15.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.553+0000 7fde657ff700 1 -- 172.21.15.132:0/1819523619 wait complete. 2023-05-10T04:19:15.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.555+0000 7fde657ff700 1 Processor -- start 2023-05-10T04:19:15.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.556+0000 7fde657ff700 1 -- start start 2023-05-10T04:19:15.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde657ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde600b87a0 0x7fde601e7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde657ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde657ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde600d1100 0x7fde600c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde657ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600cc910 con 0x7fde600cfbf0 2023-05-10T04:19:15.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde657ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600ccda0 con 0x7fde600d1100 2023-05-10T04:19:15.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde657ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde600cbd00 con 0x7fde600b87a0 2023-05-10T04:19:15.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5e7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5e7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601e7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37558/0 (socket says 172.21.15.132:37558) 2023-05-10T04:19:15.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5e7fc700 1 -- 172.21.15.132:0/1857052036 learned_addr learned my addr 172.21.15.132:0/1857052036 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:15.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5effd700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde600b87a0 0x7fde601e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5f7fe700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde600d1100 0x7fde600c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5e7fc700 1 -- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde600b87a0 msgr2=0x7fde601e7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5e7fc700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde600b87a0 0x7fde601e7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5e7fc700 1 -- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde600d1100 msgr2=0x7fde600c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5e7fc700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde600d1100 0x7fde600c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5e7fc700 1 -- 172.21.15.132:0/1857052036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540094a0 con 0x7fde600cfbf0 2023-05-10T04:19:15.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.557+0000 7fde5f7fe700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde600d1100 0x7fde600c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:15.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.558+0000 7fde5e7fc700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601e7c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde540090b0 tx=0x7fde54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:15.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.558+0000 7fde477fe700 1 -- 172.21.15.132:0/1857052036 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde540036a0 con 0x7fde600cfbf0 2023-05-10T04:19:15.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.558+0000 7fde477fe700 1 -- 172.21.15.132:0/1857052036 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5401f070 con 0x7fde600cfbf0 2023-05-10T04:19:15.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.558+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde60160e30 con 0x7fde600cfbf0 2023-05-10T04:19:15.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.558+0000 7fde477fe700 1 -- 172.21.15.132:0/1857052036 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde54003a00 con 0x7fde600cfbf0 2023-05-10T04:19:15.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.558+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde600cd980 con 0x7fde600cfbf0 2023-05-10T04:19:15.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.559+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde60160fc0 con 0x7fde600cfbf0 2023-05-10T04:19:15.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.560+0000 7fde477fe700 1 -- 172.21.15.132:0/1857052036 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde54003b60 con 0x7fde600cfbf0 2023-05-10T04:19:15.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.561+0000 7fde477fe700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde4c06ace0 0x7fde4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.561+0000 7fde477fe700 1 -- 172.21.15.132:0/1857052036 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde54021070 con 0x7fde600cfbf0 2023-05-10T04:19:15.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.561+0000 7fde5effd700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde4c06ace0 0x7fde4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.561+0000 7fde5effd700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde4c06ace0 0x7fde4c06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde50000f60 tx=0x7fde50009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:15.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.565+0000 7fde477fe700 1 -- 172.21.15.132:0/1857052036 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fde540560a0 con 0x7fde600cfbf0 2023-05-10T04:19:15.630 INFO:tasks.ceph.mds.b.smithi154.stderr:2023-05-10T04:19:15.628+0000 7f111ddf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T04:19:15.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.765+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde600b52f0 con 0x7fde600cfbf0 2023-05-10T04:19:15.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.766+0000 7fde477fe700 1 -- 172.21.15.132:0/1857052036 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fde540596c0 con 0x7fde600cfbf0 2023-05-10T04:19:15.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:15.769 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:15.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde4c06ace0 msgr2=0x7fde4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde4c06ace0 0x7fde4c06d190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde50000f60 tx=0x7fde50009040 comp rx=0 tx=0).stop 2023-05-10T04:19:15.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 msgr2=0x7fde601e7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601e7c50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fde540090b0 tx=0x7fde54004750 comp rx=0 tx=0).stop 2023-05-10T04:19:15.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 shutdown_connections 2023-05-10T04:19:15.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde4c06ace0 0x7fde4c06d190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde600d1100 0x7fde600c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde600b87a0 0x7fde601e7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 --2- 172.21.15.132:0/1857052036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde600cfbf0 0x7fde601e7c50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 >> 172.21.15.132:0/1857052036 conn(0x7fde60071b10 msgr2=0x7fde600b42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:15.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 shutdown_connections 2023-05-10T04:19:15.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.769+0000 7fde657ff700 1 -- 172.21.15.132:0/1857052036 wait complete. 2023-05-10T04:19:15.804 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:19:15.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.985+0000 7fc0a8dff700 1 Processor -- start 2023-05-10T04:19:15.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.985+0000 7fc0a8dff700 1 -- start start 2023-05-10T04:19:15.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a8dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc0a40b87a0 0x7fc0a40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a8dff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40cdc60 con 0x7fc0a4160d40 2023-05-10T04:19:15.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a8dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a40cd6a0 con 0x7fc0a41601e0 2023-05-10T04:19:15.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a8dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a40d02d0 con 0x7fc0a40b87a0 2023-05-10T04:19:15.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a2d9d700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc0a4160d40 0x7fc0a40d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36992/0 (socket says 172.21.15.132:36992) 2023-05-10T04:19:15.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/2689486086 learned_addr learned my addr 172.21.15.132:0/2689486086 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:15.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a259c700 1 --2- 172.21.15.132:0/2689486086 >> v2:172.21.15.154:3300/0 conn(0x7fc0a40b87a0 0x7fc0a40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128552498 0 0) 0x7fc0a40cdc60 con 0x7fc0a4160d40 2023-05-10T04:19:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc08c0035b0 con 0x7fc0a4160d40 2023-05-10T04:19:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144514333 0 0) 0x7fc0a40cd6a0 con 0x7fc0a41601e0 2023-05-10T04:19:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.987+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0a40cdc60 con 0x7fc0a41601e0 2023-05-10T04:19:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3550994047 0 0) 0x7fc08c0035b0 con 0x7fc0a4160d40 2023-05-10T04:19:15.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 >> v2:172.21.15.154:3300/0 conn(0x7fc0a40b87a0 msgr2=0x7fc0a40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 --2- 172.21.15.132:0/2689486086 >> v2:172.21.15.154:3300/0 conn(0x7fc0a40b87a0 0x7fc0a40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 >> v1:172.21.15.154:6789/0 conn(0x7fc0a41601e0 legacy=0x7fc0a4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40cd980 con 0x7fc0a4160d40 2023-05-10T04:19:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fc09c0019f0 con 0x7fc0a4160d40 2023-05-10T04:19:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a259c700 1 --2- 172.21.15.132:0/2689486086 >> v2:172.21.15.154:3300/0 conn(0x7fc0a40b87a0 0x7fc0a40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 >> v1:172.21.15.132:6789/0 conn(0x7fc0a4160d40 legacy=0x7fc0a40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c003b90 0x7fc08c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c004850 0x7fc08c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc08c005200 0x7fc08c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40d02d0 con 0x7fc08c005200 2023-05-10T04:19:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c00c060 con 0x7fc08c003b90 2023-05-10T04:19:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c00c220 con 0x7fc08c004850 2023-05-10T04:19:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a2d9d700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc08c005200 0x7fc08c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a259c700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c003b90 0x7fc08c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a1d9b700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c004850 0x7fc08c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/2689486086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c004850 msgr2=0x7fc08c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a2d9d700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc08c004850 0x7fc08c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/2689486086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c003b90 msgr2=0x7fc08c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a2d9d700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c003b90 0x7fc08c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/2689486086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c0035b0 con 0x7fc08c005200 2023-05-10T04:19:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.988+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/2689486086 reap_dead start 2023-05-10T04:19:15.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a2d9d700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc08c005200 0x7fc08c00ba10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00a7a0 tx=0x7fc08c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4760829d84bda9d7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c012600 con 0x7fc08c005200 2023-05-10T04:19:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c012780 con 0x7fc08c005200 2023-05-10T04:19:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a159a700 1 -- 172.21.15.132:0/2689486086 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c012b30 con 0x7fc08c005200 2023-05-10T04:19:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a8dff700 1 -- 172.21.15.132:0/2689486086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc08c005200 msgr2=0x7fc08c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a8dff700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc08c005200 0x7fc08c00ba10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc09c00a7a0 tx=0x7fc08c005880 comp rx=0 tx=0).stop 2023-05-10T04:19:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a8dff700 1 -- 172.21.15.132:0/2689486086 shutdown_connections 2023-05-10T04:19:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a8dff700 1 --2- 172.21.15.132:0/2689486086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc08c005200 0x7fc08c00ba10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:15.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a8dff700 1 -- 172.21.15.132:0/2689486086 >> 172.21.15.132:0/2689486086 conn(0x7fc0a4071b10 msgr2=0x7fc0a4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:15.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.989+0000 7fc0a8dff700 1 -- 172.21.15.132:0/2689486086 shutdown_connections 2023-05-10T04:19:15.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.990+0000 7fc0a8dff700 1 -- 172.21.15.132:0/2689486086 wait complete. 2023-05-10T04:19:15.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.992+0000 7fc0a8dff700 1 Processor -- start 2023-05-10T04:19:15.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.992+0000 7fc0a8dff700 1 -- start start 2023-05-10T04:19:15.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.993+0000 7fc0a8dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c005200 0x7fc0a41513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.993+0000 7fc0a8dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a40c8bc0 0x7fc0a40c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.993+0000 7fc0a8dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a40c69e0 0x7fc0a40c6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:15.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.993+0000 7fc0a8dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c7fb0 con 0x7fc0a40c69e0 2023-05-10T04:19:15.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.993+0000 7fc0a8dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a4152cb0 con 0x7fc08c005200 2023-05-10T04:19:16.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.993+0000 7fc0a8dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a40c9570 con 0x7fc0a40c8bc0 2023-05-10T04:19:16.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a40c69e0 0x7fc0a40c6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a40c69e0 0x7fc0a40c6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37572/0 (socket says 172.21.15.132:37572) 2023-05-10T04:19:16.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/507339049 learned_addr learned my addr 172.21.15.132:0/507339049 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:16.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a1d9b700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a40c8bc0 0x7fc0a40c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a259c700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c005200 0x7fc0a41513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/507339049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a40c8bc0 msgr2=0x7fc0a40c9030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a40c8bc0 0x7fc0a40c9030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/507339049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c005200 msgr2=0x7fc0a41513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c005200 0x7fc0a41513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 -- 172.21.15.132:0/507339049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a40cfd80 con 0x7fc0a40c69e0 2023-05-10T04:19:16.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a2d9d700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a40c69e0 0x7fc0a40c6e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4160140 tx=0x7fc09c001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:16.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc092ffd700 1 -- 172.21.15.132:0/507339049 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c01e630 con 0x7fc0a40c69e0 2023-05-10T04:19:16.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc092ffd700 1 -- 172.21.15.132:0/507339049 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09c01e790 con 0x7fc0a40c69e0 2023-05-10T04:19:16.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.994+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a40cfbf0 con 0x7fc0a40c69e0 2023-05-10T04:19:16.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.995+0000 7fc092ffd700 1 -- 172.21.15.132:0/507339049 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c01eb20 con 0x7fc0a40c69e0 2023-05-10T04:19:16.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.995+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a40cff10 con 0x7fc0a40c69e0 2023-05-10T04:19:16.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.996+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a4151900 con 0x7fc0a40c69e0 2023-05-10T04:19:16.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.997+0000 7fc092ffd700 1 -- 172.21.15.132:0/507339049 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc09c01ec80 con 0x7fc0a40c69e0 2023-05-10T04:19:16.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.997+0000 7fc092ffd700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc08406ace0 0x7fc08406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:16.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.998+0000 7fc092ffd700 1 -- 172.21.15.132:0/507339049 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc09c08b610 con 0x7fc0a40c69e0 2023-05-10T04:19:16.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.998+0000 7fc0a259c700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc08406ace0 0x7fc08406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:15.998+0000 7fc0a259c700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc08406ace0 0x7fc08406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc094009470 tx=0x7fc094009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:16.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.002+0000 7fc092ffd700 1 -- 172.21.15.132:0/507339049 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc09c0563c0 con 0x7fc0a40c69e0 2023-05-10T04:19:16.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.238+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0a4151900 con 0x7fc0a40c69e0 2023-05-10T04:19:16.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.238+0000 7fc092ffd700 1 -- 172.21.15.132:0/507339049 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fc09c017090 con 0x7fc0a40c69e0 2023-05-10T04:19:16.240 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:16.241 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:14.463352+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-05-10T04:19:16.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc08406ace0 msgr2=0x7fc08406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc08406ace0 0x7fc08406d190 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc094009470 tx=0x7fc094009210 comp rx=0 tx=0).stop 2023-05-10T04:19:16.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a40c69e0 msgr2=0x7fc0a40c6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a40c69e0 0x7fc0a40c6e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4160140 tx=0x7fc09c001d00 comp rx=0 tx=0).stop 2023-05-10T04:19:16.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 shutdown_connections 2023-05-10T04:19:16.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc08406ace0 0x7fc08406d190 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0a40c69e0 0x7fc0a40c6e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc08c005200 0x7fc0a41513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.240+0000 7fc0a8dff700 1 --2- 172.21.15.132:0/507339049 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc0a40c8bc0 0x7fc0a40c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.241+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 >> 172.21.15.132:0/507339049 conn(0x7fc0a4071b10 msgr2=0x7fc0a4160610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:16.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.241+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 shutdown_connections 2023-05-10T04:19:16.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.241+0000 7fc0a8dff700 1 -- 172.21.15.132:0/507339049 wait complete. 2023-05-10T04:19:16.244 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 7 2023-05-10T04:19:16.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:16.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.440+0000 7f2b403ff700 1 Processor -- start 2023-05-10T04:19:16.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.440+0000 7f2b403ff700 1 -- start start 2023-05-10T04:19:16.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.441+0000 7f2b403ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b3815c590 0x7f2b38160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:16.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.441+0000 7f2b403ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b380cff50 0x7f2b380d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:16.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.441+0000 7f2b403ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b380cd520 con 0x7f2b380cf010 2023-05-10T04:19:16.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.441+0000 7f2b403ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b380d2640 con 0x7f2b3815c590 2023-05-10T04:19:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.441+0000 7f2b403ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b381610d0 con 0x7f2b380cff50 2023-05-10T04:19:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.441+0000 7f2b3e19b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b3815c590 0x7f2b38160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.441+0000 7f2b3e19b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b3815c590 0x7f2b38160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37580/0 (socket says 172.21.15.132:37580) 2023-05-10T04:19:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.441+0000 7f2b3e19b700 1 -- 172.21.15.132:0/332468116 learned_addr learned my addr 172.21.15.132:0/332468116 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3e99c700 1 --2- 172.21.15.132:0/332468116 >> v2:172.21.15.154:3300/0 conn(0x7f2b380cff50 0x7f2b380d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3e19b700 1 -- 172.21.15.132:0/332468116 >> v2:172.21.15.154:3300/0 conn(0x7f2b380cff50 msgr2=0x7f2b380d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:16.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3e19b700 1 --2- 172.21.15.132:0/332468116 >> v2:172.21.15.154:3300/0 conn(0x7f2b380cff50 0x7f2b380d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3e19b700 1 -- 172.21.15.132:0/332468116 >> v1:172.21.15.154:6789/0 conn(0x7f2b380cf010 legacy=0x7f2b380cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3e19b700 1 -- 172.21.15.132:0/332468116 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b380b23c0 con 0x7f2b3815c590 2023-05-10T04:19:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3e19b700 1 --2- 172.21.15.132:0/332468116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b3815c590 0x7f2b38160b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b380b20b0 tx=0x7f2b34009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cd5d18c403cdf7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3d199700 1 -- 172.21.15.132:0/332468116 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34004230 con 0x7f2b3815c590 2023-05-10T04:19:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3d199700 1 -- 172.21.15.132:0/332468116 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b34004390 con 0x7f2b3815c590 2023-05-10T04:19:16.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.442+0000 7f2b3d199700 1 -- 172.21.15.132:0/332468116 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b340036a0 con 0x7f2b3815c590 2023-05-10T04:19:16.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.443+0000 7f2b403ff700 1 -- 172.21.15.132:0/332468116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b3815c590 msgr2=0x7f2b38160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.443+0000 7f2b403ff700 1 --2- 172.21.15.132:0/332468116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b3815c590 0x7f2b38160b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2b380b20b0 tx=0x7f2b34009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.443+0000 7f2b403ff700 1 -- 172.21.15.132:0/332468116 shutdown_connections 2023-05-10T04:19:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.443+0000 7f2b403ff700 1 --2- 172.21.15.132:0/332468116 >> v2:172.21.15.154:3300/0 conn(0x7f2b380cff50 0x7f2b380d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.443+0000 7f2b403ff700 1 --2- 172.21.15.132:0/332468116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b3815c590 0x7f2b38160b90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.443+0000 7f2b403ff700 1 -- 172.21.15.132:0/332468116 >> 172.21.15.132:0/332468116 conn(0x7f2b38071b10 msgr2=0x7f2b38071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.443+0000 7f2b403ff700 1 -- 172.21.15.132:0/332468116 shutdown_connections 2023-05-10T04:19:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.443+0000 7f2b403ff700 1 -- 172.21.15.132:0/332468116 wait complete. 2023-05-10T04:19:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.444+0000 7f2b403ff700 1 Processor -- start 2023-05-10T04:19:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.445+0000 7f2b403ff700 1 -- start start 2023-05-10T04:19:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.445+0000 7f2b403ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b380cf010 0x7f2b3815e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.445+0000 7f2b403ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cff50 0x7f2b38158770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.445+0000 7f2b403ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3815c590 0x7f2b3815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b403ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3815f700 con 0x7f2b380cff50 2023-05-10T04:19:16.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b403ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3815ea80 con 0x7f2b3815c590 2023-05-10T04:19:16.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b403ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3815ed60 con 0x7f2b380cf010 2023-05-10T04:19:16.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cff50 0x7f2b38158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cff50 0x7f2b38158770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37596/0 (socket says 172.21.15.132:37596) 2023-05-10T04:19:16.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 -- 172.21.15.132:0/2478519029 learned_addr learned my addr 172.21.15.132:0/2478519029 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:16.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3e19b700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b380cf010 0x7f2b3815e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3e99c700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3815c590 0x7f2b3815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 -- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b380cf010 msgr2=0x7f2b3815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b380cf010 0x7f2b3815e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 -- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3815c590 msgr2=0x7f2b3815a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3815c590 0x7f2b3815a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 -- 172.21.15.132:0/2478519029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b34009550 con 0x7f2b380cff50 2023-05-10T04:19:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3e19b700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b380cf010 0x7f2b3815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.446+0000 7f2b3d99a700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cff50 0x7f2b38158770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800b4a0 tx=0x7f2b2800b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.447+0000 7f2b2effd700 1 -- 172.21.15.132:0/2478519029 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b28011830 con 0x7f2b380cff50 2023-05-10T04:19:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.447+0000 7f2b2effd700 1 -- 172.21.15.132:0/2478519029 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b28011990 con 0x7f2b380cff50 2023-05-10T04:19:16.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.447+0000 7f2b2effd700 1 -- 172.21.15.132:0/2478519029 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b28011d40 con 0x7f2b380cff50 2023-05-10T04:19:16.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.447+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b380cd770 con 0x7f2b380cff50 2023-05-10T04:19:16.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.447+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b380cf560 con 0x7f2b380cff50 2023-05-10T04:19:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.448+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b3815c960 con 0x7f2b380cff50 2023-05-10T04:19:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.449+0000 7f2b2effd700 1 -- 172.21.15.132:0/2478519029 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b2801a400 con 0x7f2b380cff50 2023-05-10T04:19:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.450+0000 7f2b2effd700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b1c06ad10 0x7f2b1c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.450+0000 7f2b2effd700 1 -- 172.21.15.132:0/2478519029 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2b280893b0 con 0x7f2b380cff50 2023-05-10T04:19:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.450+0000 7f2b3e19b700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b1c06ad10 0x7f2b1c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:16.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.451+0000 7f2b3e19b700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b1c06ad10 0x7f2b1c06d1c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009840 tx=0x7f2b34008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:16.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.454+0000 7f2b2effd700 1 -- 172.21.15.132:0/2478519029 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2b28054170 con 0x7f2b380cff50 2023-05-10T04:19:16.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.650+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b3815f840 con 0x7f2b380cff50 2023-05-10T04:19:16.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.652+0000 7f2b2effd700 1 -- 172.21.15.132:0/2478519029 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f2b3815f840 con 0x7f2b380cff50 2023-05-10T04:19:16.654 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:16.654 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b1c06ad10 msgr2=0x7f2b1c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b1c06ad10 0x7f2b1c06d1c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2b34009840 tx=0x7f2b34008030 comp rx=0 tx=0).stop 2023-05-10T04:19:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cff50 msgr2=0x7f2b38158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:16.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cff50 0x7f2b38158770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b2800b4a0 tx=0x7f2b2800b7b0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 shutdown_connections 2023-05-10T04:19:16.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b1c06ad10 0x7f2b1c06d1c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b3815c590 0x7f2b3815a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b380cf010 0x7f2b3815e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 --2- 172.21.15.132:0/2478519029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cff50 0x7f2b38158770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:16.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 >> 172.21.15.132:0/2478519029 conn(0x7f2b38071b10 msgr2=0x7f2b380b4270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:16.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 shutdown_connections 2023-05-10T04:19:16.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:16.654+0000 7f2b403ff700 1 -- 172.21.15.132:0/2478519029 wait complete. 2023-05-10T04:19:17.076 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T04:19:09.944202+0000', 'modified': '2023-05-10T04:19:14.463352+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4315}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4315': {'gid': 4315, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6835/36374977', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6833', 'nonce': 36374977}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 36374977}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-05-10T04:19:17.077 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T04:19:17.078 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-10T04:19:17.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.259+0000 7f8771fff700 1 Processor -- start 2023-05-10T04:19:17.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.260+0000 7f8771fff700 1 -- start start 2023-05-10T04:19:17.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f8771fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c0b87a0 0x7f876c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f8771fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f876c1601e0 0x7f876c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f8771fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f876c160ff0 con 0x7f876c160b70 2023-05-10T04:19:17.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f8771fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f876c0d02d0 con 0x7f876c1601e0 2023-05-10T04:19:17.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f8771fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0d0cb0 con 0x7f876c0b87a0 2023-05-10T04:19:17.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f876bfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f876c160b70 0x7f876c0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37000/0 (socket says 172.21.15.132:37000) 2023-05-10T04:19:17.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f876bfff700 1 -- 172.21.15.132:0/3417648277 learned_addr learned my addr 172.21.15.132:0/3417648277 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:17.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f8763fff700 1 --2- 172.21.15.132:0/3417648277 >> v2:172.21.15.154:3300/0 conn(0x7f876c1601e0 0x7f876c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f876b7fe700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c0b87a0 0x7f876c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251009356 0 0) 0x7f876c160ff0 con 0x7f876c160b70 2023-05-10T04:19:17.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.261+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87580035b0 con 0x7f876c160b70 2023-05-10T04:19:17.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1946696211 0 0) 0x7f87580035b0 con 0x7f876c160b70 2023-05-10T04:19:17.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c0b87a0 msgr2=0x7f876c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c0b87a0 0x7f876c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 >> v2:172.21.15.154:3300/0 conn(0x7f876c1601e0 msgr2=0x7f876c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 --2- 172.21.15.132:0/3417648277 >> v2:172.21.15.154:3300/0 conn(0x7f876c1601e0 0x7f876c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0cdc60 con 0x7f876c160b70 2023-05-10T04:19:17.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f87640019f0 con 0x7f876c160b70 2023-05-10T04:19:17.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 >> v1:172.21.15.132:6789/0 conn(0x7f876c160b70 legacy=0x7f876c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c0b87a0 0x7f8758003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758003f80 0x7f8758004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8758004d90 0x7f8758005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0d02d0 con 0x7f8758004d90 2023-05-10T04:19:17.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875800ba10 con 0x7f8758003f80 2023-05-10T04:19:17.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875800bb50 con 0x7f876c0b87a0 2023-05-10T04:19:17.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876bfff700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8758004d90 0x7f8758005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f8763fff700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758003f80 0x7f8758004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876b7fe700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c0b87a0 0x7f8758003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876bfff700 1 -- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c0b87a0 msgr2=0x7f8758003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876bfff700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c0b87a0 0x7f8758003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876bfff700 1 -- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758003f80 msgr2=0x7f8758004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.262+0000 7f876bfff700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758003f80 0x7f8758004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.263+0000 7f876bfff700 1 -- 172.21.15.132:0/3417648277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87580035b0 con 0x7f8758004d90 2023-05-10T04:19:17.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.263+0000 7f876bfff700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8758004d90 0x7f8758005200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f876400a860 tx=0x7f8758005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cab4060cb7352a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.263+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764012600 con 0x7f8758004d90 2023-05-10T04:19:17.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.263+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8764012780 con 0x7f8758004d90 2023-05-10T04:19:17.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.263+0000 7f876affd700 1 -- 172.21.15.132:0/3417648277 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8764012b30 con 0x7f8758004d90 2023-05-10T04:19:17.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.263+0000 7f8771fff700 1 -- 172.21.15.132:0/3417648277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8758004d90 msgr2=0x7f8758005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.263+0000 7f8771fff700 1 --2- 172.21.15.132:0/3417648277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8758004d90 0x7f8758005200 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f876400a860 tx=0x7f8758005880 comp rx=0 tx=0).stop 2023-05-10T04:19:17.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.263+0000 7f876bfff700 1 -- 172.21.15.132:0/3417648277 reap_dead start 2023-05-10T04:19:17.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.264+0000 7f8771fff700 1 -- 172.21.15.132:0/3417648277 shutdown_connections 2023-05-10T04:19:17.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.264+0000 7f8771fff700 1 -- 172.21.15.132:0/3417648277 >> 172.21.15.132:0/3417648277 conn(0x7f876c071b10 msgr2=0x7f876c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:17.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.264+0000 7f8771fff700 1 -- 172.21.15.132:0/3417648277 shutdown_connections 2023-05-10T04:19:17.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.264+0000 7f8771fff700 1 -- 172.21.15.132:0/3417648277 wait complete. 2023-05-10T04:19:17.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.265+0000 7f8771fff700 1 Processor -- start 2023-05-10T04:19:17.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.265+0000 7f8771fff700 1 -- start start 2023-05-10T04:19:17.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.266+0000 7f8771fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758004d90 0x7f876c0b3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.266+0000 7f8771fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876c0ca1b0 0x7f876c0ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.266+0000 7f8771fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c150f90 0x7f876c151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.266+0000 7f8771fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0cab60 con 0x7f876c0ca1b0 2023-05-10T04:19:17.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.266+0000 7f8771fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876c151940 con 0x7f8758004d90 2023-05-10T04:19:17.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.266+0000 7f8771fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876c0c69e0 con 0x7f876c150f90 2023-05-10T04:19:17.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876c0ca1b0 0x7f876c0ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876c0ca1b0 0x7f876c0ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37622/0 (socket says 172.21.15.132:37622) 2023-05-10T04:19:17.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 -- 172.21.15.132:0/2486368028 learned_addr learned my addr 172.21.15.132:0/2486368028 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:17.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f876bfff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c150f90 0x7f876c151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f876b7fe700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758004d90 0x7f876c0b3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 -- 172.21.15.132:0/2486368028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c150f90 msgr2=0x7f876c151400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c150f90 0x7f876c151400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 -- 172.21.15.132:0/2486368028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758004d90 msgr2=0x7f876c0b3bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758004d90 0x7f876c0b3bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 -- 172.21.15.132:0/2486368028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f876c0cd980 con 0x7f876c0ca1b0 2023-05-10T04:19:17.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8763fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876c0ca1b0 0x7f876c0ca620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8754011ad0 tx=0x7f8754011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8768ff9700 1 -- 172.21.15.132:0/2486368028 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400f940 con 0x7f876c0ca1b0 2023-05-10T04:19:17.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8768ff9700 1 -- 172.21.15.132:0/2486368028 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875400fac0 con 0x7f876c0ca1b0 2023-05-10T04:19:17.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8771fff700 1 -- 172.21.15.132:0/2486368028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f876c0cd6a0 con 0x7f876c0ca1b0 2023-05-10T04:19:17.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.267+0000 7f8768ff9700 1 -- 172.21.15.132:0/2486368028 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875400fe70 con 0x7f876c0ca1b0 2023-05-10T04:19:17.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.268+0000 7f8771fff700 1 -- 172.21.15.132:0/2486368028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f876c0d2110 con 0x7f876c0ca1b0 2023-05-10T04:19:17.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.271+0000 7f8768ff9700 1 -- 172.21.15.132:0/2486368028 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8754014440 con 0x7f876c0ca1b0 2023-05-10T04:19:17.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.271+0000 7f8768ff9700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874c06ad10 0x7f874c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.272+0000 7f8768ff9700 1 -- 172.21.15.132:0/2486368028 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8754089db0 con 0x7f876c0ca1b0 2023-05-10T04:19:17.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.272+0000 7f876b7fe700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874c06ad10 0x7f874c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.272+0000 7f876b7fe700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874c06ad10 0x7f874c06d1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f875c009c60 tx=0x7f875c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.273+0000 7f8785891b80 1 Processor -- start 2023-05-10T04:19:17.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.273+0000 7f8785891b80 1 -- start start 2023-05-10T04:19:17.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.274+0000 7f8785891b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfdb210 0x55f9dbfb71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.274+0000 7f8785891b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 0x55f9dbfe2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.274+0000 7f8785891b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfe6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.274+0000 7f8785891b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbec1010 con 0x55f9dbfe5dc0 2023-05-10T04:19:17.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.274+0000 7f8785891b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbf13850 con 0x55f9dbfb94a0 2023-05-10T04:19:17.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.274+0000 7f8785891b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbf0cce0 con 0x55f9dbfdb210 2023-05-10T04:19:17.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.274+0000 7f876bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfe6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f876bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfe6230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37630/0 (socket says 172.21.15.132:37630) 2023-05-10T04:19:17.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f876bfff700 1 -- 172.21.15.132:0/1803530716 learned_addr learned my addr 172.21.15.132:0/1803530716 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:17.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f876bfff700 1 -- 172.21.15.132:0/1803530716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfdb210 msgr2=0x55f9dbfb71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f876bfff700 1 --2- 172.21.15.132:0/1803530716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfdb210 0x55f9dbfb71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f876bfff700 1 -- 172.21.15.132:0/1803530716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 msgr2=0x55f9dbfe2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f876bfff700 1 --2- 172.21.15.132:0/1803530716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 0x55f9dbfe2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f876bfff700 1 -- 172.21.15.132:0/1803530716 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9dbd8e5e0 con 0x55f9dbfe5dc0 2023-05-10T04:19:17.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f876bfff700 1 --2- 172.21.15.132:0/1803530716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfe6230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8764012000 tx=0x7f8764007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3446cdf5d7dd2408 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f87617fa700 1 -- 172.21.15.132:0/1803530716 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876400a280 con 0x55f9dbfe5dc0 2023-05-10T04:19:17.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f87617fa700 1 -- 172.21.15.132:0/1803530716 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8764012400 con 0x55f9dbfe5dc0 2023-05-10T04:19:17.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.275+0000 7f87617fa700 1 -- 172.21.15.132:0/1803530716 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87640017b0 con 0x55f9dbfe5dc0 2023-05-10T04:19:17.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 -- 172.21.15.132:0/1803530716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfe5dc0 msgr2=0x55f9dbfe6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 --2- 172.21.15.132:0/1803530716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfe6230 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8764012000 tx=0x7f8764007000 comp rx=0 tx=0).stop 2023-05-10T04:19:17.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 -- 172.21.15.132:0/1803530716 shutdown_connections 2023-05-10T04:19:17.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 --2- 172.21.15.132:0/1803530716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfe6230 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 --2- 172.21.15.132:0/1803530716 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfdb210 0x55f9dbfb71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 --2- 172.21.15.132:0/1803530716 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 0x55f9dbfe2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 -- 172.21.15.132:0/1803530716 >> 172.21.15.132:0/1803530716 conn(0x55f9dbfb0ba0 msgr2=0x55f9dc000dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:17.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 -- 172.21.15.132:0/1803530716 shutdown_connections 2023-05-10T04:19:17.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.276+0000 7f8785891b80 1 -- 172.21.15.132:0/1803530716 wait complete. 2023-05-10T04:19:17.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.277+0000 7f8785891b80 1 -- start start 2023-05-10T04:19:17.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.277+0000 7f8785891b80 1 Processor -- start 2023-05-10T04:19:17.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8785891b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 0x55f9dbfda730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8785891b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8785891b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfb52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8785891b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbeae890 con 0x55f9dbfdb210 2023-05-10T04:19:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8785891b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbeae530 con 0x55f9dbfb94a0 2023-05-10T04:19:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8785891b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbd908d0 con 0x55f9dbfe5dc0 2023-05-10T04:19:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8785891b80 10 client.0 _ll_register_callbacks cb 0x55f9dbecc730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T04:19:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8763fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8763fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37646/0 (socket says 172.21.15.132:37646) 2023-05-10T04:19:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f8763fff700 1 -- 172.21.15.132:0/2519738037 learned_addr learned my addr 172.21.15.132:0/2519738037 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.278+0000 7f876b7fe700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 0x55f9dbfda730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f876bfff700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfb52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8763fff700 1 -- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 msgr2=0x55f9dbfb52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8763fff700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfb52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8763fff700 1 -- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 msgr2=0x55f9dbfda730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8763fff700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 0x55f9dbfda730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8763fff700 1 -- 172.21.15.132:0/2519738037 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87580035b0 con 0x55f9dbfdb210 2023-05-10T04:19:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f876b7fe700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 0x55f9dbfda730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f876bfff700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfb52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8763fff700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb4d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8754060740 tx=0x7f875405ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8290c27ad15f3861 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f874a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-05-10T04:19:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f874a7fc700 1 -- 172.21.15.132:0/2519738037 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540607e0 con 0x55f9dbfdb210 2023-05-10T04:19:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8785891b80 1 -- 172.21.15.132:0/2519738037 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9dbfae360 con 0x55f9dbfdb210 2023-05-10T04:19:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f874a7fc700 1 -- 172.21.15.132:0/2519738037 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8754060940 con 0x55f9dbfdb210 2023-05-10T04:19:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f874a7fc700 1 -- 172.21.15.132:0/2519738037 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8754012c00 con 0x55f9dbfdb210 2023-05-10T04:19:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8785891b80 10 client.4422 fetch_fsmap learned FSMap version 7 2023-05-10T04:19:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8785891b80 1 -- 172.21.15.132:0/2519738037 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f9dbed3140 con 0x55f9dbfdb210 2023-05-10T04:19:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f874a7fc700 1 -- 172.21.15.132:0/2519738037 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f9dbfae360 con 0x55f9dbfdb210 2023-05-10T04:19:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f874a7fc700 1 -- 172.21.15.132:0/2519738037 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f8754012d60 con 0x55f9dbfdb210 2023-05-10T04:19:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.279+0000 7f8785891b80 10 client.4422 fetch_fsmap finished waiting for FSMap version 7 2023-05-10T04:19:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.280+0000 7f8785891b80 10 client.4422 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-10T04:19:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.280+0000 7f8785891b80 20 client.4422 populate_metadata read hostname 'smithi132' 2023-05-10T04:19:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.280+0000 7f8785891b80 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f9dc013ea0 0x55f9dc014270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.280+0000 7f8785891b80 4 client.4422 mds_command: new command op to 4315 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T04:19:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.280+0000 7f8785891b80 1 -- 172.21.15.132:0/2519738037 --> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9dbecf050 con 0x55f9dc013ea0 2023-05-10T04:19:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.280+0000 7f876b7fe700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f9dc013ea0 0x55f9dc014270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.280+0000 7f874a7fc700 10 client.4422 ms_handle_connect on v2:172.21.15.154:6833/36374977 2023-05-10T04:19:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.280+0000 7f876b7fe700 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f9dc013ea0 0x55f9dc014270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2d1c979eac01dd2 server_cookie=fbd6cd83b745c89e in_seq=0 out_seq=0 2023-05-10T04:19:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.281+0000 7f874a7fc700 1 -- 172.21.15.132:0/2519738037 <== mds.0 v2:172.21.15.154:6833/36374977 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f9dbecf050 con 0x55f9dc013ea0 2023-05-10T04:19:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.281+0000 7f874a7fc700 10 client.4422 handle_command_reply: tid=0 2023-05-10T04:19:17.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.281+0000 7f8785891b80 1 client.4422 shutdown 2023-05-10T04:19:17.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 -- 172.21.15.132:0/2519738037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 msgr2=0x55f9dbfb4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb4d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f8754060740 tx=0x7f875405ca10 comp rx=0 tx=0).stop 2023-05-10T04:19:17.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 -- 172.21.15.132:0/2519738037 shutdown_connections 2023-05-10T04:19:17.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f9dc013ea0 0x55f9dc014270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfb52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfb94a0 0x55f9dbfda730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f874a7fc700 0 client.4422 ms_handle_reset on v2:172.21.15.154:6833/36374977 2023-05-10T04:19:17.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 --2- 172.21.15.132:0/2519738037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb4d90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 -- 172.21.15.132:0/2519738037 >> 172.21.15.132:0/2519738037 conn(0x55f9dbfb0ba0 msgr2=0x55f9dbfe3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:17.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 -- 172.21.15.132:0/2519738037 shutdown_connections 2023-05-10T04:19:17.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 1 -- 172.21.15.132:0/2519738037 wait complete. 2023-05-10T04:19:17.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.282+0000 7f8785891b80 20 client.4422 trim_cache size 0 max 16384 2023-05-10T04:19:17.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.300+0000 7f8785891b80 1 Processor -- start 2023-05-10T04:19:17.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.300+0000 7f8785891b80 1 -- start start 2023-05-10T04:19:17.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8785891b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfb94a0 0x55f9dbfb4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8785891b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8785891b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfda500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8785891b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbfd9db0 con 0x55f9dbfdb210 2023-05-10T04:19:17.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8785891b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbfe5aa0 con 0x55f9dbfe5dc0 2023-05-10T04:19:17.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8785891b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbfdaa40 con 0x55f9dbfb94a0 2023-05-10T04:19:17.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8763fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8763fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37662/0 (socket says 172.21.15.132:37662) 2023-05-10T04:19:17.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8763fff700 1 -- 172.21.15.132:0/59377052 learned_addr learned my addr 172.21.15.132:0/59377052 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:17.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f876b7fe700 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfb94a0 0x55f9dbfb4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f876bfff700 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfda500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8763fff700 1 -- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfb94a0 msgr2=0x55f9dbfb4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8763fff700 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfb94a0 0x55f9dbfb4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8763fff700 1 -- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfe5dc0 msgr2=0x55f9dbfda500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8763fff700 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfda500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f8763fff700 1 -- 172.21.15.132:0/59377052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9dbed2e90 con 0x55f9dbfdb210 2023-05-10T04:19:17.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f876b7fe700 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfb94a0 0x55f9dbfb4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:17.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.301+0000 7f876bfff700 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfda500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:17.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8763fff700 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb5470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8754056f10 tx=0x7f875405e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c7f79e4b83a2c8d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8761ffb700 1 -- 172.21.15.132:0/59377052 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540607e0 con 0x55f9dbfdb210 2023-05-10T04:19:17.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8761ffb700 1 -- 172.21.15.132:0/59377052 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8754060940 con 0x55f9dbfdb210 2023-05-10T04:19:17.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8761ffb700 1 -- 172.21.15.132:0/59377052 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754012e20 con 0x55f9dbfdb210 2023-05-10T04:19:17.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8785891b80 1 -- 172.21.15.132:0/59377052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 msgr2=0x55f9dbfb5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8785891b80 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb5470 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8754056f10 tx=0x7f875405e000 comp rx=0 tx=0).stop 2023-05-10T04:19:17.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8785891b80 1 -- 172.21.15.132:0/59377052 shutdown_connections 2023-05-10T04:19:17.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8785891b80 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfe5dc0 0x55f9dbfda500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8785891b80 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfb94a0 0x55f9dbfb4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8785891b80 1 --2- 172.21.15.132:0/59377052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb5470 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.302+0000 7f8785891b80 1 -- 172.21.15.132:0/59377052 >> 172.21.15.132:0/59377052 conn(0x55f9dbfb0ba0 msgr2=0x55f9dbfbb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:17.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.303+0000 7f8785891b80 1 -- 172.21.15.132:0/59377052 shutdown_connections 2023-05-10T04:19:17.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.303+0000 7f8785891b80 1 -- 172.21.15.132:0/59377052 wait complete. 2023-05-10T04:19:17.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.303+0000 7f8785891b80 1 -- start start 2023-05-10T04:19:17.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.303+0000 7f8785891b80 1 Processor -- start 2023-05-10T04:19:17.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.304+0000 7f8785891b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfb94a0 0x55f9dc066810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.304+0000 7f8785891b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.304+0000 7f8785891b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.304+0000 7f8785891b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbfd8c40 con 0x55f9dbfb94a0 2023-05-10T04:19:17.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.304+0000 7f8785891b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9dc0202c0 con 0x55f9dbfdb210 2023-05-10T04:19:17.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.304+0000 7f8785891b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f9dbfd8e40 con 0x55f9dbfe5dc0 2023-05-10T04:19:17.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.304+0000 7f8785891b80 10 client.0 _ll_register_callbacks cb 0x7f8754058280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T04:19:17.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.304+0000 7f876b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfb94a0 0x55f9dc066810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfb94a0 0x55f9dc066810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37668/0 (socket says 172.21.15.132:37668) 2023-05-10T04:19:17.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876b7fe700 1 -- 172.21.15.132:0/3617612428 learned_addr learned my addr 172.21.15.132:0/3617612428 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:17.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876bfff700 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f8763fff700 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876b7fe700 1 -- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 msgr2=0x55f9dbfffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876b7fe700 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876b7fe700 1 -- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfdb210 msgr2=0x55f9dbfb51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876b7fe700 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876b7fe700 1 -- 172.21.15.132:0/3617612428 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f9dbed3140 con 0x55f9dbfb94a0 2023-05-10T04:19:17.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f8763fff700 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:17.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f876b7fe700 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfb94a0 0x55f9dc066810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f875c009a40 tx=0x7f875c017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b011e53b8d7c777e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f874a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-05-10T04:19:17.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f874a7fc700 1 -- 172.21.15.132:0/3617612428 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f875c028040 con 0x55f9dbfb94a0 2023-05-10T04:19:17.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f874a7fc700 1 -- 172.21.15.132:0/3617612428 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f875c029240 con 0x55f9dbfb94a0 2023-05-10T04:19:17.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.305+0000 7f8785891b80 1 -- 172.21.15.132:0/3617612428 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8764012400 con 0x55f9dbfb94a0 2023-05-10T04:19:17.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f874a7fc700 1 -- 172.21.15.132:0/3617612428 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f875c014e90 con 0x55f9dbfb94a0 2023-05-10T04:19:17.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8785891b80 10 client.4428 fetch_fsmap learned FSMap version 7 2023-05-10T04:19:17.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8785891b80 1 -- 172.21.15.132:0/3617612428 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55f9dbd23c10 con 0x55f9dbfb94a0 2023-05-10T04:19:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f874a7fc700 1 -- 172.21.15.132:0/3617612428 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8764012400 con 0x55f9dbfb94a0 2023-05-10T04:19:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f874a7fc700 1 -- 172.21.15.132:0/3617612428 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f875c029400 con 0x55f9dbfb94a0 2023-05-10T04:19:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8785891b80 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2023-05-10T04:19:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8785891b80 10 client.4428 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-10T04:19:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8785891b80 20 client.4428 populate_metadata read hostname 'smithi132' 2023-05-10T04:19:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8785891b80 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f9dbffc2c0 0x55f9dbffc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8785891b80 4 client.4428 mds_command: new command op to 4315 tid=0[{"prefix": "status"}] 2023-05-10T04:19:17.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8785891b80 1 -- 172.21.15.132:0/3617612428 --> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f9dbedb610 con 0x55f9dbffc2c0 2023-05-10T04:19:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.306+0000 7f8763fff700 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f9dbffc2c0 0x55f9dbffc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f874a7fc700 10 client.4428 ms_handle_connect on v2:172.21.15.154:6833/36374977 2023-05-10T04:19:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8763fff700 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f9dbffc2c0 0x55f9dbffc690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf15474f1fa71cad server_cookie=6c196e3042c0f33 in_seq=0 out_seq=0 2023-05-10T04:19:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f874a7fc700 1 -- 172.21.15.132:0/3617612428 <== mds.0 v2:172.21.15.154:6833/36374977 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f9dbedb610 con 0x55f9dbffc2c0 2023-05-10T04:19:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f874a7fc700 10 client.4428 handle_command_reply: tid=0 2023-05-10T04:19:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 client.4428 shutdown 2023-05-10T04:19:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 -- 172.21.15.132:0/3617612428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfb94a0 msgr2=0x55f9dc066810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfb94a0 0x55f9dc066810 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f875c009a40 tx=0x7f875c017070 comp rx=0 tx=0).stop 2023-05-10T04:19:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 -- 172.21.15.132:0/3617612428 shutdown_connections 2023-05-10T04:19:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f9dbffc2c0 0x55f9dbffc690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f9dbfe5dc0 0x55f9dbfffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f9dbfb94a0 0x55f9dc066810 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 --2- 172.21.15.132:0/3617612428 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f9dbfdb210 0x55f9dbfb51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f874a7fc700 0 client.4428 ms_handle_reset on v2:172.21.15.154:6833/36374977 2023-05-10T04:19:17.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 -- 172.21.15.132:0/3617612428 >> 172.21.15.132:0/3617612428 conn(0x55f9dbfb0ba0 msgr2=0x55f9dbfb61d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 -- 172.21.15.132:0/3617612428 shutdown_connections 2023-05-10T04:19:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.307+0000 7f8785891b80 1 -- 172.21.15.132:0/3617612428 wait complete. 2023-05-10T04:19:17.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8785891b80 20 client.4428 trim_cache size 0 max 16384 2023-05-10T04:19:17.320 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-05-10T04:19:17.321 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "390ee88e-3ece-4689-996a-1bc273e3e6b7", 2023-05-10T04:19:17.321 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-05-10T04:19:17.321 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4315, 2023-05-10T04:19:17.321 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-05-10T04:19:17.321 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-05-10T04:19:17.321 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-05-10T04:19:17.321 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 7.3599387680000001, 2023-05-10T04:19:17.321 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 7, 2023-05-10T04:19:17.322 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 28, 2023-05-10T04:19:17.322 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 27, 2023-05-10T04:19:17.322 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 12.686546921 2023-05-10T04:19:17.322 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-05-10T04:19:17.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 -- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874c06ad10 msgr2=0x7f874c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874c06ad10 0x7f874c06d1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f875c009c60 tx=0x7f875c009210 comp rx=0 tx=0).stop 2023-05-10T04:19:17.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 -- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876c0ca1b0 msgr2=0x7f876c0ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876c0ca1b0 0x7f876c0ca620 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8754011ad0 tx=0x7f8754011de0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 -- 172.21.15.132:0/2486368028 shutdown_connections 2023-05-10T04:19:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874c06ad10 0x7f874c06d1c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f876c150f90 0x7f876c151400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8758004d90 0x7f876c0b3bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 --2- 172.21.15.132:0/2486368028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876c0ca1b0 0x7f876c0ca620 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 -- 172.21.15.132:0/2486368028 >> 172.21.15.132:0/2486368028 conn(0x7f876c071b10 msgr2=0x7f876c15f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:17.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 -- 172.21.15.132:0/2486368028 shutdown_connections 2023-05-10T04:19:17.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.308+0000 7f8771fff700 1 -- 172.21.15.132:0/2486368028 wait complete. 2023-05-10T04:19:17.327 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-10T04:19:17.328 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-10T04:19:17.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-10T04:19:17.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.513+0000 7fe9afdff700 1 Processor -- start 2023-05-10T04:19:17.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.514+0000 7fe9afdff700 1 -- start start 2023-05-10T04:19:17.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9afdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9a80cd520 0x7fe9a80cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9afdff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9a80cfe20 0x7fe9a80b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9afdff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9a815d660 con 0x7fe9a815a140 2023-05-10T04:19:17.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9afdff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a80d02a0 con 0x7fe9a80cfe20 2023-05-10T04:19:17.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9afdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9a815cd70 con 0x7fe9a80cd520 2023-05-10T04:19:17.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9adb9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe9a815a140 0x7fe9a8160ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37004/0 (socket says 172.21.15.132:37004) 2023-05-10T04:19:17.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9adb9b700 1 -- 172.21.15.132:0/3387167433 learned_addr learned my addr 172.21.15.132:0/3387167433 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:17.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9ad39a700 1 --2- 172.21.15.132:0/3387167433 >> v2:172.21.15.154:3300/0 conn(0x7fe9a80cd520 0x7fe9a80cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9ae39c700 1 --2- 172.21.15.132:0/3387167433 >> v2:172.21.15.132:3300/0 conn(0x7fe9a80cfe20 0x7fe9a80b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9ad39a700 1 -- 172.21.15.132:0/3387167433 >> v2:172.21.15.132:3300/0 conn(0x7fe9a80cfe20 msgr2=0x7fe9a80b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:17.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9ad39a700 1 --2- 172.21.15.132:0/3387167433 >> v2:172.21.15.132:3300/0 conn(0x7fe9a80cfe20 0x7fe9a80b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9ad39a700 1 -- 172.21.15.132:0/3387167433 >> v1:172.21.15.132:6789/0 conn(0x7fe9a815a140 legacy=0x7fe9a8160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9ad39a700 1 -- 172.21.15.132:0/3387167433 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a815d010 con 0x7fe9a80cd520 2023-05-10T04:19:17.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9ae39c700 1 --2- 172.21.15.132:0/3387167433 >> v2:172.21.15.132:3300/0 conn(0x7fe9a80cfe20 0x7fe9a80b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:17.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.515+0000 7fe9acb99700 1 -- 172.21.15.132:0/3387167433 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965845876 0 0) 0x7fe9a815d660 con 0x7fe9a815a140 2023-05-10T04:19:17.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.516+0000 7fe9ad39a700 1 --2- 172.21.15.132:0/3387167433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cd520 0x7fe9a80cf8e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80d07b0 tx=0x7fe998009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e97d9a80c46853e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.516+0000 7fe9acb99700 1 -- 172.21.15.132:0/3387167433 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998011830 con 0x7fe9a80cd520 2023-05-10T04:19:17.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.516+0000 7fe9acb99700 1 -- 172.21.15.132:0/3387167433 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe998011990 con 0x7fe9a80cd520 2023-05-10T04:19:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.516+0000 7fe9acb99700 1 -- 172.21.15.132:0/3387167433 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998011d20 con 0x7fe9a80cd520 2023-05-10T04:19:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.516+0000 7fe9afdff700 1 -- 172.21.15.132:0/3387167433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cd520 msgr2=0x7fe9a80cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.516+0000 7fe9afdff700 1 --2- 172.21.15.132:0/3387167433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cd520 0x7fe9a80cf8e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe9a80d07b0 tx=0x7fe998009b20 comp rx=0 tx=0).stop 2023-05-10T04:19:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.517+0000 7fe9afdff700 1 -- 172.21.15.132:0/3387167433 shutdown_connections 2023-05-10T04:19:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.517+0000 7fe9afdff700 1 --2- 172.21.15.132:0/3387167433 >> v2:172.21.15.132:3300/0 conn(0x7fe9a80cfe20 0x7fe9a80b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.517+0000 7fe9afdff700 1 --2- 172.21.15.132:0/3387167433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cd520 0x7fe9a80cf8e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.517+0000 7fe9afdff700 1 -- 172.21.15.132:0/3387167433 >> 172.21.15.132:0/3387167433 conn(0x7fe9a8071b10 msgr2=0x7fe9a8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.517+0000 7fe9afdff700 1 -- 172.21.15.132:0/3387167433 shutdown_connections 2023-05-10T04:19:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.517+0000 7fe9afdff700 1 -- 172.21.15.132:0/3387167433 wait complete. 2023-05-10T04:19:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.518+0000 7fe9afdff700 1 Processor -- start 2023-05-10T04:19:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.518+0000 7fe9afdff700 1 -- start start 2023-05-10T04:19:17.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9afdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a80cd520 0x7fe9a80b85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9afdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cfe20 0x7fe9a814d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9afdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a815a140 0x7fe9a814dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9afdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80cb0c0 con 0x7fe9a80cd520 2023-05-10T04:19:17.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9afdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80cb3a0 con 0x7fe9a80cfe20 2023-05-10T04:19:17.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9afdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a80cb680 con 0x7fe9a815a140 2023-05-10T04:19:17.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9adb9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a80cd520 0x7fe9a80b85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9adb9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a80cd520 0x7fe9a80b85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37692/0 (socket says 172.21.15.132:37692) 2023-05-10T04:19:17.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.519+0000 7fe9adb9b700 1 -- 172.21.15.132:0/2065909577 learned_addr learned my addr 172.21.15.132:0/2065909577 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:17.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9ae39c700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a815a140 0x7fe9a814dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9ad39a700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cfe20 0x7fe9a814d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9adb9b700 1 -- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a815a140 msgr2=0x7fe9a814dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9adb9b700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a815a140 0x7fe9a814dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9adb9b700 1 -- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cfe20 msgr2=0x7fe9a814d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9adb9b700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cfe20 0x7fe9a814d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9adb9b700 1 -- 172.21.15.132:0/2065909577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a0009a70 con 0x7fe9a80cd520 2023-05-10T04:19:17.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9ae39c700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a815a140 0x7fe9a814dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:17.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9adb9b700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a80cd520 0x7fe9a80b85b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c550 tx=0x7fe9a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe99e7fc700 1 -- 172.21.15.132:0/2065909577 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4004c80 con 0x7fe9a80cd520 2023-05-10T04:19:17.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe99e7fc700 1 -- 172.21.15.132:0/2065909577 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9a4004e00 con 0x7fe9a80cd520 2023-05-10T04:19:17.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9980094a0 con 0x7fe9a80cd520 2023-05-10T04:19:17.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe99e7fc700 1 -- 172.21.15.132:0/2065909577 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9a4007310 con 0x7fe9a80cd520 2023-05-10T04:19:17.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.520+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a815daf0 con 0x7fe9a80cd520 2023-05-10T04:19:17.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.521+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a815d2f0 con 0x7fe9a80cd520 2023-05-10T04:19:17.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.522+0000 7fe99e7fc700 1 -- 172.21.15.132:0/2065909577 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9a4007470 con 0x7fe9a80cd520 2023-05-10T04:19:17.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.523+0000 7fe99e7fc700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe98c06ace0 0x7fe98c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:17.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.523+0000 7fe99e7fc700 1 -- 172.21.15.132:0/2065909577 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe9a4089550 con 0x7fe9a80cd520 2023-05-10T04:19:17.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.523+0000 7fe9ad39a700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe98c06ace0 0x7fe98c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:17.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.524+0000 7fe9ad39a700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe98c06ace0 0x7fe98c06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe9980090b0 tx=0x7fe998008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:17.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.527+0000 7fe99e7fc700 1 -- 172.21.15.132:0/2065909577 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe9a4054270 con 0x7fe9a80cd520 2023-05-10T04:19:17.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.769+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe9a80cdb00 con 0x7fe9a80cd520 2023-05-10T04:19:17.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.769+0000 7fe99e7fc700 1 -- 172.21.15.132:0/2065909577 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe9a4057890 con 0x7fe9a80cd520 2023-05-10T04:19:17.772 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-10T04:19:17.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe98c06ace0 msgr2=0x7fe98c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe98c06ace0 0x7fe98c06d190 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe9980090b0 tx=0x7fe998008030 comp rx=0 tx=0).stop 2023-05-10T04:19:17.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a80cd520 msgr2=0x7fe9a80b85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:17.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a80cd520 0x7fe9a80b85b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe9a400c550 tx=0x7fe9a400c910 comp rx=0 tx=0).stop 2023-05-10T04:19:17.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 shutdown_connections 2023-05-10T04:19:17.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe98c06ace0 0x7fe98c06d190 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9a815a140 0x7fe9a814dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9a80cd520 0x7fe9a80b85b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 --2- 172.21.15.132:0/2065909577 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9a80cfe20 0x7fe9a814d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:17.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 >> 172.21.15.132:0/2065909577 conn(0x7fe9a8071b10 msgr2=0x7fe9a80cefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:17.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 shutdown_connections 2023-05-10T04:19:17.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:17.772+0000 7fe9afdff700 1 -- 172.21.15.132:0/2065909577 wait complete. 2023-05-10T04:19:17.792 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-10T04:19:17.792 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T04:19:17.792 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-05-10T04:19:17.793 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-05-10T04:19:17.793 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-05-10T04:19:17.793 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-10T04:19:17.793 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T04:19:17.794 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T04:19:17.794 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-05-10T04:19:17.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:17.794 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-05-10T04:19:17.834 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:17.834 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:17.834 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:17.834 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:17.834 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:17.835 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:17.835 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:17.835 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:17.835 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-05-10T04:19:17.835 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:17.835 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:17.835 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-05-10T04:19:17.836 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:17.836 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:17.836 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T04:19:17.836 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:17.836 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-10T04:19:17.836 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42185sec preferred_lft 42185sec 2023-05-10T04:19:17.836 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::829d:7347:a1a9:23a0/64 scope link noprefixroute 2023-05-10T04:19:17.837 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:17.837 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-10T04:19:17.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:17.838 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:17.838 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:17.838 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2023-05-10T04:19:17.839 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2023-05-10T04:19:17.839 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2023-05-10T04:19:17.839 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-10T04:19:17.839 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:18.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:18.280 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T04:19:18.347 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-05-10T04:19:18.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:18.349 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-05-10T04:19:18.395 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-05-10T04:19:18.395 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T04:19:18.395 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-10T04:19:18.396 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-10T04:19:18.396 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T04:19:18.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:18.397 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:18.397 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:18.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-10T04:19:18.398 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-10T04:19:18.398 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-10T04:19:18.398 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:19.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:19.105 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-05-10T04:19:19.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:19.145 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-05-10T04:19:19.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:19.224 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:19.224 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:19.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-10T04:19:19.225 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-05-10T04:19:19.225 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:19.390 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-05-10T04:19:19.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:19.391 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:19.391 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:19.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-05-10T04:19:19.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-10T04:19:19.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-05-10T04:19:19.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-05-10T04:19:19.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-05-10T04:19:19.393 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:19.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:19.636 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:19.636 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:19.636 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-05-10T04:19:19.637 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2023-05-10T04:19:19.637 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:19.803 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-05-10T04:19:19.803 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:19.803 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-05-10T04:19:19.841 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-05-10T04:19:19.842 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:19.842 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-05-10T04:19:19.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:19:20.020 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:20.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:20.082 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:20.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:20.084 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:19:20.121 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-10T04:19:20.121 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-05-10T04:19:20.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:19:20.226 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:20.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:20.285 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:20.288 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:20.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:20.289 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:19:20.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi132.stderr:2023-05-10T04:19:20.967+0000 7fc64124f5c0 -1 init, newargv = 0x55d1db46cd70 newargc=15 2023-05-10T04:19:20.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi132.stderr:ceph-fuse[135096]: starting ceph client 2023-05-10T04:19:20.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi132.stderr:ceph-fuse[135096]: starting fuse 2023-05-10T04:19:21.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:19:21.493 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:21.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:21.553 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:21.555 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:21.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:21.557 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:19:21.595 INFO:teuthology.orchestra.run.smithi132.stdout:43 2023-05-10T04:19:21.595 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-10T04:19:21.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-10T04:19:21.596 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-05-10T04:19:21.596 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-05-10T04:19:21.596 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-05-10T04:19:21.597 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-05-10T04:19:21.597 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:21.597 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-05-10T04:19:21.598 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-05-10T04:19:21.598 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-05-10T04:19:21.598 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-05-10T04:19:21.598 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:21.599 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-05-10T04:19:21.599 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-05-10T04:19:21.599 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-05-10T04:19:21.599 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-05-10T04:19:21.600 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:21.600 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-05-10T04:19:21.600 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-10T04:19:21.600 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-10T04:19:21.601 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-10T04:19:21.601 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-05-10T04:19:21.601 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-05-10T04:19:21.601 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-05-10T04:19:21.602 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-10T04:19:21.602 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:21.602 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.admin")) 2023-05-10T04:19:21.603 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-05-10T04:19:21.768 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.admin.135096.asok 2023-05-10T04:19:21.946 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.135096.asok 2023-05-10T04:19:21.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:21.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.135096.asok status 2023-05-10T04:19:22.162 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-05-10T04:19:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-05-10T04:19:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "2ef5137fbb6e28908d2161218e7b594628c1b6d3", 2023-05-10T04:19:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.0.0-3851-g2ef5137f (2ef5137fbb6e28908d2161218e7b594628c1b6d3) reef (dev)", 2023-05-10T04:19:22.162 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "admin", 2023-05-10T04:19:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-05-10T04:19:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-05-10T04:19:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "135096", 2023-05-10T04:19:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-05-10T04:19:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-05-10T04:19:22.163 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-05-10T04:19:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4443, 2023-05-10T04:19:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-05-10T04:19:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-05-10T04:19:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-05-10T04:19:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 4443 2023-05-10T04:19:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:22.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-05-10T04:19:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-05-10T04:19:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-05-10T04:19:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3719407955 2023-05-10T04:19:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:19:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-05-10T04:19:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-05-10T04:19:22.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-05-10T04:19:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3719407955 2023-05-10T04:19:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.4443 192.168.0.1:0/3719407955", 2023-05-10T04:19:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3719407955", 2023-05-10T04:19:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-05-10T04:19:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 7, 2023-05-10T04:19:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 28, 2023-05-10T04:19:22.166 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-05-10T04:19:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-05-10T04:19:22.167 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-05-10T04:19:22.167 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-05-10T04:19:22.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:22.176 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-05-10T04:19:22.176 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-05-10T04:19:22.215 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-05-10T04:19:22.216 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-05-10T04:19:22.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:22.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-05-10T04:19:22.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:22.318 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-05-10T04:19:22.430 INFO:teuthology.orchestra.run.smithi132.stdout:# file: . 2023-05-10T04:19:22.430 INFO:teuthology.orchestra.run.smithi132.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-05-10T04:19:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:22.431 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:19:22.432 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:19:22.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:22.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.693+0000 7f1b58fff700 1 Processor -- start 2023-05-10T04:19:22.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.693+0000 7f1b58fff700 1 -- start start 2023-05-10T04:19:22.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.694+0000 7f1b58fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:22.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.694+0000 7f1b58fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b540adf70 0x7f1b540cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:22.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.694+0000 7f1b58fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b540cc9e0 con 0x7f1b5415cf10 2023-05-10T04:19:22.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.694+0000 7f1b58fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5415de20 con 0x7f1b540adf70 2023-05-10T04:19:22.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.694+0000 7f1b58fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540ce070 con 0x7f1b540cd760 2023-05-10T04:19:22.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.694+0000 7f1b51d9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b540adf70 0x7f1b540cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:22.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.694+0000 7f1b51d9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b540adf70 0x7f1b540cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51258/0 (socket says 172.21.15.132:51258) 2023-05-10T04:19:22.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.694+0000 7f1b51d9b700 1 -- 172.21.15.132:0/4193595939 learned_addr learned my addr 172.21.15.132:0/4193595939 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:22.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b5259c700 1 --2- 172.21.15.132:0/4193595939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:22.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b51d9b700 1 -- 172.21.15.132:0/4193595939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 msgr2=0x7f1b540cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:22.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b51d9b700 1 --2- 172.21.15.132:0/4193595939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b51d9b700 1 -- 172.21.15.132:0/4193595939 >> v1:172.21.15.154:6789/0 conn(0x7f1b5415cf10 legacy=0x7f1b5406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:22.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b51d9b700 1 -- 172.21.15.132:0/4193595939 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5415d860 con 0x7f1b540adf70 2023-05-10T04:19:22.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b5259c700 1 --2- 172.21.15.132:0/4193595939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:22.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b51d9b700 1 --2- 172.21.15.132:0/4193595939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b540adf70 0x7f1b540cce70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b48006fd0 tx=0x7f1b48009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16d7b708fd04dcaf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:22.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b5159a700 1 -- 172.21.15.132:0/4193595939 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b48005e30 con 0x7f1b540adf70 2023-05-10T04:19:22.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b5159a700 1 -- 172.21.15.132:0/4193595939 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b48006030 con 0x7f1b540adf70 2023-05-10T04:19:22.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.695+0000 7f1b5159a700 1 -- 172.21.15.132:0/4193595939 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b480063c0 con 0x7f1b540adf70 2023-05-10T04:19:22.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.696+0000 7f1b58fff700 1 -- 172.21.15.132:0/4193595939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b540adf70 msgr2=0x7f1b540cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:22.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.696+0000 7f1b58fff700 1 --2- 172.21.15.132:0/4193595939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b540adf70 0x7f1b540cce70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1b48006fd0 tx=0x7f1b48009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.696+0000 7f1b58fff700 1 -- 172.21.15.132:0/4193595939 shutdown_connections 2023-05-10T04:19:22.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.696+0000 7f1b58fff700 1 --2- 172.21.15.132:0/4193595939 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.696+0000 7f1b58fff700 1 --2- 172.21.15.132:0/4193595939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b540adf70 0x7f1b540cce70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.696+0000 7f1b58fff700 1 -- 172.21.15.132:0/4193595939 >> 172.21.15.132:0/4193595939 conn(0x7f1b540cf720 msgr2=0x7f1b540cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:22.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.696+0000 7f1b58fff700 1 -- 172.21.15.132:0/4193595939 shutdown_connections 2023-05-10T04:19:22.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.696+0000 7f1b58fff700 1 -- 172.21.15.132:0/4193595939 wait complete. 2023-05-10T04:19:22.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.697+0000 7f1b58fff700 1 Processor -- start 2023-05-10T04:19:22.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.698+0000 7f1b58fff700 1 -- start start 2023-05-10T04:19:22.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.698+0000 7f1b58fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b540adf70 0x7f1b5414fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:22.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.698+0000 7f1b58fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:22.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.698+0000 7f1b58fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b5415cf10 0x7f1b540c4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:22.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.698+0000 7f1b58fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b540c2ff0 con 0x7f1b5415cf10 2023-05-10T04:19:22.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.698+0000 7f1b58fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54164340 con 0x7f1b540adf70 2023-05-10T04:19:22.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.698+0000 7f1b58fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b54164620 con 0x7f1b540cd760 2023-05-10T04:19:22.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b5415cf10 0x7f1b540c4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:22.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b5415cf10 0x7f1b540c4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51268/0 (socket says 172.21.15.132:51268) 2023-05-10T04:19:22.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 -- 172.21.15.132:0/1826896268 learned_addr learned my addr 172.21.15.132:0/1826896268 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:22.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b5259c700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b540adf70 0x7f1b5414fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:22.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b51d9b700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:22.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 -- 172.21.15.132:0/1826896268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 msgr2=0x7f1b540c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:22.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 -- 172.21.15.132:0/1826896268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b540adf70 msgr2=0x7f1b5414fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:22.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b540adf70 0x7f1b5414fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 -- 172.21.15.132:0/1826896268 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b48009500 con 0x7f1b5415cf10 2023-05-10T04:19:22.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.699+0000 7f1b52d9d700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b5415cf10 0x7f1b540c4830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00b970 tx=0x7f1b4c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:22.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.700+0000 7f1b42ffd700 1 -- 172.21.15.132:0/1826896268 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c00c9b0 con 0x7f1b5415cf10 2023-05-10T04:19:22.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.700+0000 7f1b42ffd700 1 -- 172.21.15.132:0/1826896268 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4c00cb10 con 0x7f1b5415cf10 2023-05-10T04:19:22.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.700+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b540cc670 con 0x7f1b5415cf10 2023-05-10T04:19:22.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.700+0000 7f1b42ffd700 1 -- 172.21.15.132:0/1826896268 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4c014440 con 0x7f1b5415cf10 2023-05-10T04:19:22.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.700+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5415db40 con 0x7f1b5415cf10 2023-05-10T04:19:22.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.701+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b54071600 con 0x7f1b5415cf10 2023-05-10T04:19:22.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.702+0000 7f1b42ffd700 1 -- 172.21.15.132:0/1826896268 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b4c01d3b0 con 0x7f1b5415cf10 2023-05-10T04:19:22.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.703+0000 7f1b42ffd700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:22.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.703+0000 7f1b42ffd700 1 -- 172.21.15.132:0/1826896268 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b4c089570 con 0x7f1b5415cf10 2023-05-10T04:19:22.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.703+0000 7f1b5259c700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:22.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.703+0000 7f1b5259c700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b44006fd0 tx=0x7f1b44008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:22.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.707+0000 7f1b42ffd700 1 -- 172.21.15.132:0/1826896268 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1b4c054290 con 0x7f1b5415cf10 2023-05-10T04:19:22.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.902+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b54164b40 con 0x7f1b5415cf10 2023-05-10T04:19:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.904+0000 7f1b42ffd700 1 -- 172.21.15.132:0/1826896268 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f1b54164b40 con 0x7f1b5415cf10 2023-05-10T04:19:22.906 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:22.906 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:22.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 msgr2=0x7f1b3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:22.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1b44006fd0 tx=0x7f1b44008040 comp rx=0 tx=0).stop 2023-05-10T04:19:22.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b5415cf10 msgr2=0x7f1b540c4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:22.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b5415cf10 0x7f1b540c4830 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c00b970 tx=0x7f1b4c00bd30 comp rx=0 tx=0).stop 2023-05-10T04:19:22.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 shutdown_connections 2023-05-10T04:19:22.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b5415cf10 0x7f1b540c4830 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b540adf70 0x7f1b5414fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 --2- 172.21.15.132:0/1826896268 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b540cd760 0x7f1b540c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:22.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 >> 172.21.15.132:0/1826896268 conn(0x7f1b540cf720 msgr2=0x7f1b540cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:22.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 shutdown_connections 2023-05-10T04:19:22.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:22.906+0000 7f1b58fff700 1 -- 172.21.15.132:0/1826896268 wait complete. 2023-05-10T04:19:22.925 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:19:22.926 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:19:23.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.109+0000 7faacd5ff700 1 Processor -- start 2023-05-10T04:19:23.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.110+0000 7faacd5ff700 1 -- start start 2023-05-10T04:19:23.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faacd5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faac815d460 0x7faac80d2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faacd5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d8d0 0x7faac80d3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faacd5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faac80cd4c0 con 0x7faac815d090 2023-05-10T04:19:23.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faacd5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faac80cd7a0 con 0x7faac815d460 2023-05-10T04:19:23.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faacd5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac80cda80 con 0x7faac815d8d0 2023-05-10T04:19:23.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faac77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d8d0 0x7faac80d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faabffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faac815d460 0x7faac80d2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faac77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d8d0 0x7faac80d3340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:51710/0 (socket says 172.21.15.132:51710) 2023-05-10T04:19:23.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faac77fe700 1 -- 172.21.15.132:0/3415385051 learned_addr learned my addr 172.21.15.132:0/3415385051 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:23.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.111+0000 7faac6ffd700 1 --1- 172.21.15.132:0/3415385051 >> v1:172.21.15.154:6789/0 conn(0x7faac815d090 0x7faac80cfc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:52554/0 (socket says 172.21.15.132:52554) 2023-05-10T04:19:23.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.112+0000 7faac77fe700 1 -- 172.21.15.132:0/3415385051 >> v2:172.21.15.154:3300/0 conn(0x7faac815d460 msgr2=0x7faac80d2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:23.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.112+0000 7faac77fe700 1 --2- 172.21.15.132:0/3415385051 >> v2:172.21.15.154:3300/0 conn(0x7faac815d460 0x7faac80d2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.112+0000 7faac77fe700 1 -- 172.21.15.132:0/3415385051 >> v1:172.21.15.154:6789/0 conn(0x7faac815d090 legacy=0x7faac80cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.112+0000 7faac77fe700 1 -- 172.21.15.132:0/3415385051 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac80cf440 con 0x7faac815d8d0 2023-05-10T04:19:23.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.112+0000 7faac77fe700 1 --2- 172.21.15.132:0/3415385051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d8d0 0x7faac80d3340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faac0009e50 tx=0x7faac000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c76cdd145a9c80d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.112+0000 7faac67fc700 1 -- 172.21.15.132:0/3415385051 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000e070 con 0x7faac815d8d0 2023-05-10T04:19:23.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.112+0000 7faac67fc700 1 -- 172.21.15.132:0/3415385051 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac000b910 con 0x7faac815d8d0 2023-05-10T04:19:23.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.112+0000 7faac67fc700 1 -- 172.21.15.132:0/3415385051 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac000bcc0 con 0x7faac815d8d0 2023-05-10T04:19:23.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.113+0000 7faacd5ff700 1 -- 172.21.15.132:0/3415385051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d8d0 msgr2=0x7faac80d3340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.113+0000 7faacd5ff700 1 --2- 172.21.15.132:0/3415385051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d8d0 0x7faac80d3340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faac0009e50 tx=0x7faac000b330 comp rx=0 tx=0).stop 2023-05-10T04:19:23.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.113+0000 7faacd5ff700 1 -- 172.21.15.132:0/3415385051 shutdown_connections 2023-05-10T04:19:23.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.113+0000 7faacd5ff700 1 --2- 172.21.15.132:0/3415385051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d8d0 0x7faac80d3340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.113+0000 7faacd5ff700 1 --2- 172.21.15.132:0/3415385051 >> v2:172.21.15.154:3300/0 conn(0x7faac815d460 0x7faac80d2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.113+0000 7faacd5ff700 1 -- 172.21.15.132:0/3415385051 >> 172.21.15.132:0/3415385051 conn(0x7faac8071b10 msgr2=0x7faac8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:23.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.113+0000 7faacd5ff700 1 -- 172.21.15.132:0/3415385051 shutdown_connections 2023-05-10T04:19:23.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.113+0000 7faacd5ff700 1 -- 172.21.15.132:0/3415385051 wait complete. 2023-05-10T04:19:23.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.115+0000 7faacd5ff700 1 Processor -- start 2023-05-10T04:19:23.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.115+0000 7faacd5ff700 1 -- start start 2023-05-10T04:19:23.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faacd5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac815d090 0x7faac80c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faacd5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d460 0x7faac80b6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faacd5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faac81501b0 0x7faac80b80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faacd5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac8159d10 con 0x7faac81501b0 2023-05-10T04:19:23.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faacd5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faac815a290 con 0x7faac815d090 2023-05-10T04:19:23.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faacd5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faac8159fb0 con 0x7faac815d460 2023-05-10T04:19:23.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac77fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faac81501b0 0x7faac80b80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac77fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faac81501b0 0x7faac80b80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51280/0 (socket says 172.21.15.132:51280) 2023-05-10T04:19:23.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac77fe700 1 -- 172.21.15.132:0/1699239034 learned_addr learned my addr 172.21.15.132:0/1699239034 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:23.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faabffff700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d460 0x7faac80b6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac6ffd700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac815d090 0x7faac80c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac77fe700 1 -- 172.21.15.132:0/1699239034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d460 msgr2=0x7faac80b6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac77fe700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d460 0x7faac80b6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac77fe700 1 -- 172.21.15.132:0/1699239034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac815d090 msgr2=0x7faac80c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac77fe700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac815d090 0x7faac80c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.116+0000 7faac77fe700 1 -- 172.21.15.132:0/1699239034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac0009b30 con 0x7faac81501b0 2023-05-10T04:19:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.117+0000 7faac77fe700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faac81501b0 0x7faac80b80a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faac0012000 tx=0x7faac0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.117+0000 7faabf7fe700 1 -- 172.21.15.132:0/1699239034 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac0004800 con 0x7faac81501b0 2023-05-10T04:19:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.117+0000 7faabf7fe700 1 -- 172.21.15.132:0/1699239034 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faac0004960 con 0x7faac81501b0 2023-05-10T04:19:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.117+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faac80cf0c0 con 0x7faac81501b0 2023-05-10T04:19:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.117+0000 7faabf7fe700 1 -- 172.21.15.132:0/1699239034 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faac001c680 con 0x7faac81501b0 2023-05-10T04:19:23.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.117+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faac80cf720 con 0x7faac81501b0 2023-05-10T04:19:23.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.118+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faac80b2500 con 0x7faac81501b0 2023-05-10T04:19:23.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.119+0000 7faabf7fe700 1 -- 172.21.15.132:0/1699239034 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faac001c7e0 con 0x7faac81501b0 2023-05-10T04:19:23.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.120+0000 7faabf7fe700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faaa806ace0 0x7faaa806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.120+0000 7faabf7fe700 1 -- 172.21.15.132:0/1699239034 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faac008afc0 con 0x7faac81501b0 2023-05-10T04:19:23.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.120+0000 7faac6ffd700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faaa806ace0 0x7faaa806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.121+0000 7faac6ffd700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faaa806ace0 0x7faaa806d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faab8000f60 tx=0x7faab8007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.124+0000 7faabf7fe700 1 -- 172.21.15.132:0/1699239034 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faac0055d70 con 0x7faac81501b0 2023-05-10T04:19:23.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.317+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faac80c9a00 con 0x7faac81501b0 2023-05-10T04:19:23.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.318+0000 7faabf7fe700 1 -- 172.21.15.132:0/1699239034 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7faac0059390 con 0x7faac81501b0 2023-05-10T04:19:23.320 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:19:23.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faaa806ace0 msgr2=0x7faaa806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faaa806ace0 0x7faaa806d190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faab8000f60 tx=0x7faab8007ed0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faac81501b0 msgr2=0x7faac80b80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faac81501b0 0x7faac80b80a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faac0012000 tx=0x7faac0004ad0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 shutdown_connections 2023-05-10T04:19:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faaa806ace0 0x7faaa806d190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faac81501b0 0x7faac80b80a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faac815d090 0x7faac80c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 --2- 172.21.15.132:0/1699239034 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faac815d460 0x7faac80b6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 >> 172.21.15.132:0/1699239034 conn(0x7faac8071b10 msgr2=0x7faac815a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:23.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 shutdown_connections 2023-05-10T04:19:23.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.321+0000 7faacd5ff700 1 -- 172.21.15.132:0/1699239034 wait complete. 2023-05-10T04:19:23.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:19:23.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.526+0000 7f60641ff700 1 Processor -- start 2023-05-10T04:19:23.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.526+0000 7f60641ff700 1 -- start start 2023-05-10T04:19:23.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f60641ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f605c15a5a0 0x7f605c06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f60641ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f605c06a920 0x7f605c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f60641ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605c0cb280 con 0x7f605c071030 2023-05-10T04:19:23.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f60641ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605c15a970 con 0x7f605c15a5a0 2023-05-10T04:19:23.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f60641ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c06ad90 con 0x7f605c06a920 2023-05-10T04:19:23.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f606279c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f605c071030 0x7f605c15dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59272/0 (socket says 172.21.15.132:59272) 2023-05-10T04:19:23.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f606279c700 1 -- 172.21.15.132:0/525013856 learned_addr learned my addr 172.21.15.132:0/525013856 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:23.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f606179a700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f605c06a920 0x7f605c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f6061f9b700 1 --2- 172.21.15.132:0/525013856 >> v2:172.21.15.154:3300/0 conn(0x7f605c15a5a0 0x7f605c06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.527+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020040652 0 0) 0x7f6054001490 con 0x7f605c071030 2023-05-10T04:19:23.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60480035b0 con 0x7f605c071030 2023-05-10T04:19:23.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1474881019 0 0) 0x7f60480035b0 con 0x7f605c071030 2023-05-10T04:19:23.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f605c06a920 msgr2=0x7f605c070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:23.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f605c06a920 0x7f605c070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 >> v2:172.21.15.154:3300/0 conn(0x7f605c15a5a0 msgr2=0x7f605c06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:23.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 --2- 172.21.15.132:0/525013856 >> v2:172.21.15.154:3300/0 conn(0x7f605c15a5a0 0x7f605c06a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c0714b0 con 0x7f605c071030 2023-05-10T04:19:23.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f6054001b80 con 0x7f605c071030 2023-05-10T04:19:23.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 >> v1:172.21.15.132:6789/0 conn(0x7f605c071030 legacy=0x7f605c15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6048003a30 0x7f6048003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f605c06a920 0x7f6048004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6048004d90 0x7f6048005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c15a970 con 0x7f6048004d90 2023-05-10T04:19:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c06ad90 con 0x7f6048003a30 2023-05-10T04:19:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f604800ba10 con 0x7f605c06a920 2023-05-10T04:19:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f6061f9b700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6048003a30 0x7f6048003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f606279c700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6048004d90 0x7f6048005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.528+0000 7f606179a700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f605c06a920 0x7f6048004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f606279c700 1 -- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f605c06a920 msgr2=0x7f6048004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f606279c700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f605c06a920 0x7f6048004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f606279c700 1 -- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6048003a30 msgr2=0x7f6048003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f606279c700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6048003a30 0x7f6048003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f606279c700 1 -- 172.21.15.132:0/525013856 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60480035b0 con 0x7f6048004d90 2023-05-10T04:19:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f6061f9b700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6048003a30 0x7f6048003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f606279c700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6048004d90 0x7f6048005200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f605400a830 tx=0x7f6048005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d3f02a6329943d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605400a490 con 0x7f6048004d90 2023-05-10T04:19:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6054012620 con 0x7f6048004d90 2023-05-10T04:19:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.529+0000 7f6060f99700 1 -- 172.21.15.132:0/525013856 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60540129d0 con 0x7f6048004d90 2023-05-10T04:19:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.530+0000 7f60641ff700 1 -- 172.21.15.132:0/525013856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6048004d90 msgr2=0x7f6048005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.530+0000 7f60641ff700 1 --2- 172.21.15.132:0/525013856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6048004d90 0x7f6048005200 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f605400a830 tx=0x7f6048005880 comp rx=0 tx=0).stop 2023-05-10T04:19:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.530+0000 7f606279c700 1 -- 172.21.15.132:0/525013856 reap_dead start 2023-05-10T04:19:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.530+0000 7f60641ff700 1 -- 172.21.15.132:0/525013856 shutdown_connections 2023-05-10T04:19:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.530+0000 7f60641ff700 1 -- 172.21.15.132:0/525013856 >> 172.21.15.132:0/525013856 conn(0x7f605c0cf720 msgr2=0x7f605c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:23.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.530+0000 7f60641ff700 1 -- 172.21.15.132:0/525013856 shutdown_connections 2023-05-10T04:19:23.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.530+0000 7f60641ff700 1 -- 172.21.15.132:0/525013856 wait complete. 2023-05-10T04:19:23.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.531+0000 7f60641ff700 1 Processor -- start 2023-05-10T04:19:23.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.532+0000 7f60641ff700 1 -- start start 2023-05-10T04:19:23.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.532+0000 7f60641ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6048004d90 0x7f605c15aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.532+0000 7f60641ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c155bc0 0x7f605c1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.532+0000 7f60641ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c15cfe0 0x7f605c15d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.532+0000 7f60641ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c15d9c0 con 0x7f605c155bc0 2023-05-10T04:19:23.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.532+0000 7f60641ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605c156480 con 0x7f605c15cfe0 2023-05-10T04:19:23.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.532+0000 7f60641ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605c15b1b0 con 0x7f6048004d90 2023-05-10T04:19:23.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c155bc0 0x7f605c1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c155bc0 0x7f605c1553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51290/0 (socket says 172.21.15.132:51290) 2023-05-10T04:19:23.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 -- 172.21.15.132:0/89571913 learned_addr learned my addr 172.21.15.132:0/89571913 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:23.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f6061f9b700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6048004d90 0x7f605c15aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606279c700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c15cfe0 0x7f605c15d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 -- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6048004d90 msgr2=0x7f605c15aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6048004d90 0x7f605c15aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 -- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c15cfe0 msgr2=0x7f605c15d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c15cfe0 0x7f605c15d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 -- 172.21.15.132:0/89571913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605c0719e0 con 0x7f605c155bc0 2023-05-10T04:19:23.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606279c700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c15cfe0 0x7f605c15d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:23.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.533+0000 7f606179a700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c155bc0 0x7f605c1553b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f604c0119f0 tx=0x7f604c011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.534+0000 7f60527fc700 1 -- 172.21.15.132:0/89571913 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c005c30 con 0x7f605c155bc0 2023-05-10T04:19:23.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.534+0000 7f60527fc700 1 -- 172.21.15.132:0/89571913 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c005d90 con 0x7f605c155bc0 2023-05-10T04:19:23.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.534+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f605c071700 con 0x7f605c155bc0 2023-05-10T04:19:23.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.534+0000 7f60527fc700 1 -- 172.21.15.132:0/89571913 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c00f8f0 con 0x7f605c155bc0 2023-05-10T04:19:23.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.534+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605c06c6c0 con 0x7f605c155bc0 2023-05-10T04:19:23.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.535+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605c06c990 con 0x7f605c155bc0 2023-05-10T04:19:23.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.536+0000 7f60527fc700 1 -- 172.21.15.132:0/89571913 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f604c00fa50 con 0x7f605c155bc0 2023-05-10T04:19:23.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.537+0000 7f60527fc700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f604006ace0 0x7f604006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.537+0000 7f60527fc700 1 -- 172.21.15.132:0/89571913 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f604c089ee0 con 0x7f605c155bc0 2023-05-10T04:19:23.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.537+0000 7f6061f9b700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f604006ace0 0x7f604006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.537+0000 7f6061f9b700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f604006ace0 0x7f604006d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f605c06a840 tx=0x7f6058009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.541+0000 7f60527fc700 1 -- 172.21.15.132:0/89571913 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f604c054cc0 con 0x7f605c155bc0 2023-05-10T04:19:23.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.737+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f605c0cbcf0 con 0x7f605c155bc0 2023-05-10T04:19:23.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.738+0000 7f60527fc700 1 -- 172.21.15.132:0/89571913 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f604c0210a0 con 0x7f605c155bc0 2023-05-10T04:19:23.740 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:19:23.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f604006ace0 msgr2=0x7f604006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f604006ace0 0x7f604006d190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f605c06a840 tx=0x7f6058009210 comp rx=0 tx=0).stop 2023-05-10T04:19:23.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c155bc0 msgr2=0x7f605c1553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c155bc0 0x7f605c1553b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f604c0119f0 tx=0x7f604c011db0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 shutdown_connections 2023-05-10T04:19:23.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f604006ace0 0x7f604006d190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f605c15cfe0 0x7f605c15d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6048004d90 0x7f605c15aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 --2- 172.21.15.132:0/89571913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f605c155bc0 0x7f605c1553b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.740+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 >> 172.21.15.132:0/89571913 conn(0x7f605c0cf720 msgr2=0x7f605c072d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:23.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.741+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 shutdown_connections 2023-05-10T04:19:23.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.741+0000 7f60641ff700 1 -- 172.21.15.132:0/89571913 wait complete. 2023-05-10T04:19:23.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:19:23.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.945+0000 7f233d5ff700 1 Processor -- start 2023-05-10T04:19:23.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.945+0000 7f233d5ff700 1 -- start start 2023-05-10T04:19:23.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f233d5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f23380b87a0 0x7f23380cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f233d5ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380cdc60 con 0x7f2338160d40 2023-05-10T04:19:23.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f233d5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23380cd6a0 con 0x7f23381601e0 2023-05-10T04:19:23.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f233d5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23380d02d0 con 0x7f23380b87a0 2023-05-10T04:19:23.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f23377fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2338160d40 0x7f23380d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59282/0 (socket says 172.21.15.132:59282) 2023-05-10T04:19:23.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f23377fe700 1 -- 172.21.15.132:0/1744823900 learned_addr learned my addr 172.21.15.132:0/1744823900 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f2336ffd700 1 --2- 172.21.15.132:0/1744823900 >> v2:172.21.15.154:3300/0 conn(0x7f23380b87a0 0x7f23380cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f23367fc700 1 -- 172.21.15.132:0/1744823900 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4201519717 0 0) 0x7f23380cdc60 con 0x7f2338160d40 2023-05-10T04:19:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.947+0000 7f23367fc700 1 -- 172.21.15.132:0/1744823900 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23240035b0 con 0x7f2338160d40 2023-05-10T04:19:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f23367fc700 1 -- 172.21.15.132:0/1744823900 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1240984555 0 0) 0x7f23380cd6a0 con 0x7f23381601e0 2023-05-10T04:19:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f23367fc700 1 -- 172.21.15.132:0/1744823900 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23380cdc60 con 0x7f23381601e0 2023-05-10T04:19:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f2336ffd700 1 -- 172.21.15.132:0/1744823900 >> v1:172.21.15.154:6789/0 conn(0x7f23381601e0 legacy=0x7f2338160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f2336ffd700 1 -- 172.21.15.132:0/1744823900 >> v1:172.21.15.132:6789/0 conn(0x7f2338160d40 legacy=0x7f23380d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f2336ffd700 1 -- 172.21.15.132:0/1744823900 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380cd980 con 0x7f23380b87a0 2023-05-10T04:19:23.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f2336ffd700 1 --2- 172.21.15.132:0/1744823900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 0x7f23380cfbf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2328009840 tx=0x7f2328009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d567e1dbd8a2e6b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f23367fc700 1 -- 172.21.15.132:0/1744823900 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328011830 con 0x7f23380b87a0 2023-05-10T04:19:23.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f23367fc700 1 -- 172.21.15.132:0/1744823900 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2328011990 con 0x7f23380b87a0 2023-05-10T04:19:23.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.948+0000 7f23367fc700 1 -- 172.21.15.132:0/1744823900 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328011d20 con 0x7f23380b87a0 2023-05-10T04:19:23.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.949+0000 7f233d5ff700 1 -- 172.21.15.132:0/1744823900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 msgr2=0x7f23380cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.949+0000 7f233d5ff700 1 --2- 172.21.15.132:0/1744823900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 0x7f23380cfbf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2328009840 tx=0x7f2328009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:23.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.949+0000 7f233d5ff700 1 -- 172.21.15.132:0/1744823900 shutdown_connections 2023-05-10T04:19:23.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.949+0000 7f233d5ff700 1 --2- 172.21.15.132:0/1744823900 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 0x7f23380cfbf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.949+0000 7f233d5ff700 1 -- 172.21.15.132:0/1744823900 >> 172.21.15.132:0/1744823900 conn(0x7f2338071b10 msgr2=0x7f2338071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:23.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.949+0000 7f233d5ff700 1 -- 172.21.15.132:0/1744823900 shutdown_connections 2023-05-10T04:19:23.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.949+0000 7f233d5ff700 1 -- 172.21.15.132:0/1744823900 wait complete. 2023-05-10T04:19:23.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.951+0000 7f233d5ff700 1 Processor -- start 2023-05-10T04:19:23.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.951+0000 7f233d5ff700 1 -- start start 2023-05-10T04:19:23.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f233d5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 0x7f23380cc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f233d5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23381601e0 0x7f2338154920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f233d5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2338160d40 0x7f23380c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f233d5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23381f6830 con 0x7f23381601e0 2023-05-10T04:19:23.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f233d5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c69c0 con 0x7f23380b87a0 2023-05-10T04:19:23.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f233d5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c6ca0 con 0x7f2338160d40 2023-05-10T04:19:23.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f232ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23381601e0 0x7f2338154920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f2336ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 0x7f23380cc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f23377fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2338160d40 0x7f23380c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f232ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23381601e0 0x7f2338154920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51306/0 (socket says 172.21.15.132:51306) 2023-05-10T04:19:23.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f2336ffd700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 0x7f23380cc990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:49564/0 (socket says 172.21.15.132:49564) 2023-05-10T04:19:23.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f232ffff700 1 -- 172.21.15.132:0/3863354447 learned_addr learned my addr 172.21.15.132:0/3863354447 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:23.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f232ffff700 1 -- 172.21.15.132:0/3863354447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2338160d40 msgr2=0x7f23380c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f232ffff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2338160d40 0x7f23380c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f232ffff700 1 -- 172.21.15.132:0/3863354447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 msgr2=0x7f23380cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:23.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f232ffff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 0x7f23380cc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:23.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.952+0000 7f232ffff700 1 -- 172.21.15.132:0/3863354447 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23280094a0 con 0x7f23381601e0 2023-05-10T04:19:23.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.953+0000 7f232ffff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23381601e0 0x7f2338154920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f232000c520 tx=0x7f232000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.953+0000 7f232f7fe700 1 -- 172.21.15.132:0/3863354447 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200052d0 con 0x7f23381601e0 2023-05-10T04:19:23.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.953+0000 7f232f7fe700 1 -- 172.21.15.132:0/3863354447 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2320005430 con 0x7f23381601e0 2023-05-10T04:19:23.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.953+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23380d19a0 con 0x7f23381601e0 2023-05-10T04:19:23.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.953+0000 7f232f7fe700 1 -- 172.21.15.132:0/3863354447 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23200038c0 con 0x7f23381601e0 2023-05-10T04:19:23.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.953+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23380d1810 con 0x7f23381601e0 2023-05-10T04:19:23.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.954+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23380d1b30 con 0x7f23381601e0 2023-05-10T04:19:23.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.955+0000 7f232f7fe700 1 -- 172.21.15.132:0/3863354447 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2320003a20 con 0x7f23381601e0 2023-05-10T04:19:23.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.956+0000 7f232f7fe700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f231806ace0 0x7f231806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:23.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.956+0000 7f232f7fe700 1 -- 172.21.15.132:0/3863354447 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2320088cf0 con 0x7f23381601e0 2023-05-10T04:19:23.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.956+0000 7f2336ffd700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f231806ace0 0x7f231806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:23.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.957+0000 7f2336ffd700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f231806ace0 0x7f231806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2328009fd0 tx=0x7f232801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:23.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:23.960+0000 7f232f7fe700 1 -- 172.21.15.132:0/3863354447 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2320053990 con 0x7f23381601e0 2023-05-10T04:19:24.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.155+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23380b7d60 con 0x7f23381601e0 2023-05-10T04:19:24.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.156+0000 7f232f7fe700 1 -- 172.21.15.132:0/3863354447 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2320056fb0 con 0x7f23381601e0 2023-05-10T04:19:24.158 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:19:24.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f231806ace0 msgr2=0x7f231806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f231806ace0 0x7f231806d190 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2328009fd0 tx=0x7f232801c040 comp rx=0 tx=0).stop 2023-05-10T04:19:24.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23381601e0 msgr2=0x7f2338154920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23381601e0 0x7f2338154920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f232000c520 tx=0x7f232000c830 comp rx=0 tx=0).stop 2023-05-10T04:19:24.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 shutdown_connections 2023-05-10T04:19:24.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f231806ace0 0x7f231806d190 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2338160d40 0x7f23380c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f23380b87a0 0x7f23380cc990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 --2- 172.21.15.132:0/3863354447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23381601e0 0x7f2338154920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 >> 172.21.15.132:0/3863354447 conn(0x7f2338071b10 msgr2=0x7f2338071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:24.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 shutdown_connections 2023-05-10T04:19:24.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.158+0000 7f233d5ff700 1 -- 172.21.15.132:0/3863354447 wait complete. 2023-05-10T04:19:24.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:19:24.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.363+0000 7f0f8d9ff700 1 Processor -- start 2023-05-10T04:19:24.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.363+0000 7f0f8d9ff700 1 -- start start 2023-05-10T04:19:24.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.364+0000 7f0f8d9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f880b87a0 0x7f0f880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.364+0000 7f0f8d9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f88160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.364+0000 7f0f8d9ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f88160b70 0x7f0f880d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f8d9ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f880d02d0 con 0x7f0f88160b70 2023-05-10T04:19:24.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f8d9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f880d0cb0 con 0x7f0f880b87a0 2023-05-10T04:19:24.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f8d9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880b2730 con 0x7f0f881601e0 2023-05-10T04:19:24.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f88160b70 0x7f0f880d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f88160b70 0x7f0f880d2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51314/0 (socket says 172.21.15.132:51314) 2023-05-10T04:19:24.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 -- 172.21.15.132:0/2121425487 learned_addr learned my addr 172.21.15.132:0/2121425487 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:24.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f867fc700 1 --2- 172.21.15.132:0/2121425487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f88160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f86ffd700 1 --2- 172.21.15.132:0/2121425487 >> v2:172.21.15.154:3300/0 conn(0x7f0f880b87a0 0x7f0f880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 -- 172.21.15.132:0/2121425487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 msgr2=0x7f0f88160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:24.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 --2- 172.21.15.132:0/2121425487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f88160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 -- 172.21.15.132:0/2121425487 >> v2:172.21.15.154:3300/0 conn(0x7f0f880b87a0 msgr2=0x7f0f880cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:24.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 --2- 172.21.15.132:0/2121425487 >> v2:172.21.15.154:3300/0 conn(0x7f0f880b87a0 0x7f0f880cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 -- 172.21.15.132:0/2121425487 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f88160ff0 con 0x7f0f88160b70 2023-05-10T04:19:24.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f867fc700 1 --2- 172.21.15.132:0/2121425487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f88160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:24.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f86ffd700 1 --2- 172.21.15.132:0/2121425487 >> v2:172.21.15.154:3300/0 conn(0x7f0f880b87a0 0x7f0f880cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:24.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.365+0000 7f0f877fe700 1 --2- 172.21.15.132:0/2121425487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f880d2de0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f880b4ac0 tx=0x7f0f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35fb25121e91a7df server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:24.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f85ffb700 1 -- 172.21.15.132:0/2121425487 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000e070 con 0x7f0f88160b70 2023-05-10T04:19:24.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f85ffb700 1 -- 172.21.15.132:0/2121425487 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8000b9c0 con 0x7f0f88160b70 2023-05-10T04:19:24.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f85ffb700 1 -- 172.21.15.132:0/2121425487 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000bd70 con 0x7f0f88160b70 2023-05-10T04:19:24.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/2121425487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 msgr2=0x7f0f880d2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/2121425487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f880d2de0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0f880b4ac0 tx=0x7f0f8000b330 comp rx=0 tx=0).stop 2023-05-10T04:19:24.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/2121425487 shutdown_connections 2023-05-10T04:19:24.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/2121425487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f880d2de0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/2121425487 >> v2:172.21.15.154:3300/0 conn(0x7f0f880b87a0 0x7f0f880cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/2121425487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f88160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/2121425487 >> 172.21.15.132:0/2121425487 conn(0x7f0f88071b10 msgr2=0x7f0f88071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:24.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/2121425487 shutdown_connections 2023-05-10T04:19:24.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.366+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/2121425487 wait complete. 2023-05-10T04:19:24.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.368+0000 7f0f8d9ff700 1 Processor -- start 2023-05-10T04:19:24.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.368+0000 7f0f8d9ff700 1 -- start start 2023-05-10T04:19:24.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f8d9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880b87a0 0x7f0f88150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f8d9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f881570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f8d9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f88157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f8d9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880c6e00 con 0x7f0f88160b70 2023-05-10T04:19:24.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f8d9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88150db0 con 0x7f0f880b87a0 2023-05-10T04:19:24.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f8d9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f88159160 con 0x7f0f881601e0 2023-05-10T04:19:24.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f877fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f88157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f877fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f88157630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51320/0 (socket says 172.21.15.132:51320) 2023-05-10T04:19:24.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f877fe700 1 -- 172.21.15.132:0/200246729 learned_addr learned my addr 172.21.15.132:0/200246729 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:24.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.369+0000 7f0f86ffd700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880b87a0 0x7f0f88150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f867fc700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f881570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f877fe700 1 -- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 msgr2=0x7f0f881570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f877fe700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f881570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f877fe700 1 -- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880b87a0 msgr2=0x7f0f88150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f877fe700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880b87a0 0x7f0f88150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f877fe700 1 -- 172.21.15.132:0/200246729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f80009b30 con 0x7f0f88160b70 2023-05-10T04:19:24.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f86ffd700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880b87a0 0x7f0f88150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:24.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f877fe700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f88157630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000b730 tx=0x7f0f80004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:24.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f6ffff700 1 -- 172.21.15.132:0/200246729 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800099b0 con 0x7f0f88160b70 2023-05-10T04:19:24.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f6ffff700 1 -- 172.21.15.132:0/200246729 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f80004250 con 0x7f0f88160b70 2023-05-10T04:19:24.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f880cd6a0 con 0x7f0f88160b70 2023-05-10T04:19:24.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.370+0000 7f0f6ffff700 1 -- 172.21.15.132:0/200246729 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80004600 con 0x7f0f88160b70 2023-05-10T04:19:24.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.371+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f880cdc60 con 0x7f0f88160b70 2023-05-10T04:19:24.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.371+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f880cd980 con 0x7f0f88160b70 2023-05-10T04:19:24.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.372+0000 7f0f6ffff700 1 -- 172.21.15.132:0/200246729 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f80004760 con 0x7f0f88160b70 2023-05-10T04:19:24.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.373+0000 7f0f6ffff700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.373+0000 7f0f6ffff700 1 -- 172.21.15.132:0/200246729 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f8008ab60 con 0x7f0f88160b70 2023-05-10T04:19:24.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.374+0000 7f0f86ffd700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.374+0000 7f0f86ffd700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7406ace0 0x7f0f7406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f78004630 tx=0x7f0f78008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:24.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.377+0000 7f0f6ffff700 1 -- 172.21.15.132:0/200246729 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0f80055910 con 0x7f0f88160b70 2023-05-10T04:19:24.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.576+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f880c6f40 con 0x7f0f88160b70 2023-05-10T04:19:24.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.576+0000 7f0f6ffff700 1 -- 172.21.15.132:0/200246729 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f880c6f40 con 0x7f0f88160b70 2023-05-10T04:19:24.578 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:19:24.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7406ace0 msgr2=0x7f0f7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7406ace0 0x7f0f7406d190 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f78004630 tx=0x7f0f78008040 comp rx=0 tx=0).stop 2023-05-10T04:19:24.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 msgr2=0x7f0f88157630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f88157630 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0f8000b730 tx=0x7f0f80004ad0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 shutdown_connections 2023-05-10T04:19:24.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7406ace0 0x7f0f7406d190 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f88160b70 0x7f0f88157630 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f880b87a0 0x7f0f88150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 --2- 172.21.15.132:0/200246729 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f881601e0 0x7f0f881570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.578+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 >> 172.21.15.132:0/200246729 conn(0x7f0f88071b10 msgr2=0x7f0f880b3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:24.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.579+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 shutdown_connections 2023-05-10T04:19:24.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.579+0000 7f0f8d9ff700 1 -- 172.21.15.132:0/200246729 wait complete. 2023-05-10T04:19:24.598 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:19:24.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.783+0000 7fec809ff700 1 Processor -- start 2023-05-10T04:19:24.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.783+0000 7fec809ff700 1 -- start start 2023-05-10T04:19:24.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec809ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c0b87a0 0x7fec7c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec809ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec7c1601e0 0x7fec7c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec809ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec7c160ff0 con 0x7fec7c160b70 2023-05-10T04:19:24.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec809ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec7c0d02d0 con 0x7fec7c1601e0 2023-05-10T04:19:24.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec809ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0d0cb0 con 0x7fec7c0b87a0 2023-05-10T04:19:24.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec73fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec7c1601e0 0x7fec7c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec73fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec7c1601e0 0x7fec7c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51330/0 (socket says 172.21.15.132:51330) 2023-05-10T04:19:24.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec73fff700 1 -- 172.21.15.132:0/448431736 learned_addr learned my addr 172.21.15.132:0/448431736 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:24.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.784+0000 7fec7a59c700 1 --2- 172.21.15.132:0/448431736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c0b87a0 0x7fec7c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.785+0000 7fec73fff700 1 -- 172.21.15.132:0/448431736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c0b87a0 msgr2=0x7fec7c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.785+0000 7fec73fff700 1 --2- 172.21.15.132:0/448431736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c0b87a0 0x7fec7c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.785+0000 7fec73fff700 1 -- 172.21.15.132:0/448431736 >> v1:172.21.15.154:6789/0 conn(0x7fec7c160b70 legacy=0x7fec7c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.785+0000 7fec73fff700 1 -- 172.21.15.132:0/448431736 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0cdc60 con 0x7fec7c1601e0 2023-05-10T04:19:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.785+0000 7fec73fff700 1 --2- 172.21.15.132:0/448431736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c1601e0 0x7fec7c160630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec640098f0 tx=0x7fec64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c638621a29cdaf server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.785+0000 7fec79d9b700 1 -- 172.21.15.132:0/448431736 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64011830 con 0x7fec7c1601e0 2023-05-10T04:19:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.785+0000 7fec79d9b700 1 -- 172.21.15.132:0/448431736 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec64011990 con 0x7fec7c1601e0 2023-05-10T04:19:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.785+0000 7fec79d9b700 1 -- 172.21.15.132:0/448431736 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec64011d20 con 0x7fec7c1601e0 2023-05-10T04:19:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.786+0000 7fec809ff700 1 -- 172.21.15.132:0/448431736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c1601e0 msgr2=0x7fec7c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.786+0000 7fec809ff700 1 --2- 172.21.15.132:0/448431736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c1601e0 0x7fec7c160630 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fec640098f0 tx=0x7fec64009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.786+0000 7fec809ff700 1 -- 172.21.15.132:0/448431736 shutdown_connections 2023-05-10T04:19:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.786+0000 7fec809ff700 1 --2- 172.21.15.132:0/448431736 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c0b87a0 0x7fec7c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.786+0000 7fec809ff700 1 --2- 172.21.15.132:0/448431736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c1601e0 0x7fec7c160630 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.786+0000 7fec809ff700 1 -- 172.21.15.132:0/448431736 >> 172.21.15.132:0/448431736 conn(0x7fec7c071b10 msgr2=0x7fec7c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.786+0000 7fec809ff700 1 -- 172.21.15.132:0/448431736 shutdown_connections 2023-05-10T04:19:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.786+0000 7fec809ff700 1 -- 172.21.15.132:0/448431736 wait complete. 2023-05-10T04:19:24.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.788+0000 7fec809ff700 1 Processor -- start 2023-05-10T04:19:24.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.788+0000 7fec809ff700 1 -- start start 2023-05-10T04:19:24.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec809ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0b87a0 0x7fec7c151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec809ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c1601e0 0x7fec7c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec809ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c160b70 0x7fec7c0cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec809ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c14ac00 con 0x7fec7c0b87a0 2023-05-10T04:19:24.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec809ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c15a6a0 con 0x7fec7c1601e0 2023-05-10T04:19:24.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec809ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c0cb9c0 con 0x7fec7c160b70 2023-05-10T04:19:24.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7a59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0b87a0 0x7fec7c151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7a59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0b87a0 0x7fec7c151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51342/0 (socket says 172.21.15.132:51342) 2023-05-10T04:19:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7a59c700 1 -- 172.21.15.132:0/3451334270 learned_addr learned my addr 172.21.15.132:0/3451334270 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7ad9d700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c160b70 0x7fec7c0cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec73fff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c1601e0 0x7fec7c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7a59c700 1 -- 172.21.15.132:0/3451334270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c160b70 msgr2=0x7fec7c0cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7a59c700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c160b70 0x7fec7c0cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7a59c700 1 -- 172.21.15.132:0/3451334270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c1601e0 msgr2=0x7fec7c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7a59c700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c1601e0 0x7fec7c15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.789+0000 7fec7a59c700 1 -- 172.21.15.132:0/3451334270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec64009550 con 0x7fec7c0b87a0 2023-05-10T04:19:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.790+0000 7fec7a59c700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0b87a0 0x7fec7c151890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00e9b0 tx=0x7fec6c00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.790+0000 7fec72ffd700 1 -- 172.21.15.132:0/3451334270 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c009710 con 0x7fec7c0b87a0 2023-05-10T04:19:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.790+0000 7fec72ffd700 1 -- 172.21.15.132:0/3451334270 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec6c00ee50 con 0x7fec7c0b87a0 2023-05-10T04:19:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.790+0000 7fec72ffd700 1 -- 172.21.15.132:0/3451334270 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6c00ca50 con 0x7fec7c0b87a0 2023-05-10T04:19:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.790+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7c0cd980 con 0x7fec7c0b87a0 2023-05-10T04:19:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.790+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec7c0cd6a0 con 0x7fec7c0b87a0 2023-05-10T04:19:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.791+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7c0d2110 con 0x7fec7c0b87a0 2023-05-10T04:19:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.792+0000 7fec72ffd700 1 -- 172.21.15.132:0/3451334270 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec6c00cbb0 con 0x7fec7c0b87a0 2023-05-10T04:19:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.793+0000 7fec72ffd700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec5c06ace0 0x7fec5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.793+0000 7fec72ffd700 1 -- 172.21.15.132:0/3451334270 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec6c089770 con 0x7fec7c0b87a0 2023-05-10T04:19:24.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.793+0000 7fec73fff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec5c06ace0 0x7fec5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:24.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.794+0000 7fec73fff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec5c06ace0 0x7fec5c06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec64009c40 tx=0x7fec64008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:24.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.797+0000 7fec72ffd700 1 -- 172.21.15.132:0/3451334270 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fec6c057fb0 con 0x7fec7c0b87a0 2023-05-10T04:19:24.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.992+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec7c0ccb50 con 0x7fec7c0b87a0 2023-05-10T04:19:24.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.992+0000 7fec72ffd700 1 -- 172.21.15.132:0/3451334270 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fec6c00ce60 con 0x7fec7c0b87a0 2023-05-10T04:19:24.994 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:19:24.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec5c06ace0 msgr2=0x7fec5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec5c06ace0 0x7fec5c06d190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec64009c40 tx=0x7fec64008030 comp rx=0 tx=0).stop 2023-05-10T04:19:24.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0b87a0 msgr2=0x7fec7c151890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:24.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0b87a0 0x7fec7c151890 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fec6c00e9b0 tx=0x7fec6c00ecc0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 shutdown_connections 2023-05-10T04:19:24.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec5c06ace0 0x7fec5c06d190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec7c160b70 0x7fec7c0cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0b87a0 0x7fec7c151890 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 --2- 172.21.15.132:0/3451334270 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec7c1601e0 0x7fec7c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:24.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 >> 172.21.15.132:0/3451334270 conn(0x7fec7c071b10 msgr2=0x7fec7c0b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:24.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 shutdown_connections 2023-05-10T04:19:24.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:24.995+0000 7fec809ff700 1 -- 172.21.15.132:0/3451334270 wait complete. 2023-05-10T04:19:25.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:19:25.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.195+0000 7f6a695ff700 1 Processor -- start 2023-05-10T04:19:25.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.195+0000 7f6a695ff700 1 -- start start 2023-05-10T04:19:25.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a695ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a640cfbf0 0x7f6a641608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a695ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640d1100 0x7f6a640d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a695ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a640d0020 con 0x7f6a640b87a0 2023-05-10T04:19:25.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a695ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a640d02d0 con 0x7f6a640cfbf0 2023-05-10T04:19:25.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a695ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640d0cb0 con 0x7f6a640d1100 2023-05-10T04:19:25.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a5bfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a640cfbf0 0x7f6a641608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a62ffd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6a640b87a0 0x7f6a641601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59294/0 (socket says 172.21.15.132:59294) 2023-05-10T04:19:25.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a62ffd700 1 -- 172.21.15.132:0/1744286602 learned_addr learned my addr 172.21.15.132:0/1744286602 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:25.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a637fe700 1 --2- 172.21.15.132:0/1744286602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640d1100 0x7f6a640d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a5bfff700 1 -- 172.21.15.132:0/1744286602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640d1100 msgr2=0x7f6a640d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:25.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a5bfff700 1 --2- 172.21.15.132:0/1744286602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640d1100 0x7f6a640d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a5bfff700 1 -- 172.21.15.132:0/1744286602 >> v1:172.21.15.132:6789/0 conn(0x7f6a640b87a0 legacy=0x7f6a641601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a627fc700 1 -- 172.21.15.132:0/1744286602 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379458750 0 0) 0x7f6a640d0020 con 0x7f6a640b87a0 2023-05-10T04:19:25.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a5bfff700 1 -- 172.21.15.132:0/1744286602 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a640cdc60 con 0x7f6a640cfbf0 2023-05-10T04:19:25.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.197+0000 7f6a637fe700 1 --2- 172.21.15.132:0/1744286602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640d1100 0x7f6a640d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:25.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.198+0000 7f6a5bfff700 1 --2- 172.21.15.132:0/1744286602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640cfbf0 0x7f6a641608f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009840 tx=0x7f6a4c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=191100d17255cc6c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:25.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.198+0000 7f6a627fc700 1 -- 172.21.15.132:0/1744286602 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011830 con 0x7f6a640cfbf0 2023-05-10T04:19:25.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.198+0000 7f6a627fc700 1 -- 172.21.15.132:0/1744286602 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4c011990 con 0x7f6a640cfbf0 2023-05-10T04:19:25.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.198+0000 7f6a627fc700 1 -- 172.21.15.132:0/1744286602 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4c011d20 con 0x7f6a640cfbf0 2023-05-10T04:19:25.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.198+0000 7f6a695ff700 1 -- 172.21.15.132:0/1744286602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640cfbf0 msgr2=0x7f6a641608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.198+0000 7f6a695ff700 1 --2- 172.21.15.132:0/1744286602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640cfbf0 0x7f6a641608f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c009840 tx=0x7f6a4c009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:25.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.198+0000 7f6a695ff700 1 -- 172.21.15.132:0/1744286602 shutdown_connections 2023-05-10T04:19:25.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.199+0000 7f6a695ff700 1 --2- 172.21.15.132:0/1744286602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640d1100 0x7f6a640d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.199+0000 7f6a695ff700 1 --2- 172.21.15.132:0/1744286602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640cfbf0 0x7f6a641608f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.199+0000 7f6a695ff700 1 -- 172.21.15.132:0/1744286602 >> 172.21.15.132:0/1744286602 conn(0x7f6a64071b10 msgr2=0x7f6a64071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:25.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.199+0000 7f6a695ff700 1 -- 172.21.15.132:0/1744286602 shutdown_connections 2023-05-10T04:19:25.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.199+0000 7f6a695ff700 1 -- 172.21.15.132:0/1744286602 wait complete. 2023-05-10T04:19:25.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.200+0000 7f6a695ff700 1 Processor -- start 2023-05-10T04:19:25.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.200+0000 7f6a695ff700 1 -- start start 2023-05-10T04:19:25.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.201+0000 7f6a695ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640b87a0 0x7f6a64159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.201+0000 7f6a695ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a640cfbf0 0x7f6a641f2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.201+0000 7f6a695ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640d1100 0x7f6a640ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.201+0000 7f6a695ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641f2ed0 con 0x7f6a640d1100 2023-05-10T04:19:25.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.201+0000 7f6a695ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641ef9a0 con 0x7f6a640cfbf0 2023-05-10T04:19:25.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.201+0000 7f6a695ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640cc4f0 con 0x7f6a640b87a0 2023-05-10T04:19:25.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.201+0000 7f6a637fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640d1100 0x7f6a640ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.201+0000 7f6a637fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640d1100 0x7f6a640ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51364/0 (socket says 172.21.15.132:51364) 2023-05-10T04:19:25.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a637fe700 1 -- 172.21.15.132:0/2441829466 learned_addr learned my addr 172.21.15.132:0/2441829466 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:25.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a62ffd700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640b87a0 0x7f6a64159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a5bfff700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a640cfbf0 0x7f6a641f2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a637fe700 1 -- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640b87a0 msgr2=0x7f6a64159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a637fe700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640b87a0 0x7f6a64159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a637fe700 1 -- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a640cfbf0 msgr2=0x7f6a641f2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a637fe700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a640cfbf0 0x7f6a641f2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a637fe700 1 -- 172.21.15.132:0/2441829466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0094a0 con 0x7f6a640d1100 2023-05-10T04:19:25.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a62ffd700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640b87a0 0x7f6a64159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:25.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a637fe700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640d1100 0x7f6a640ca0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00cef0 tx=0x7f6a5c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:25.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a5b7fe700 1 -- 172.21.15.132:0/2441829466 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c00adb0 con 0x7f6a640d1100 2023-05-10T04:19:25.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a5b7fe700 1 -- 172.21.15.132:0/2441829466 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a5c015440 con 0x7f6a640d1100 2023-05-10T04:19:25.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a5b7fe700 1 -- 172.21.15.132:0/2441829466 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a5c0157f0 con 0x7f6a640d1100 2023-05-10T04:19:25.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.202+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a640cd980 con 0x7f6a640d1100 2023-05-10T04:19:25.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.203+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a640cd6a0 con 0x7f6a640d1100 2023-05-10T04:19:25.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.204+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a64160e30 con 0x7f6a640d1100 2023-05-10T04:19:25.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.204+0000 7f6a5b7fe700 1 -- 172.21.15.132:0/2441829466 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a5c00d430 con 0x7f6a640d1100 2023-05-10T04:19:25.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.206+0000 7f6a5b7fe700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6a4406ace0 0x7f6a4406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.206+0000 7f6a5b7fe700 1 -- 172.21.15.132:0/2441829466 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6a5c089ce0 con 0x7f6a640d1100 2023-05-10T04:19:25.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.206+0000 7f6a62ffd700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6a4406ace0 0x7f6a4406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.206+0000 7f6a62ffd700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6a4406ace0 0x7f6a4406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000f60 tx=0x7f6a54007d50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:25.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.210+0000 7f6a5b7fe700 1 -- 172.21.15.132:0/2441829466 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6a5c054a90 con 0x7f6a640d1100 2023-05-10T04:19:25.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.423+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6a64074430 con 0x7f6a640d1100 2023-05-10T04:19:25.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.423+0000 7f6a5b7fe700 1 -- 172.21.15.132:0/2441829466 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6a5c01a080 con 0x7f6a640d1100 2023-05-10T04:19:25.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.425+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6a4406ace0 msgr2=0x7f6a4406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.425+0000 7f6a695ff700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6a4406ace0 0x7f6a4406d190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6a54000f60 tx=0x7f6a54007d50 comp rx=0 tx=0).stop 2023-05-10T04:19:25.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.425+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640d1100 msgr2=0x7f6a640ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.425+0000 7f6a695ff700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640d1100 0x7f6a640ca0f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c00cef0 tx=0x7f6a5c00cf20 comp rx=0 tx=0).stop 2023-05-10T04:19:25.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.426+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 shutdown_connections 2023-05-10T04:19:25.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.426+0000 7f6a695ff700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6a4406ace0 0x7f6a4406d190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.426+0000 7f6a695ff700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a640d1100 0x7f6a640ca0f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.426+0000 7f6a695ff700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6a640b87a0 0x7f6a64159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.426+0000 7f6a695ff700 1 --2- 172.21.15.132:0/2441829466 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6a640cfbf0 0x7f6a641f2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.426+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 >> 172.21.15.132:0/2441829466 conn(0x7f6a64071b10 msgr2=0x7f6a64071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:25.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.426+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 shutdown_connections 2023-05-10T04:19:25.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.426+0000 7f6a695ff700 1 -- 172.21.15.132:0/2441829466 wait complete. 2023-05-10T04:19:25.429 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:19:25.445 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:19:25.445 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:19:25.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:25.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.706+0000 7f04967ff700 1 Processor -- start 2023-05-10T04:19:25.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.706+0000 7f04967ff700 1 -- start start 2023-05-10T04:19:25.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.707+0000 7f04967ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04900b87a0 0x7f04900cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.707+0000 7f04967ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04901601e0 0x7f0490160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.707+0000 7f04967ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0490160b70 0x7f04900d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.707+0000 7f04967ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04900d02d0 con 0x7f04901601e0 2023-05-10T04:19:25.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.707+0000 7f04967ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04900d0cb0 con 0x7f0490160b70 2023-05-10T04:19:25.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.707+0000 7f04967ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04900b2730 con 0x7f04900b87a0 2023-05-10T04:19:25.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04901601e0 0x7f0490160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04901601e0 0x7f0490160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51378/0 (socket says 172.21.15.132:51378) 2023-05-10T04:19:25.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 -- 172.21.15.132:0/1517402364 learned_addr learned my addr 172.21.15.132:0/1517402364 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:25.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0494d9c700 1 --2- 172.21.15.132:0/1517402364 >> v2:172.21.15.154:3300/0 conn(0x7f0490160b70 0x7f04900d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f048ffff700 1 --2- 172.21.15.132:0/1517402364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04900b87a0 0x7f04900cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 -- 172.21.15.132:0/1517402364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04900b87a0 msgr2=0x7f04900cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:25.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 --2- 172.21.15.132:0/1517402364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04900b87a0 0x7f04900cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 -- 172.21.15.132:0/1517402364 >> v2:172.21.15.154:3300/0 conn(0x7f0490160b70 msgr2=0x7f04900d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:25.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 --2- 172.21.15.132:0/1517402364 >> v2:172.21.15.154:3300/0 conn(0x7f0490160b70 0x7f04900d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 -- 172.21.15.132:0/1517402364 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0490160ff0 con 0x7f04901601e0 2023-05-10T04:19:25.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.708+0000 7f0487fff700 1 --2- 172.21.15.132:0/1517402364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04901601e0 0x7f0490160630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f049008be30 tx=0x7f0478009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e545bbfef8c422 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:25.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f048f7fe700 1 -- 172.21.15.132:0/1517402364 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047800b870 con 0x7f04901601e0 2023-05-10T04:19:25.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f048f7fe700 1 -- 172.21.15.132:0/1517402364 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047800b9d0 con 0x7f04901601e0 2023-05-10T04:19:25.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f048f7fe700 1 -- 172.21.15.132:0/1517402364 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047800bd60 con 0x7f04901601e0 2023-05-10T04:19:25.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 -- 172.21.15.132:0/1517402364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04901601e0 msgr2=0x7f0490160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 --2- 172.21.15.132:0/1517402364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04901601e0 0x7f0490160630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f049008be30 tx=0x7f0478009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 -- 172.21.15.132:0/1517402364 shutdown_connections 2023-05-10T04:19:25.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 --2- 172.21.15.132:0/1517402364 >> v2:172.21.15.154:3300/0 conn(0x7f0490160b70 0x7f04900d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 --2- 172.21.15.132:0/1517402364 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04900b87a0 0x7f04900cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 --2- 172.21.15.132:0/1517402364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04901601e0 0x7f0490160630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 -- 172.21.15.132:0/1517402364 >> 172.21.15.132:0/1517402364 conn(0x7f0490071b10 msgr2=0x7f0490071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:25.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 -- 172.21.15.132:0/1517402364 shutdown_connections 2023-05-10T04:19:25.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.709+0000 7f04967ff700 1 -- 172.21.15.132:0/1517402364 wait complete. 2023-05-10T04:19:25.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.711+0000 7f04967ff700 1 Processor -- start 2023-05-10T04:19:25.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.711+0000 7f04967ff700 1 -- start start 2023-05-10T04:19:25.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f04967ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04900b87a0 0x7f04901f33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f04967ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04901601e0 0x7f04900c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f04967ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0490160b70 0x7f04901513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f04967ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04901f3a60 con 0x7f04900b87a0 2023-05-10T04:19:25.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f04967ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04900c8ae0 con 0x7f0490160b70 2023-05-10T04:19:25.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f04967ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04901518e0 con 0x7f04901601e0 2023-05-10T04:19:25.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f048ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04900b87a0 0x7f04901f33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f048ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04900b87a0 0x7f04901f33e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51386/0 (socket says 172.21.15.132:51386) 2023-05-10T04:19:25.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f048ffff700 1 -- 172.21.15.132:0/1799734200 learned_addr learned my addr 172.21.15.132:0/1799734200 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:25.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f048ffff700 1 -- 172.21.15.132:0/1799734200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04901601e0 msgr2=0x7f04900c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f048ffff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04901601e0 0x7f04900c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f048ffff700 1 -- 172.21.15.132:0/1799734200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0490160b70 msgr2=0x7f04901513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f048ffff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0490160b70 0x7f04901513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.712+0000 7f048ffff700 1 -- 172.21.15.132:0/1799734200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0478009550 con 0x7f04900b87a0 2023-05-10T04:19:25.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.713+0000 7f048ffff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04900b87a0 0x7f04901f33e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f048000d800 tx=0x7f048000dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:25.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.713+0000 7f048d7fa700 1 -- 172.21.15.132:0/1799734200 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04800125f0 con 0x7f04900b87a0 2023-05-10T04:19:25.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.713+0000 7f048d7fa700 1 -- 172.21.15.132:0/1799734200 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0480012750 con 0x7f04900b87a0 2023-05-10T04:19:25.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.713+0000 7f048d7fa700 1 -- 172.21.15.132:0/1799734200 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0480012ae0 con 0x7f04900b87a0 2023-05-10T04:19:25.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.713+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04900cd6a0 con 0x7f04900b87a0 2023-05-10T04:19:25.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.713+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04900cdc60 con 0x7f04900b87a0 2023-05-10T04:19:25.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.714+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04900cd980 con 0x7f04900b87a0 2023-05-10T04:19:25.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.715+0000 7f048d7fa700 1 -- 172.21.15.132:0/1799734200 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0480012c40 con 0x7f04900b87a0 2023-05-10T04:19:25.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.716+0000 7f048d7fa700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f047006ace0 0x7f047006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:25.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.716+0000 7f048d7fa700 1 -- 172.21.15.132:0/1799734200 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0480089ab0 con 0x7f04900b87a0 2023-05-10T04:19:25.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.716+0000 7f0487fff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f047006ace0 0x7f047006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:25.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.717+0000 7f0487fff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f047006ace0 0x7f047006d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04901f5df0 tx=0x7f0478010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:25.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.720+0000 7f048d7fa700 1 -- 172.21.15.132:0/1799734200 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0480054860 con 0x7f04900b87a0 2023-05-10T04:19:25.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.918+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f049006d260 con 0x7f04900b87a0 2023-05-10T04:19:25.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.919+0000 7f048d7fa700 1 -- 172.21.15.132:0/1799734200 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f0480057e80 con 0x7f04900b87a0 2023-05-10T04:19:25.922 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:25.922 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:25.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f047006ace0 msgr2=0x7f047006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f047006ace0 0x7f047006d190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f04901f5df0 tx=0x7f0478010000 comp rx=0 tx=0).stop 2023-05-10T04:19:25.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04900b87a0 msgr2=0x7f04901f33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04900b87a0 0x7f04901f33e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f048000d800 tx=0x7f048000dbc0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 shutdown_connections 2023-05-10T04:19:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f047006ace0 0x7f047006d190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0490160b70 0x7f04901513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04900b87a0 0x7f04901f33e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 --2- 172.21.15.132:0/1799734200 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f04901601e0 0x7f04900c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 >> 172.21.15.132:0/1799734200 conn(0x7f0490071b10 msgr2=0x7f04900d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 shutdown_connections 2023-05-10T04:19:25.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:25.922+0000 7f04967ff700 1 -- 172.21.15.132:0/1799734200 wait complete. 2023-05-10T04:19:25.942 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:19:25.942 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:19:26.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.129+0000 7f48763ff700 1 Processor -- start 2023-05-10T04:19:26.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.129+0000 7f48763ff700 1 -- start start 2023-05-10T04:19:26.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.130+0000 7f48763ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f48700cf010 0x7f4870160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.130+0000 7f48763ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48700cff50 0x7f48700d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.130+0000 7f48763ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48700cd520 con 0x7f487015c590 2023-05-10T04:19:26.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.130+0000 7f48763ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48700d2640 con 0x7f48700cff50 2023-05-10T04:19:26.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.130+0000 7f48763ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48701610d0 con 0x7f48700cf010 2023-05-10T04:19:26.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f486ffff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f487015c590 0x7f48700cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59306/0 (socket says 172.21.15.132:59306) 2023-05-10T04:19:26.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f486ffff700 1 -- 172.21.15.132:0/109350354 learned_addr learned my addr 172.21.15.132:0/109350354 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:26.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f487499c700 1 --2- 172.21.15.132:0/109350354 >> v2:172.21.15.132:3300/0 conn(0x7f48700cff50 0x7f48700d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f4867fff700 1 --2- 172.21.15.132:0/109350354 >> v2:172.21.15.154:3300/0 conn(0x7f48700cf010 0x7f4870160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f486f7fe700 1 -- 172.21.15.132:0/109350354 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1042877047 0 0) 0x7f48700cd520 con 0x7f487015c590 2023-05-10T04:19:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f486f7fe700 1 -- 172.21.15.132:0/109350354 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f485c0035b0 con 0x7f487015c590 2023-05-10T04:19:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f487499c700 1 -- 172.21.15.132:0/109350354 >> v2:172.21.15.154:3300/0 conn(0x7f48700cf010 msgr2=0x7f4870160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f487499c700 1 --2- 172.21.15.132:0/109350354 >> v2:172.21.15.154:3300/0 conn(0x7f48700cf010 0x7f4870160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f487499c700 1 -- 172.21.15.132:0/109350354 >> v1:172.21.15.132:6789/0 conn(0x7f487015c590 legacy=0x7f48700cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.131+0000 7f487499c700 1 -- 172.21.15.132:0/109350354 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48700b23c0 con 0x7f48700cff50 2023-05-10T04:19:26.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f487499c700 1 --2- 172.21.15.132:0/109350354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f48700d2ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f48700b4ee0 tx=0x7f486800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b71dc00527e8982 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f486f7fe700 1 -- 172.21.15.132:0/109350354 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486800e070 con 0x7f48700cff50 2023-05-10T04:19:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f486f7fe700 1 -- 172.21.15.132:0/109350354 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486800bb20 con 0x7f48700cff50 2023-05-10T04:19:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f486f7fe700 1 -- 172.21.15.132:0/109350354 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4868012430 con 0x7f48700cff50 2023-05-10T04:19:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f48763ff700 1 -- 172.21.15.132:0/109350354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 msgr2=0x7f48700d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f48763ff700 1 --2- 172.21.15.132:0/109350354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f48700d2ad0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f48700b4ee0 tx=0x7f486800b330 comp rx=0 tx=0).stop 2023-05-10T04:19:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f48763ff700 1 -- 172.21.15.132:0/109350354 shutdown_connections 2023-05-10T04:19:26.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f48763ff700 1 --2- 172.21.15.132:0/109350354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f48700d2ad0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f48763ff700 1 --2- 172.21.15.132:0/109350354 >> v2:172.21.15.154:3300/0 conn(0x7f48700cf010 0x7f4870160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f48763ff700 1 -- 172.21.15.132:0/109350354 >> 172.21.15.132:0/109350354 conn(0x7f4870071b10 msgr2=0x7f4870071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:26.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f48763ff700 1 -- 172.21.15.132:0/109350354 shutdown_connections 2023-05-10T04:19:26.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.132+0000 7f48763ff700 1 -- 172.21.15.132:0/109350354 wait complete. 2023-05-10T04:19:26.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.134+0000 7f48763ff700 1 Processor -- start 2023-05-10T04:19:26.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.134+0000 7f48763ff700 1 -- start start 2023-05-10T04:19:26.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.135+0000 7f48763ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48700cf010 0x7f4870151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.135+0000 7f48763ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f487015e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.135+0000 7f48763ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f487015c590 0x7f487015ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.135+0000 7f48763ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48700b5d00 con 0x7f48700cff50 2023-05-10T04:19:26.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.135+0000 7f48763ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48700b5fe0 con 0x7f48700cf010 2023-05-10T04:19:26.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.135+0000 7f48763ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f487015d9e0 con 0x7f487015c590 2023-05-10T04:19:26.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.135+0000 7f4867fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f487015e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f4867fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f487015e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51402/0 (socket says 172.21.15.132:51402) 2023-05-10T04:19:26.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f4867fff700 1 -- 172.21.15.132:0/1748093189 learned_addr learned my addr 172.21.15.132:0/1748093189 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:26.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f486ffff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48700cf010 0x7f4870151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f487499c700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f487015c590 0x7f487015ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f4867fff700 1 -- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f487015c590 msgr2=0x7f487015ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f4867fff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f487015c590 0x7f487015ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f4867fff700 1 -- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48700cf010 msgr2=0x7f4870151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f4867fff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48700cf010 0x7f4870151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f4867fff700 1 -- 172.21.15.132:0/1748093189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4868009a70 con 0x7f48700cff50 2023-05-10T04:19:26.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f487499c700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f487015c590 0x7f487015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:26.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f4867fff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f487015e950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f485800e870 tx=0x7f485800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f486d7fa700 1 -- 172.21.15.132:0/1748093189 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4858009590 con 0x7f48700cff50 2023-05-10T04:19:26.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f486d7fa700 1 -- 172.21.15.132:0/1748093189 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4858013680 con 0x7f48700cff50 2023-05-10T04:19:26.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f486d7fa700 1 -- 172.21.15.132:0/1748093189 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580139f0 con 0x7f48700cff50 2023-05-10T04:19:26.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.136+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48700cd770 con 0x7f48700cff50 2023-05-10T04:19:26.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.137+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48700cf560 con 0x7f48700cff50 2023-05-10T04:19:26.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.138+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f487015c960 con 0x7f48700cff50 2023-05-10T04:19:26.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.139+0000 7f486d7fa700 1 -- 172.21.15.132:0/1748093189 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4858013b50 con 0x7f48700cff50 2023-05-10T04:19:26.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.140+0000 7f486d7fa700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f485006ace0 0x7f485006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.140+0000 7f486d7fa700 1 -- 172.21.15.132:0/1748093189 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48580895d0 con 0x7f48700cff50 2023-05-10T04:19:26.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.140+0000 7f486ffff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f485006ace0 0x7f485006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.140+0000 7f486ffff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f485006ace0 0x7f485006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4860007fd0 tx=0x7f4860007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.144+0000 7f486d7fa700 1 -- 172.21.15.132:0/1748093189 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4858054420 con 0x7f48700cff50 2023-05-10T04:19:26.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.340+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48700b6120 con 0x7f48700cff50 2023-05-10T04:19:26.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.340+0000 7f486d7fa700 1 -- 172.21.15.132:0/1748093189 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f48700b6120 con 0x7f48700cff50 2023-05-10T04:19:26.343 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:19:26.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f485006ace0 msgr2=0x7f485006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f485006ace0 0x7f485006d190 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4860007fd0 tx=0x7f4860007dc0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 msgr2=0x7f487015e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f487015e950 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f485800e870 tx=0x7f485800eb80 comp rx=0 tx=0).stop 2023-05-10T04:19:26.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 shutdown_connections 2023-05-10T04:19:26.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f485006ace0 0x7f485006d190 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f487015c590 0x7f487015ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f48700cf010 0x7f4870151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 --2- 172.21.15.132:0/1748093189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48700cff50 0x7f487015e950 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 >> 172.21.15.132:0/1748093189 conn(0x7f4870071b10 msgr2=0x7f48700b2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:26.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 shutdown_connections 2023-05-10T04:19:26.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.343+0000 7f48763ff700 1 -- 172.21.15.132:0/1748093189 wait complete. 2023-05-10T04:19:26.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:19:26.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.549+0000 7f9673fff700 1 Processor -- start 2023-05-10T04:19:26.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.549+0000 7f9673fff700 1 -- start start 2023-05-10T04:19:26.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.550+0000 7f9673fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 0x7f966c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.550+0000 7f9673fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f966c160d40 0x7f966c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.550+0000 7f9673fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f966c0cdc60 con 0x7f966c1601e0 2023-05-10T04:19:26.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.550+0000 7f9673fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f966c0d02d0 con 0x7f966c160d40 2023-05-10T04:19:26.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.550+0000 7f9673fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0d0cb0 con 0x7f966c0b87a0 2023-05-10T04:19:26.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f967259c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f966c160d40 0x7f966c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f967259c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f966c160d40 0x7f966c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51416/0 (socket says 172.21.15.132:51416) 2023-05-10T04:19:26.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f9671d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 0x7f966c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f967259c700 1 -- 172.21.15.132:0/2406388132 learned_addr learned my addr 172.21.15.132:0/2406388132 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:26.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f967259c700 1 -- 172.21.15.132:0/2406388132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 msgr2=0x7f966c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:26.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f967259c700 1 --2- 172.21.15.132:0/2406388132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 0x7f966c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f967259c700 1 -- 172.21.15.132:0/2406388132 >> v1:172.21.15.154:6789/0 conn(0x7f966c1601e0 legacy=0x7f966c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f967259c700 1 -- 172.21.15.132:0/2406388132 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f966c0cd6a0 con 0x7f966c160d40 2023-05-10T04:19:26.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f9670d99700 1 -- 172.21.15.132:0/2406388132 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592151284 0 0) 0x7f966c0cdc60 con 0x7f966c1601e0 2023-05-10T04:19:26.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.551+0000 7f967259c700 1 --2- 172.21.15.132:0/2406388132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c160d40 0x7f966c0d1100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9664009e50 tx=0x7f966400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4be88db3f1ea88a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9670d99700 1 -- 172.21.15.132:0/2406388132 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400e070 con 0x7f966c160d40 2023-05-10T04:19:26.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9670d99700 1 -- 172.21.15.132:0/2406388132 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f966400b910 con 0x7f966c160d40 2023-05-10T04:19:26.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9670d99700 1 -- 172.21.15.132:0/2406388132 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f966400bcc0 con 0x7f966c160d40 2023-05-10T04:19:26.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9673fff700 1 -- 172.21.15.132:0/2406388132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c160d40 msgr2=0x7f966c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9673fff700 1 --2- 172.21.15.132:0/2406388132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c160d40 0x7f966c0d1100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9664009e50 tx=0x7f966400b330 comp rx=0 tx=0).stop 2023-05-10T04:19:26.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9673fff700 1 -- 172.21.15.132:0/2406388132 shutdown_connections 2023-05-10T04:19:26.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9673fff700 1 --2- 172.21.15.132:0/2406388132 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 0x7f966c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9673fff700 1 --2- 172.21.15.132:0/2406388132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c160d40 0x7f966c0d1100 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9673fff700 1 -- 172.21.15.132:0/2406388132 >> 172.21.15.132:0/2406388132 conn(0x7f966c071b10 msgr2=0x7f966c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:26.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9673fff700 1 -- 172.21.15.132:0/2406388132 shutdown_connections 2023-05-10T04:19:26.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.552+0000 7f9673fff700 1 -- 172.21.15.132:0/2406388132 wait complete. 2023-05-10T04:19:26.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.554+0000 7f9673fff700 1 Processor -- start 2023-05-10T04:19:26.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.554+0000 7f9673fff700 1 -- start start 2023-05-10T04:19:26.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f9673fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 0x7f966c152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f9673fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c1601e0 0x7f966c1e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f9673fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f966c160d40 0x7f966c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f9673fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c0c7da0 con 0x7f966c1601e0 2023-05-10T04:19:26.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f9673fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f966c1e7470 con 0x7f966c160d40 2023-05-10T04:19:26.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f9673fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f966c1e7750 con 0x7f966c0b87a0 2023-05-10T04:19:26.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f967159a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c1601e0 0x7f966c1e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f967159a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c1601e0 0x7f966c1e69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51420/0 (socket says 172.21.15.132:51420) 2023-05-10T04:19:26.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f967159a700 1 -- 172.21.15.132:0/2231117295 learned_addr learned my addr 172.21.15.132:0/2231117295 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:26.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f9671d9b700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 0x7f966c152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.555+0000 7f967259c700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f966c160d40 0x7f966c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f967159a700 1 -- 172.21.15.132:0/2231117295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 msgr2=0x7f966c152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f967159a700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 0x7f966c152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f967159a700 1 -- 172.21.15.132:0/2231117295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f966c160d40 msgr2=0x7f966c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f967159a700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f966c160d40 0x7f966c15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f967159a700 1 -- 172.21.15.132:0/2231117295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9664009b30 con 0x7f966c1601e0 2023-05-10T04:19:26.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f967159a700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c1601e0 0x7f966c1e69f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f965c0011e0 tx=0x7f965c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f96627fc700 1 -- 172.21.15.132:0/2231117295 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c0054e0 con 0x7f966c1601e0 2023-05-10T04:19:26.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f96627fc700 1 -- 172.21.15.132:0/2231117295 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f965c003680 con 0x7f966c1601e0 2023-05-10T04:19:26.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f966c0d1640 con 0x7f966c1601e0 2023-05-10T04:19:26.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f96627fc700 1 -- 172.21.15.132:0/2231117295 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f965c003a30 con 0x7f966c1601e0 2023-05-10T04:19:26.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.556+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f966c0cd980 con 0x7f966c1601e0 2023-05-10T04:19:26.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.557+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f966c0d17d0 con 0x7f966c1601e0 2023-05-10T04:19:26.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.558+0000 7f96627fc700 1 -- 172.21.15.132:0/2231117295 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f965c003b90 con 0x7f966c1601e0 2023-05-10T04:19:26.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.559+0000 7f96627fc700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f965006ace0 0x7f965006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.559+0000 7f96627fc700 1 -- 172.21.15.132:0/2231117295 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f965c088b90 con 0x7f966c1601e0 2023-05-10T04:19:26.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.559+0000 7f9671d9b700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f965006ace0 0x7f965006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.560+0000 7f9671d9b700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f965006ace0 0x7f965006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9668009be0 tx=0x7f9668009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.563+0000 7f96627fc700 1 -- 172.21.15.132:0/2231117295 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f965c053940 con 0x7f966c1601e0 2023-05-10T04:19:26.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.758+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f966c074430 con 0x7f966c1601e0 2023-05-10T04:19:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.759+0000 7f96627fc700 1 -- 172.21.15.132:0/2231117295 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f965c0170a0 con 0x7f966c1601e0 2023-05-10T04:19:26.761 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:19:26.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f965006ace0 msgr2=0x7f965006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f965006ace0 0x7f965006d190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9668009be0 tx=0x7f9668009210 comp rx=0 tx=0).stop 2023-05-10T04:19:26.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c1601e0 msgr2=0x7f966c1e69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c1601e0 0x7f966c1e69f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f965c0011e0 tx=0x7f965c00ca30 comp rx=0 tx=0).stop 2023-05-10T04:19:26.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 shutdown_connections 2023-05-10T04:19:26.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f965006ace0 0x7f965006d190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f966c160d40 0x7f966c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f966c0b87a0 0x7f966c152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 --2- 172.21.15.132:0/2231117295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f966c1601e0 0x7f966c1e69f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 >> 172.21.15.132:0/2231117295 conn(0x7f966c071b10 msgr2=0x7f966c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:26.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 shutdown_connections 2023-05-10T04:19:26.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.761+0000 7f9673fff700 1 -- 172.21.15.132:0/2231117295 wait complete. 2023-05-10T04:19:26.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:19:26.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.963+0000 7f1d00fff700 1 Processor -- start 2023-05-10T04:19:26.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.964+0000 7f1d00fff700 1 -- start start 2023-05-10T04:19:26.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1d00fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1cfc0b87a0 0x7f1cfc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1d00fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1cfc160d40 0x7f1cfc0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1d00fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cfc0cdc60 con 0x7f1cfc1601e0 2023-05-10T04:19:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1d00fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc0d02d0 con 0x7f1cfc160d40 2023-05-10T04:19:26.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1d00fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cfc0d0cb0 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cfad9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1cfc160d40 0x7f1cfc0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cf3fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1cfc1601e0 0x7f1cfc160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59316/0 (socket says 172.21.15.132:59316) 2023-05-10T04:19:26.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cf3fff700 1 -- 172.21.15.132:0/3409130400 learned_addr learned my addr 172.21.15.132:0/3409130400 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:26.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cfa59c700 1 --2- 172.21.15.132:0/3409130400 >> v2:172.21.15.154:3300/0 conn(0x7f1cfc0b87a0 0x7f1cfc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cfad9d700 1 -- 172.21.15.132:0/3409130400 >> v2:172.21.15.154:3300/0 conn(0x7f1cfc0b87a0 msgr2=0x7f1cfc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:26.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cfad9d700 1 --2- 172.21.15.132:0/3409130400 >> v2:172.21.15.154:3300/0 conn(0x7f1cfc0b87a0 0x7f1cfc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cfad9d700 1 -- 172.21.15.132:0/3409130400 >> v1:172.21.15.132:6789/0 conn(0x7f1cfc1601e0 legacy=0x7f1cfc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cfad9d700 1 -- 172.21.15.132:0/3409130400 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cfc0cd6a0 con 0x7f1cfc160d40 2023-05-10T04:19:26.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.965+0000 7f1cf9d9b700 1 -- 172.21.15.132:0/3409130400 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798876448 0 0) 0x7f1cfc0cdc60 con 0x7f1cfc1601e0 2023-05-10T04:19:26.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.966+0000 7f1cfad9d700 1 --2- 172.21.15.132:0/3409130400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc160d40 0x7f1cfc0d1100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0b4ac0 tx=0x7f1cf400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801873300a052ad0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.966+0000 7f1cf9d9b700 1 -- 172.21.15.132:0/3409130400 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400e070 con 0x7f1cfc160d40 2023-05-10T04:19:26.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.966+0000 7f1cf9d9b700 1 -- 172.21.15.132:0/3409130400 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf400bae0 con 0x7f1cfc160d40 2023-05-10T04:19:26.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.966+0000 7f1cf9d9b700 1 -- 172.21.15.132:0/3409130400 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf400be90 con 0x7f1cfc160d40 2023-05-10T04:19:26.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.966+0000 7f1d00fff700 1 -- 172.21.15.132:0/3409130400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc160d40 msgr2=0x7f1cfc0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.966+0000 7f1d00fff700 1 --2- 172.21.15.132:0/3409130400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc160d40 0x7f1cfc0d1100 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0b4ac0 tx=0x7f1cf400b330 comp rx=0 tx=0).stop 2023-05-10T04:19:26.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.967+0000 7f1d00fff700 1 -- 172.21.15.132:0/3409130400 shutdown_connections 2023-05-10T04:19:26.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.967+0000 7f1d00fff700 1 --2- 172.21.15.132:0/3409130400 >> v2:172.21.15.154:3300/0 conn(0x7f1cfc0b87a0 0x7f1cfc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.967+0000 7f1d00fff700 1 --2- 172.21.15.132:0/3409130400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc160d40 0x7f1cfc0d1100 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.967+0000 7f1d00fff700 1 -- 172.21.15.132:0/3409130400 >> 172.21.15.132:0/3409130400 conn(0x7f1cfc071b10 msgr2=0x7f1cfc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:26.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.967+0000 7f1d00fff700 1 -- 172.21.15.132:0/3409130400 shutdown_connections 2023-05-10T04:19:26.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.967+0000 7f1d00fff700 1 -- 172.21.15.132:0/3409130400 wait complete. 2023-05-10T04:19:26.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.968+0000 7f1d00fff700 1 Processor -- start 2023-05-10T04:19:26.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.968+0000 7f1d00fff700 1 -- start start 2023-05-10T04:19:26.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.969+0000 7f1d00fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b87a0 0x7f1cfc152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.969+0000 7f1d00fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cfc1601e0 0x7f1cfc0c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.969+0000 7f1d00fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cfc160d40 0x7f1cfc150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.969+0000 7f1d00fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc0c8e80 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.969+0000 7f1d00fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc153920 con 0x7f1cfc160d40 2023-05-10T04:19:26.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.969+0000 7f1d00fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cfc153db0 con 0x7f1cfc1601e0 2023-05-10T04:19:26.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b87a0 0x7f1cfc152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b87a0 0x7f1cfc152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51442/0 (socket says 172.21.15.132:51442) 2023-05-10T04:19:26.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 -- 172.21.15.132:0/2067602998 learned_addr learned my addr 172.21.15.132:0/2067602998 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:26.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cf3fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cfc1601e0 0x7f1cfc0c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfad9d700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cfc160d40 0x7f1cfc150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 -- 172.21.15.132:0/2067602998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cfc1601e0 msgr2=0x7f1cfc0c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cfc1601e0 0x7f1cfc0c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 -- 172.21.15.132:0/2067602998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cfc160d40 msgr2=0x7f1cfc150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:26.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cfc160d40 0x7f1cfc150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:26.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 -- 172.21.15.132:0/2067602998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf4009a70 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cfa59c700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b87a0 0x7f1cfc152680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00e9b0 tx=0x7f1cec00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cf2ffd700 1 -- 172.21.15.132:0/2067602998 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec009710 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cf2ffd700 1 -- 172.21.15.132:0/2067602998 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00c850 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1cf2ffd700 1 -- 172.21.15.132:0/2067602998 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00cbc0 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.970+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc0d1640 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.971+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cfc0cd980 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.972+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cfc0d17d0 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.973+0000 7f1cf2ffd700 1 -- 172.21.15.132:0/2067602998 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1cec00cd20 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.973+0000 7f1cf2ffd700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1cdc06ace0 0x7f1cdc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:26.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.974+0000 7f1cf2ffd700 1 -- 172.21.15.132:0/2067602998 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1cec0899b0 con 0x7f1cfc0b87a0 2023-05-10T04:19:26.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.974+0000 7f1cf3fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1cdc06ace0 0x7f1cdc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:26.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.974+0000 7f1cf3fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1cdc06ace0 0x7f1cdc06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0b4900 tx=0x7f1ce4007be0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:26.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:26.978+0000 7f1cf2ffd700 1 -- 172.21.15.132:0/2067602998 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1cec0580d0 con 0x7f1cfc0b87a0 2023-05-10T04:19:27.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.174+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1cfc074430 con 0x7f1cfc0b87a0 2023-05-10T04:19:27.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.175+0000 7f1cf2ffd700 1 -- 172.21.15.132:0/2067602998 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1cec017020 con 0x7f1cfc0b87a0 2023-05-10T04:19:27.177 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:19:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1cdc06ace0 msgr2=0x7f1cdc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1cdc06ace0 0x7f1cdc06d190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0b4900 tx=0x7f1ce4007be0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b87a0 msgr2=0x7f1cfc152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b87a0 0x7f1cfc152680 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1cec00e9b0 tx=0x7f1cec00ed70 comp rx=0 tx=0).stop 2023-05-10T04:19:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 shutdown_connections 2023-05-10T04:19:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1cdc06ace0 0x7f1cdc06d190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1cfc160d40 0x7f1cfc150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1cfc0b87a0 0x7f1cfc152680 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 --2- 172.21.15.132:0/2067602998 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1cfc1601e0 0x7f1cfc0c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.177+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 >> 172.21.15.132:0/2067602998 conn(0x7f1cfc071b10 msgr2=0x7f1cfc071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.178+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 shutdown_connections 2023-05-10T04:19:27.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.178+0000 7f1d00fff700 1 -- 172.21.15.132:0/2067602998 wait complete. 2023-05-10T04:19:27.198 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:19:27.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.382+0000 7fdf183ff700 1 Processor -- start 2023-05-10T04:19:27.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.383+0000 7fdf183ff700 1 -- start start 2023-05-10T04:19:27.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf183ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100cfbf0 0x7fdf101608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf183ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100d0020 con 0x7fdf100d1100 2023-05-10T04:19:27.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf183ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf100cdc60 con 0x7fdf100b87a0 2023-05-10T04:19:27.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf183ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100d02d0 con 0x7fdf100cfbf0 2023-05-10T04:19:27.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf1699c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdf100d1100 0x7fdf100d1580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59318/0 (socket says 172.21.15.132:59318) 2023-05-10T04:19:27.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf1699c700 1 -- 172.21.15.132:0/1079354809 learned_addr learned my addr 172.21.15.132:0/1079354809 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:27.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf1599a700 1 --2- 172.21.15.132:0/1079354809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100cfbf0 0x7fdf101608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf15199700 1 -- 172.21.15.132:0/1079354809 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2371840485 0 0) 0x7fdf100d0020 con 0x7fdf100d1100 2023-05-10T04:19:27.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.384+0000 7fdf15199700 1 -- 172.21.15.132:0/1079354809 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdefc0035b0 con 0x7fdf100d1100 2023-05-10T04:19:27.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.385+0000 7fdf15199700 1 -- 172.21.15.132:0/1079354809 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 821898311 0 0) 0x7fdf100cdc60 con 0x7fdf100b87a0 2023-05-10T04:19:27.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.385+0000 7fdf1599a700 1 -- 172.21.15.132:0/1079354809 >> v1:172.21.15.154:6789/0 conn(0x7fdf100b87a0 legacy=0x7fdf101601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.385+0000 7fdf1599a700 1 -- 172.21.15.132:0/1079354809 >> v1:172.21.15.132:6789/0 conn(0x7fdf100d1100 legacy=0x7fdf100d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.385+0000 7fdf1599a700 1 -- 172.21.15.132:0/1079354809 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf100cd6a0 con 0x7fdf100cfbf0 2023-05-10T04:19:27.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.385+0000 7fdf1599a700 1 --2- 172.21.15.132:0/1079354809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100cfbf0 0x7fdf101608f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009870 tx=0x7fdf00009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed8dd98d4157cf90 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:27.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.385+0000 7fdf15199700 1 -- 172.21.15.132:0/1079354809 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00011830 con 0x7fdf100cfbf0 2023-05-10T04:19:27.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.385+0000 7fdf15199700 1 -- 172.21.15.132:0/1079354809 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf00011990 con 0x7fdf100cfbf0 2023-05-10T04:19:27.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.385+0000 7fdf15199700 1 -- 172.21.15.132:0/1079354809 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00011d20 con 0x7fdf100cfbf0 2023-05-10T04:19:27.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.386+0000 7fdf183ff700 1 -- 172.21.15.132:0/1079354809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100cfbf0 msgr2=0x7fdf101608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.386+0000 7fdf183ff700 1 --2- 172.21.15.132:0/1079354809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100cfbf0 0x7fdf101608f0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009870 tx=0x7fdf00009b80 comp rx=0 tx=0).stop 2023-05-10T04:19:27.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.386+0000 7fdf183ff700 1 -- 172.21.15.132:0/1079354809 shutdown_connections 2023-05-10T04:19:27.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.386+0000 7fdf183ff700 1 --2- 172.21.15.132:0/1079354809 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100cfbf0 0x7fdf101608f0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.386+0000 7fdf183ff700 1 -- 172.21.15.132:0/1079354809 >> 172.21.15.132:0/1079354809 conn(0x7fdf10071b10 msgr2=0x7fdf10071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:27.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.386+0000 7fdf183ff700 1 -- 172.21.15.132:0/1079354809 shutdown_connections 2023-05-10T04:19:27.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.386+0000 7fdf183ff700 1 -- 172.21.15.132:0/1079354809 wait complete. 2023-05-10T04:19:27.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.388+0000 7fdf183ff700 1 Processor -- start 2023-05-10T04:19:27.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.388+0000 7fdf183ff700 1 -- start start 2023-05-10T04:19:27.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf183ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf100b87a0 0x7fdf100cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf183ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf100cfbf0 0x7fdf100caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf183ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100d1100 0x7fdf100d2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf183ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100caf40 con 0x7fdf100b87a0 2023-05-10T04:19:27.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf183ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1015cca0 con 0x7fdf100cfbf0 2023-05-10T04:19:27.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf183ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf100cbe20 con 0x7fdf100d1100 2023-05-10T04:19:27.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1619b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf100b87a0 0x7fdf100cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1619b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf100b87a0 0x7fdf100cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51450/0 (socket says 172.21.15.132:51450) 2023-05-10T04:19:27.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1619b700 1 -- 172.21.15.132:0/3663591869 learned_addr learned my addr 172.21.15.132:0/3663591869 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:27.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1599a700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf100cfbf0 0x7fdf100caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1699c700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100d1100 0x7fdf100d2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1619b700 1 -- 172.21.15.132:0/3663591869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100d1100 msgr2=0x7fdf100d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1619b700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100d1100 0x7fdf100d2aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1619b700 1 -- 172.21.15.132:0/3663591869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf100cfbf0 msgr2=0x7fdf100caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1619b700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf100cfbf0 0x7fdf100caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.389+0000 7fdf1619b700 1 -- 172.21.15.132:0/3663591869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf000094a0 con 0x7fdf100b87a0 2023-05-10T04:19:27.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.390+0000 7fdf1619b700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf100b87a0 0x7fdf100cb7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00c550 tx=0x7fdf0c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:27.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.390+0000 7fdf06ffd700 1 -- 172.21.15.132:0/3663591869 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0054e0 con 0x7fdf100b87a0 2023-05-10T04:19:27.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.390+0000 7fdf06ffd700 1 -- 172.21.15.132:0/3663591869 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf0c003680 con 0x7fdf100b87a0 2023-05-10T04:19:27.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.390+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf10160e30 con 0x7fdf100b87a0 2023-05-10T04:19:27.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.390+0000 7fdf06ffd700 1 -- 172.21.15.132:0/3663591869 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c003a30 con 0x7fdf100b87a0 2023-05-10T04:19:27.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.390+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf100cd980 con 0x7fdf100b87a0 2023-05-10T04:19:27.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.391+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf10160fc0 con 0x7fdf100b87a0 2023-05-10T04:19:27.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.392+0000 7fdf06ffd700 1 -- 172.21.15.132:0/3663591869 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdf0c003b90 con 0x7fdf100b87a0 2023-05-10T04:19:27.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.393+0000 7fdf06ffd700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdef406ace0 0x7fdef406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.393+0000 7fdf06ffd700 1 -- 172.21.15.132:0/3663591869 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdf0c088b50 con 0x7fdf100b87a0 2023-05-10T04:19:27.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.393+0000 7fdf1599a700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdef406ace0 0x7fdef406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.394+0000 7fdf1599a700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdef406ace0 0x7fdef406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097c0 tx=0x7fdf0001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:27.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.397+0000 7fdf06ffd700 1 -- 172.21.15.132:0/3663591869 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdf0c053870 con 0x7fdf100b87a0 2023-05-10T04:19:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.594+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf100b52f0 con 0x7fdf100b87a0 2023-05-10T04:19:27.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.595+0000 7fdf06ffd700 1 -- 172.21.15.132:0/3663591869 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf0c0170a0 con 0x7fdf100b87a0 2023-05-10T04:19:27.597 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:19:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdef406ace0 msgr2=0x7fdef406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdef406ace0 0x7fdef406d190 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdf000097c0 tx=0x7fdf0001c040 comp rx=0 tx=0).stop 2023-05-10T04:19:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf100b87a0 msgr2=0x7fdf100cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf100b87a0 0x7fdf100cb7d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c00c550 tx=0x7fdf0c00c860 comp rx=0 tx=0).stop 2023-05-10T04:19:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 shutdown_connections 2023-05-10T04:19:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdef406ace0 0x7fdef406d190 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdf100d1100 0x7fdf100d2aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf100b87a0 0x7fdf100cb7d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 --2- 172.21.15.132:0/3663591869 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdf100cfbf0 0x7fdf100caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 >> 172.21.15.132:0/3663591869 conn(0x7fdf10071b10 msgr2=0x7fdf1015c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 shutdown_connections 2023-05-10T04:19:27.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.597+0000 7fdf183ff700 1 -- 172.21.15.132:0/3663591869 wait complete. 2023-05-10T04:19:27.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:19:27.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.801+0000 7fdc3e7ff700 1 Processor -- start 2023-05-10T04:19:27.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.801+0000 7fdc3e7ff700 1 -- start start 2023-05-10T04:19:27.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.802+0000 7fdc3e7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc3815cf10 0x7fdc3806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.802+0000 7fdc3e7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc380cc9e0 con 0x7fdc380adf70 2023-05-10T04:19:27.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.802+0000 7fdc3e7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc3815de20 con 0x7fdc380cd760 2023-05-10T04:19:27.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.802+0000 7fdc3e7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc380cd580 con 0x7fdc3815cf10 2023-05-10T04:19:27.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.802+0000 7fdc377fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdc380adf70 0x7fdc380cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59320/0 (socket says 172.21.15.132:59320) 2023-05-10T04:19:27.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.802+0000 7fdc377fe700 1 -- 172.21.15.132:0/2711887378 learned_addr learned my addr 172.21.15.132:0/2711887378 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:27.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc3cd9c700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc3815cf10 0x7fdc3806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631212385 0 0) 0x7fdc380cc9e0 con 0x7fdc380adf70 2023-05-10T04:19:27.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc200035b0 con 0x7fdc380adf70 2023-05-10T04:19:27.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 502098089 0 0) 0x7fdc200035b0 con 0x7fdc380adf70 2023-05-10T04:19:27.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc3815cf10 msgr2=0x7fdc3806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:27.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc3815cf10 0x7fdc3806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 >> v1:172.21.15.154:6789/0 conn(0x7fdc380cd760 legacy=0x7fdc380cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3815d860 con 0x7fdc380adf70 2023-05-10T04:19:27.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fdc2c0017f0 con 0x7fdc380adf70 2023-05-10T04:19:27.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 >> v1:172.21.15.132:6789/0 conn(0x7fdc380adf70 legacy=0x7fdc380cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc20003a30 0x7fdc20003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc3815cf10 0x7fdc20004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc20005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc380cd580 con 0x7fdc20004d90 2023-05-10T04:19:27.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2000bac0 con 0x7fdc20003a30 2023-05-10T04:19:27.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.803+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2000bc50 con 0x7fdc3815cf10 2023-05-10T04:19:27.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc377fe700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc3815cf10 0x7fdc20004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc37fff700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc20003a30 0x7fdc20003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc3cd9c700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc20005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc3cd9c700 1 -- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc3815cf10 msgr2=0x7fdc20004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:27.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc3cd9c700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc3815cf10 0x7fdc20004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc3cd9c700 1 -- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc20003a30 msgr2=0x7fdc20003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:27.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc3cd9c700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc20003a30 0x7fdc20003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc3cd9c700 1 -- 172.21.15.132:0/2711887378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc200035b0 con 0x7fdc20004d90 2023-05-10T04:19:27.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc3cd9c700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc20005200 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009fc0 tx=0x7fdc20005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c4f301e14b0717 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:27.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3000ec30 con 0x7fdc20004d90 2023-05-10T04:19:27.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3000f040 con 0x7fdc20004d90 2023-05-10T04:19:27.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.804+0000 7fdc36ffd700 1 -- 172.21.15.132:0/2711887378 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc30014480 con 0x7fdc20004d90 2023-05-10T04:19:27.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.805+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/2711887378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 msgr2=0x7fdc20005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.805+0000 7fdc3e7ff700 1 --2- 172.21.15.132:0/2711887378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc20005200 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc30009fc0 tx=0x7fdc20005880 comp rx=0 tx=0).stop 2023-05-10T04:19:27.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.805+0000 7fdc3cd9c700 1 -- 172.21.15.132:0/2711887378 reap_dead start 2023-05-10T04:19:27.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.805+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/2711887378 shutdown_connections 2023-05-10T04:19:27.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.805+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/2711887378 >> 172.21.15.132:0/2711887378 conn(0x7fdc380cf720 msgr2=0x7fdc380cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:27.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.805+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/2711887378 shutdown_connections 2023-05-10T04:19:27.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.805+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/2711887378 wait complete. 2023-05-10T04:19:27.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.807+0000 7fdc3e7ff700 1 Processor -- start 2023-05-10T04:19:27.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.807+0000 7fdc3e7ff700 1 -- start start 2023-05-10T04:19:27.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc3e7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc380ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc3e7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc380b38e0 0x7fdc381576d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc3e7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc380c3710 0x7fdc380c3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc3e7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc380c40c0 con 0x7fdc20004d90 2023-05-10T04:19:27.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc3e7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc380af7b0 con 0x7fdc380c3710 2023-05-10T04:19:27.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc3e7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc380ae900 con 0x7fdc380b38e0 2023-05-10T04:19:27.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc37fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc380ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc37fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc380ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51460/0 (socket says 172.21.15.132:51460) 2023-05-10T04:19:27.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc37fff700 1 -- 172.21.15.132:0/1977078051 learned_addr learned my addr 172.21.15.132:0/1977078051 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:27.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc377fe700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc380b38e0 0x7fdc381576d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc3cd9c700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc380c3710 0x7fdc380c3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc37fff700 1 -- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc380b38e0 msgr2=0x7fdc381576d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.808+0000 7fdc37fff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc380b38e0 0x7fdc381576d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc37fff700 1 -- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc380c3710 msgr2=0x7fdc380c3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:27.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc37fff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc380c3710 0x7fdc380c3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:27.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc37fff700 1 -- 172.21.15.132:0/1977078051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc380cc670 con 0x7fdc20004d90 2023-05-10T04:19:27.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc3cd9c700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc380c3710 0x7fdc380c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:27.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc377fe700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc380b38e0 0x7fdc381576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:27.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc37fff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc380ae3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800f820 tx=0x7fdc2800fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:27.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc34ff9700 1 -- 172.21.15.132:0/1977078051 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc280052e0 con 0x7fdc20004d90 2023-05-10T04:19:27.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc34ff9700 1 -- 172.21.15.132:0/1977078051 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc28005440 con 0x7fdc20004d90 2023-05-10T04:19:27.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc3815db40 con 0x7fdc20004d90 2023-05-10T04:19:27.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc34ff9700 1 -- 172.21.15.132:0/1977078051 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc280038c0 con 0x7fdc20004d90 2023-05-10T04:19:27.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.809+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc38071600 con 0x7fdc20004d90 2023-05-10T04:19:27.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.810+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc380adc60 con 0x7fdc20004d90 2023-05-10T04:19:27.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.811+0000 7fdc34ff9700 1 -- 172.21.15.132:0/1977078051 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc28003a20 con 0x7fdc20004d90 2023-05-10T04:19:27.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.812+0000 7fdc34ff9700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdc2406ace0 0x7fdc2406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:27.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.812+0000 7fdc34ff9700 1 -- 172.21.15.132:0/1977078051 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdc28089660 con 0x7fdc20004d90 2023-05-10T04:19:27.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.812+0000 7fdc377fe700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdc2406ace0 0x7fdc2406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:27.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.813+0000 7fdc377fe700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdc2406ace0 0x7fdc2406d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc38071290 tx=0x7fdc2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:27.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:27.816+0000 7fdc34ff9700 1 -- 172.21.15.132:0/1977078051 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdc28054410 con 0x7fdc20004d90 2023-05-10T04:19:28.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.010+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdc3806abd0 con 0x7fdc20004d90 2023-05-10T04:19:28.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.010+0000 7fdc34ff9700 1 -- 172.21.15.132:0/1977078051 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdc28057a30 con 0x7fdc20004d90 2023-05-10T04:19:28.013 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:19:28.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.012+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdc2406ace0 msgr2=0x7fdc2406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.012+0000 7fdc3e7ff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdc2406ace0 0x7fdc2406d190 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdc38071290 tx=0x7fdc2c009040 comp rx=0 tx=0).stop 2023-05-10T04:19:28.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.012+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 msgr2=0x7fdc380ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.012+0000 7fdc3e7ff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc380ae3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800f820 tx=0x7fdc2800fbe0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.013+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 shutdown_connections 2023-05-10T04:19:28.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.013+0000 7fdc3e7ff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdc2406ace0 0x7fdc2406d190 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.013+0000 7fdc3e7ff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdc380c3710 0x7fdc380c3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.013+0000 7fdc3e7ff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc20004d90 0x7fdc380ae3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.013+0000 7fdc3e7ff700 1 --2- 172.21.15.132:0/1977078051 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdc380b38e0 0x7fdc381576d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.013+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 >> 172.21.15.132:0/1977078051 conn(0x7fdc380cf720 msgr2=0x7fdc3806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:28.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.013+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 shutdown_connections 2023-05-10T04:19:28.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.013+0000 7fdc3e7ff700 1 -- 172.21.15.132:0/1977078051 wait complete. 2023-05-10T04:19:28.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:19:28.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.214+0000 7f2e7a1ff700 1 Processor -- start 2023-05-10T04:19:28.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.214+0000 7f2e7a1ff700 1 -- start start 2023-05-10T04:19:28.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.215+0000 7f2e7a1ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e740b87a0 0x7f2e740cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.215+0000 7f2e7a1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e74160d40 0x7f2e740d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.215+0000 7f2e7a1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e740cdc60 con 0x7f2e741601e0 2023-05-10T04:19:28.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e7a1ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740d02d0 con 0x7f2e740b87a0 2023-05-10T04:19:28.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e7a1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740d0cb0 con 0x7f2e74160d40 2023-05-10T04:19:28.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e737fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e740b87a0 0x7f2e740cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e737fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e740b87a0 0x7f2e740cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51472/0 (socket says 172.21.15.132:51472) 2023-05-10T04:19:28.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e737fe700 1 -- 172.21.15.132:0/401870531 learned_addr learned my addr 172.21.15.132:0/401870531 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:28.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e73fff700 1 --2- 172.21.15.132:0/401870531 >> v2:172.21.15.154:3300/0 conn(0x7f2e74160d40 0x7f2e740d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e737fe700 1 -- 172.21.15.132:0/401870531 >> v2:172.21.15.154:3300/0 conn(0x7f2e74160d40 msgr2=0x7f2e740d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:28.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e737fe700 1 --2- 172.21.15.132:0/401870531 >> v2:172.21.15.154:3300/0 conn(0x7f2e74160d40 0x7f2e740d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e737fe700 1 -- 172.21.15.132:0/401870531 >> v1:172.21.15.154:6789/0 conn(0x7f2e741601e0 legacy=0x7f2e74160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:28.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e737fe700 1 -- 172.21.15.132:0/401870531 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e740cd6a0 con 0x7f2e740b87a0 2023-05-10T04:19:28.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e73fff700 1 --2- 172.21.15.132:0/401870531 >> v2:172.21.15.154:3300/0 conn(0x7f2e74160d40 0x7f2e740d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:28.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.216+0000 7f2e737fe700 1 --2- 172.21.15.132:0/401870531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e740b87a0 0x7f2e740cfbf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e740d0820 tx=0x7f2e64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29802af69546035 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e72ffd700 1 -- 172.21.15.132:0/401870531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e64004230 con 0x7f2e740b87a0 2023-05-10T04:19:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e72ffd700 1 -- 172.21.15.132:0/401870531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e64004390 con 0x7f2e740b87a0 2023-05-10T04:19:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e72ffd700 1 -- 172.21.15.132:0/401870531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e640036a0 con 0x7f2e740b87a0 2023-05-10T04:19:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/401870531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e740b87a0 msgr2=0x7f2e740cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/401870531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e740b87a0 0x7f2e740cfbf0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2e740d0820 tx=0x7f2e64009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/401870531 shutdown_connections 2023-05-10T04:19:28.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/401870531 >> v2:172.21.15.154:3300/0 conn(0x7f2e74160d40 0x7f2e740d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/401870531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e740b87a0 0x7f2e740cfbf0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/401870531 >> 172.21.15.132:0/401870531 conn(0x7f2e74071b10 msgr2=0x7f2e74071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/401870531 shutdown_connections 2023-05-10T04:19:28.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.217+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/401870531 wait complete. 2023-05-10T04:19:28.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.219+0000 7f2e7a1ff700 1 Processor -- start 2023-05-10T04:19:28.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.219+0000 7f2e7a1ff700 1 -- start start 2023-05-10T04:19:28.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e7a1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e740b87a0 0x7f2e741512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e7a1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e741601e0 0x7f2e741f5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e7a1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e74160d40 0x7f2e7415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e7a1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741f67c0 con 0x7f2e741601e0 2023-05-10T04:19:28.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e7a1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741f6200 con 0x7f2e74160d40 2023-05-10T04:19:28.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e7a1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e741f64e0 con 0x7f2e740b87a0 2023-05-10T04:19:28.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e741601e0 0x7f2e741f5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e6bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e741601e0 0x7f2e741f5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51484/0 (socket says 172.21.15.132:51484) 2023-05-10T04:19:28.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e6bfff700 1 -- 172.21.15.132:0/3223138603 learned_addr learned my addr 172.21.15.132:0/3223138603 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:28.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e737fe700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e740b87a0 0x7f2e741512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.220+0000 7f2e73fff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e74160d40 0x7f2e7415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e6bfff700 1 -- 172.21.15.132:0/3223138603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e740b87a0 msgr2=0x7f2e741512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e6bfff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e740b87a0 0x7f2e741512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e6bfff700 1 -- 172.21.15.132:0/3223138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e74160d40 msgr2=0x7f2e7415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e6bfff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e74160d40 0x7f2e7415dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e6bfff700 1 -- 172.21.15.132:0/3223138603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e64009550 con 0x7f2e741601e0 2023-05-10T04:19:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e6bfff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e741601e0 0x7f2e741f5890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00c4d0 tx=0x7f2e5c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e70ff9700 1 -- 172.21.15.132:0/3223138603 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c011790 con 0x7f2e741601e0 2023-05-10T04:19:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e70ff9700 1 -- 172.21.15.132:0/3223138603 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e5c0118f0 con 0x7f2e741601e0 2023-05-10T04:19:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e740d1640 con 0x7f2e741601e0 2023-05-10T04:19:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e70ff9700 1 -- 172.21.15.132:0/3223138603 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5c011ca0 con 0x7f2e741601e0 2023-05-10T04:19:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.221+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e740cd980 con 0x7f2e741601e0 2023-05-10T04:19:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.222+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740d17d0 con 0x7f2e741601e0 2023-05-10T04:19:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.223+0000 7f2e70ff9700 1 -- 172.21.15.132:0/3223138603 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e5c01c460 con 0x7f2e741601e0 2023-05-10T04:19:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.224+0000 7f2e70ff9700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e5406ace0 0x7f2e5406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.224+0000 7f2e70ff9700 1 -- 172.21.15.132:0/3223138603 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e5c0894a0 con 0x7f2e741601e0 2023-05-10T04:19:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.224+0000 7f2e737fe700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e5406ace0 0x7f2e5406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.225+0000 7f2e737fe700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e5406ace0 0x7f2e5406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009130 tx=0x7f2e64008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:28.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.228+0000 7f2e70ff9700 1 -- 172.21.15.132:0/3223138603 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2e5c054250 con 0x7f2e741601e0 2023-05-10T04:19:28.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.442+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2e74074430 con 0x7f2e741601e0 2023-05-10T04:19:28.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.442+0000 7f2e70ff9700 1 -- 172.21.15.132:0/3223138603 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2e5c057870 con 0x7f2e741601e0 2023-05-10T04:19:28.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e5406ace0 msgr2=0x7f2e5406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e5406ace0 0x7f2e5406d190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e64009130 tx=0x7f2e64008030 comp rx=0 tx=0).stop 2023-05-10T04:19:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e741601e0 msgr2=0x7f2e741f5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e741601e0 0x7f2e741f5890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2e5c00c4d0 tx=0x7f2e5c00c7e0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 shutdown_connections 2023-05-10T04:19:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e5406ace0 0x7f2e5406d190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e74160d40 0x7f2e7415dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e740b87a0 0x7f2e741512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.444+0000 7f2e7a1ff700 1 --2- 172.21.15.132:0/3223138603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e741601e0 0x7f2e741f5890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.445+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 >> 172.21.15.132:0/3223138603 conn(0x7f2e74071b10 msgr2=0x7f2e740cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:28.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.445+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 shutdown_connections 2023-05-10T04:19:28.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.445+0000 7f2e7a1ff700 1 -- 172.21.15.132:0/3223138603 wait complete. 2023-05-10T04:19:28.448 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:19:28.464 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-05-10T04:19:28.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:28.465 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-05-10T04:19:28.523 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi132.stderr:ceph-fuse[135096]: fuse finished with error 0 and tester_r 0 2023-05-10T04:19:28.527 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:19:28.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T04:19:28.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:28.558 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-05-10T04:19:28.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:28.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.863+0000 7fddc03ff700 1 Processor -- start 2023-05-10T04:19:28.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.863+0000 7fddc03ff700 1 -- start start 2023-05-10T04:19:28.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddc03ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 0x7fddb80cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddc03ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddb80adf70 0x7fddb80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddc03ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddb815cf10 0x7fddb806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddc03ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb80cc9e0 con 0x7fddb80adf70 2023-05-10T04:19:28.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddc03ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb815de20 con 0x7fddb815cf10 2023-05-10T04:19:28.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddc03ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80ce070 con 0x7fddb80cd760 2023-05-10T04:19:28.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddbd99a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddb80adf70 0x7fddb80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddbe99c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fddb815cf10 0x7fddb806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddbe19b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 0x7fddb80cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddbd99a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddb80adf70 0x7fddb80cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51490/0 (socket says 172.21.15.132:51490) 2023-05-10T04:19:28.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.864+0000 7fddbd99a700 1 -- 172.21.15.132:0/1581167030 learned_addr learned my addr 172.21.15.132:0/1581167030 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:28.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd99a700 1 -- 172.21.15.132:0/1581167030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 msgr2=0x7fddb80cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:28.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd99a700 1 --2- 172.21.15.132:0/1581167030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 0x7fddb80cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd99a700 1 -- 172.21.15.132:0/1581167030 >> v2:172.21.15.154:3300/0 conn(0x7fddb815cf10 msgr2=0x7fddb806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:28.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd99a700 1 --2- 172.21.15.132:0/1581167030 >> v2:172.21.15.154:3300/0 conn(0x7fddb815cf10 0x7fddb806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd99a700 1 -- 172.21.15.132:0/1581167030 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb815d860 con 0x7fddb80adf70 2023-05-10T04:19:28.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd99a700 1 --2- 172.21.15.132:0/1581167030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb80adf70 0x7fddb80cce70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fddb8070480 tx=0x7fdda8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0efb6952fe22fa server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:28.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd199700 1 -- 172.21.15.132:0/1581167030 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda8005e30 con 0x7fddb80adf70 2023-05-10T04:19:28.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd199700 1 -- 172.21.15.132:0/1581167030 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda8004030 con 0x7fddb80adf70 2023-05-10T04:19:28.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.865+0000 7fddbd199700 1 -- 172.21.15.132:0/1581167030 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda80043e0 con 0x7fddb80adf70 2023-05-10T04:19:28.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 -- 172.21.15.132:0/1581167030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb80adf70 msgr2=0x7fddb80cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 --2- 172.21.15.132:0/1581167030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb80adf70 0x7fddb80cce70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fddb8070480 tx=0x7fdda8009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 -- 172.21.15.132:0/1581167030 shutdown_connections 2023-05-10T04:19:28.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 --2- 172.21.15.132:0/1581167030 >> v2:172.21.15.154:3300/0 conn(0x7fddb815cf10 0x7fddb806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 --2- 172.21.15.132:0/1581167030 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 0x7fddb80cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 --2- 172.21.15.132:0/1581167030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb80adf70 0x7fddb80cce70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 -- 172.21.15.132:0/1581167030 >> 172.21.15.132:0/1581167030 conn(0x7fddb80cf720 msgr2=0x7fddb80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:28.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 -- 172.21.15.132:0/1581167030 shutdown_connections 2023-05-10T04:19:28.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.866+0000 7fddc03ff700 1 -- 172.21.15.132:0/1581167030 wait complete. 2023-05-10T04:19:28.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.867+0000 7fddc03ff700 1 Processor -- start 2023-05-10T04:19:28.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.868+0000 7fddc03ff700 1 -- start start 2023-05-10T04:19:28.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.868+0000 7fddc03ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80adf70 0x7fddb8157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.868+0000 7fddc03ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 0x7fddb80c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.868+0000 7fddc03ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb815cf10 0x7fddb80c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.868+0000 7fddc03ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80b2cd0 con 0x7fddb815cf10 2023-05-10T04:19:28.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.868+0000 7fddc03ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80b2fb0 con 0x7fddb80adf70 2023-05-10T04:19:28.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.868+0000 7fddc03ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb80b3290 con 0x7fddb80cd760 2023-05-10T04:19:28.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb815cf10 0x7fddb80c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb815cf10 0x7fddb80c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51500/0 (socket says 172.21.15.132:51500) 2023-05-10T04:19:28.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 -- 172.21.15.132:0/3465355363 learned_addr learned my addr 172.21.15.132:0/3465355363 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:28.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe19b700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80adf70 0x7fddb8157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbd99a700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 0x7fddb80c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 -- 172.21.15.132:0/3465355363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 msgr2=0x7fddb80c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 0x7fddb80c4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 -- 172.21.15.132:0/3465355363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80adf70 msgr2=0x7fddb8157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:28.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80adf70 0x7fddb8157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:28.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 -- 172.21.15.132:0/3465355363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda8009500 con 0x7fddb815cf10 2023-05-10T04:19:28.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddbe99c700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb815cf10 0x7fddb80c5ad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fddb000bde0 tx=0x7fddb000e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:28.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddaeffd700 1 -- 172.21.15.132:0/3465355363 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0010040 con 0x7fddb815cf10 2023-05-10T04:19:28.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddaeffd700 1 -- 172.21.15.132:0/3465355363 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb0003a20 con 0x7fddb815cf10 2023-05-10T04:19:28.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb80cc670 con 0x7fddb815cf10 2023-05-10T04:19:28.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.869+0000 7fddaeffd700 1 -- 172.21.15.132:0/3465355363 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0003dd0 con 0x7fddb815cf10 2023-05-10T04:19:28.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.870+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb815db40 con 0x7fddb815cf10 2023-05-10T04:19:28.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.870+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb8071600 con 0x7fddb815cf10 2023-05-10T04:19:28.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.871+0000 7fddaeffd700 1 -- 172.21.15.132:0/3465355363 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fddb000e930 con 0x7fddb815cf10 2023-05-10T04:19:28.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.872+0000 7fddaeffd700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd9c06ace0 0x7fdd9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:28.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.872+0000 7fddaeffd700 1 -- 172.21.15.132:0/3465355363 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fddb00898a0 con 0x7fddb815cf10 2023-05-10T04:19:28.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.873+0000 7fddbe19b700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd9c06ace0 0x7fdd9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:28.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.873+0000 7fddbe19b700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd9c06ace0 0x7fdd9c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009b70 tx=0x7fddb4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:28.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:28.877+0000 7fddaeffd700 1 -- 172.21.15.132:0/3465355363 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fddb00545c0 con 0x7fddb815cf10 2023-05-10T04:19:29.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.073+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddb80b4a10 con 0x7fddb815cf10 2023-05-10T04:19:29.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.074+0000 7fddaeffd700 1 -- 172.21.15.132:0/3465355363 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fddb0057be0 con 0x7fddb815cf10 2023-05-10T04:19:29.077 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:29.078 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:29.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd9c06ace0 msgr2=0x7fdd9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd9c06ace0 0x7fdd9c06d190 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fddb4009b70 tx=0x7fddb4008040 comp rx=0 tx=0).stop 2023-05-10T04:19:29.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb815cf10 msgr2=0x7fddb80c5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb815cf10 0x7fddb80c5ad0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fddb000bde0 tx=0x7fddb000e3a0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 shutdown_connections 2023-05-10T04:19:29.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd9c06ace0 0x7fdd9c06d190 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddb815cf10 0x7fddb80c5ad0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fddb80adf70 0x7fddb8157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 --2- 172.21.15.132:0/3465355363 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fddb80cd760 0x7fddb80c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 >> 172.21.15.132:0/3465355363 conn(0x7fddb80cf720 msgr2=0x7fddb806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:29.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 shutdown_connections 2023-05-10T04:19:29.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.077+0000 7fddc03ff700 1 -- 172.21.15.132:0/3465355363 wait complete. 2023-05-10T04:19:29.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:29.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.278+0000 7f2324fff700 1 Processor -- start 2023-05-10T04:19:29.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.278+0000 7f2324fff700 1 -- start start 2023-05-10T04:19:29.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.279+0000 7f2324fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23200b87a0 0x7f23200cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.279+0000 7f2324fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320160d40 0x7f23200d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.279+0000 7f2324fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23200cdc60 con 0x7f23201601e0 2023-05-10T04:19:29.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.279+0000 7f2324fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23200d02d0 con 0x7f23200b87a0 2023-05-10T04:19:29.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.279+0000 7f2324fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23200d0cb0 con 0x7f2320160d40 2023-05-10T04:19:29.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.279+0000 7f231e59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23200b87a0 0x7f23200cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.279+0000 7f231e59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23200b87a0 0x7f23200cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51508/0 (socket says 172.21.15.132:51508) 2023-05-10T04:19:29.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.279+0000 7f231e59c700 1 -- 172.21.15.132:0/1012782433 learned_addr learned my addr 172.21.15.132:0/1012782433 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:29.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231ed9d700 1 --2- 172.21.15.132:0/1012782433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320160d40 0x7f23200d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231e59c700 1 -- 172.21.15.132:0/1012782433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320160d40 msgr2=0x7f23200d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:29.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231e59c700 1 --2- 172.21.15.132:0/1012782433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320160d40 0x7f23200d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231e59c700 1 -- 172.21.15.132:0/1012782433 >> v1:172.21.15.154:6789/0 conn(0x7f23201601e0 legacy=0x7f2320160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:29.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231e59c700 1 -- 172.21.15.132:0/1012782433 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23200cd6a0 con 0x7f23200b87a0 2023-05-10T04:19:29.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231e59c700 1 --2- 172.21.15.132:0/1012782433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23200b87a0 0x7f23200cfbf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f23100098f0 tx=0x7f2310009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a2d3addb65f57e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:29.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231d59a700 1 -- 172.21.15.132:0/1012782433 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000b8a0 con 0x7f23200b87a0 2023-05-10T04:19:29.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231d59a700 1 -- 172.21.15.132:0/1012782433 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231000ba00 con 0x7f23200b87a0 2023-05-10T04:19:29.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.280+0000 7f231d59a700 1 -- 172.21.15.132:0/1012782433 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231000bd90 con 0x7f23200b87a0 2023-05-10T04:19:29.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.281+0000 7f2324fff700 1 -- 172.21.15.132:0/1012782433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23200b87a0 msgr2=0x7f23200cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.281+0000 7f2324fff700 1 --2- 172.21.15.132:0/1012782433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23200b87a0 0x7f23200cfbf0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f23100098f0 tx=0x7f2310009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:29.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.281+0000 7f2324fff700 1 -- 172.21.15.132:0/1012782433 shutdown_connections 2023-05-10T04:19:29.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.281+0000 7f2324fff700 1 --2- 172.21.15.132:0/1012782433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2320160d40 0x7f23200d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.281+0000 7f2324fff700 1 --2- 172.21.15.132:0/1012782433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23200b87a0 0x7f23200cfbf0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.281+0000 7f2324fff700 1 -- 172.21.15.132:0/1012782433 >> 172.21.15.132:0/1012782433 conn(0x7f2320071b10 msgr2=0x7f2320071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:29.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.281+0000 7f2324fff700 1 -- 172.21.15.132:0/1012782433 shutdown_connections 2023-05-10T04:19:29.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.281+0000 7f2324fff700 1 -- 172.21.15.132:0/1012782433 wait complete. 2023-05-10T04:19:29.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.283+0000 7f2324fff700 1 Processor -- start 2023-05-10T04:19:29.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.283+0000 7f2324fff700 1 -- start start 2023-05-10T04:19:29.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f2324fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23200b87a0 0x7f2320151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f2324fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23201601e0 0x7f23200b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f2324fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320160d40 0x7f23200b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f2324fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2320151740 con 0x7f23201601e0 2023-05-10T04:19:29.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f2324fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23201f29c0 con 0x7f2320160d40 2023-05-10T04:19:29.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f2324fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23201f2ca0 con 0x7f23200b87a0 2023-05-10T04:19:29.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231dd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23201601e0 0x7f23200b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231dd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23201601e0 0x7f23200b73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51520/0 (socket says 172.21.15.132:51520) 2023-05-10T04:19:29.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231dd9b700 1 -- 172.21.15.132:0/2863924333 learned_addr learned my addr 172.21.15.132:0/2863924333 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:29.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231e59c700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23200b87a0 0x7f2320151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231ed9d700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320160d40 0x7f23200b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231dd9b700 1 -- 172.21.15.132:0/2863924333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23200b87a0 msgr2=0x7f2320151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231dd9b700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23200b87a0 0x7f2320151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231dd9b700 1 -- 172.21.15.132:0/2863924333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320160d40 msgr2=0x7f23200b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.284+0000 7f231dd9b700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320160d40 0x7f23200b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.285+0000 7f231dd9b700 1 -- 172.21.15.132:0/2863924333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2310009550 con 0x7f23201601e0 2023-05-10T04:19:29.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.285+0000 7f231dd9b700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23201601e0 0x7f23200b73b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f231400c4e0 tx=0x7f231400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:29.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.285+0000 7f230effd700 1 -- 172.21.15.132:0/2863924333 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140052d0 con 0x7f23201601e0 2023-05-10T04:19:29.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.285+0000 7f230effd700 1 -- 172.21.15.132:0/2863924333 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2314005430 con 0x7f23201601e0 2023-05-10T04:19:29.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.285+0000 7f230effd700 1 -- 172.21.15.132:0/2863924333 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23140038c0 con 0x7f23201601e0 2023-05-10T04:19:29.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.285+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23200d1640 con 0x7f23201601e0 2023-05-10T04:19:29.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.285+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23200cd980 con 0x7f23201601e0 2023-05-10T04:19:29.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.286+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23200d17d0 con 0x7f23201601e0 2023-05-10T04:19:29.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.287+0000 7f230effd700 1 -- 172.21.15.132:0/2863924333 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2314003a20 con 0x7f23201601e0 2023-05-10T04:19:29.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.288+0000 7f230effd700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f230006ace0 0x7f230006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.288+0000 7f230effd700 1 -- 172.21.15.132:0/2863924333 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2314088b70 con 0x7f23201601e0 2023-05-10T04:19:29.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.288+0000 7f231e59c700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f230006ace0 0x7f230006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.289+0000 7f231e59c700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f230006ace0 0x7f230006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2310009c40 tx=0x7f2310008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:29.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.292+0000 7f230effd700 1 -- 172.21.15.132:0/2863924333 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2314053890 con 0x7f23201601e0 2023-05-10T04:19:29.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.489+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2320074430 con 0x7f23201601e0 2023-05-10T04:19:29.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.490+0000 7f230effd700 1 -- 172.21.15.132:0/2863924333 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f2314056eb0 con 0x7f23201601e0 2023-05-10T04:19:29.493 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:29.494 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:29.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f230006ace0 msgr2=0x7f230006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f230006ace0 0x7f230006d190 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2310009c40 tx=0x7f2310008030 comp rx=0 tx=0).stop 2023-05-10T04:19:29.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23201601e0 msgr2=0x7f23200b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23201601e0 0x7f23200b73b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f231400c4e0 tx=0x7f231400c7f0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 shutdown_connections 2023-05-10T04:19:29.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f230006ace0 0x7f230006d190 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2320160d40 0x7f23200b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f23200b87a0 0x7f2320151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 --2- 172.21.15.132:0/2863924333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23201601e0 0x7f23200b73b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 >> 172.21.15.132:0/2863924333 conn(0x7f2320071b10 msgr2=0x7f23200cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:29.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 shutdown_connections 2023-05-10T04:19:29.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.493+0000 7f2324fff700 1 -- 172.21.15.132:0/2863924333 wait complete. 2023-05-10T04:19:29.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T04:19:29.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.697+0000 7f2fb55ff700 1 Processor -- start 2023-05-10T04:19:29.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.697+0000 7f2fb55ff700 1 -- start start 2023-05-10T04:19:29.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.698+0000 7f2fb55ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2fb00cfbf0 0x7f2fb01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.698+0000 7f2fb55ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2fb00d1100 0x7f2fb00d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.698+0000 7f2fb55ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb00d0020 con 0x7f2fb00b87a0 2023-05-10T04:19:29.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.698+0000 7f2fb55ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00d02d0 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.698+0000 7f2fb55ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00d0cb0 con 0x7f2fb00d1100 2023-05-10T04:19:29.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.698+0000 7f2fae7fc700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2fb00cfbf0 0x7f2fb01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.698+0000 7f2faeffd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2fb00b87a0 0x7f2fb01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59336/0 (socket says 172.21.15.132:59336) 2023-05-10T04:19:29.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.698+0000 7f2faeffd700 1 -- 172.21.15.132:0/3407036376 learned_addr learned my addr 172.21.15.132:0/3407036376 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:29.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2faf7fe700 1 --2- 172.21.15.132:0/3407036376 >> v2:172.21.15.154:3300/0 conn(0x7f2fb00d1100 0x7f2fb00d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2fae7fc700 1 -- 172.21.15.132:0/3407036376 >> v2:172.21.15.154:3300/0 conn(0x7f2fb00d1100 msgr2=0x7f2fb00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:29.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2fae7fc700 1 --2- 172.21.15.132:0/3407036376 >> v2:172.21.15.154:3300/0 conn(0x7f2fb00d1100 0x7f2fb00d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2fae7fc700 1 -- 172.21.15.132:0/3407036376 >> v1:172.21.15.132:6789/0 conn(0x7f2fb00b87a0 legacy=0x7f2fb01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2fae7fc700 1 -- 172.21.15.132:0/3407036376 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb00cdc60 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2fae7fc700 1 --2- 172.21.15.132:0/3407036376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb01608f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00d0820 tx=0x7f2fa4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f5e2d262259f80 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:29.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2fadffb700 1 -- 172.21.15.132:0/3407036376 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4011830 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2fadffb700 1 -- 172.21.15.132:0/3407036376 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa4011990 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.699+0000 7f2fadffb700 1 -- 172.21.15.132:0/3407036376 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4011d20 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.700+0000 7f2fb55ff700 1 -- 172.21.15.132:0/3407036376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 msgr2=0x7f2fb01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.700+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/3407036376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb01608f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00d0820 tx=0x7f2fa4009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:29.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.700+0000 7f2fb55ff700 1 -- 172.21.15.132:0/3407036376 shutdown_connections 2023-05-10T04:19:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.700+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/3407036376 >> v2:172.21.15.154:3300/0 conn(0x7f2fb00d1100 0x7f2fb00d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.700+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/3407036376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb01608f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.700+0000 7f2fb55ff700 1 -- 172.21.15.132:0/3407036376 >> 172.21.15.132:0/3407036376 conn(0x7f2fb0071b10 msgr2=0x7f2fb0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.700+0000 7f2fb55ff700 1 -- 172.21.15.132:0/3407036376 shutdown_connections 2023-05-10T04:19:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.700+0000 7f2fb55ff700 1 -- 172.21.15.132:0/3407036376 wait complete. 2023-05-10T04:19:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.702+0000 7f2fb55ff700 1 Processor -- start 2023-05-10T04:19:29.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.702+0000 7f2fb55ff700 1 -- start start 2023-05-10T04:19:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fb55ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fb00b87a0 0x7f2fb01e82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fb55ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fb55ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fb00d1100 0x7f2fb01e7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fb55ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb015dc30 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fb55ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb015ea70 con 0x7f2fb00d1100 2023-05-10T04:19:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fb55ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb015de60 con 0x7f2fb00b87a0 2023-05-10T04:19:29.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fae7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fae7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb015d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51534/0 (socket says 172.21.15.132:51534) 2023-05-10T04:19:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fae7fc700 1 -- 172.21.15.132:0/2804656233 learned_addr learned my addr 172.21.15.132:0/2804656233 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2faeffd700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fb00b87a0 0x7f2fb01e82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2faf7fe700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fb00d1100 0x7f2fb01e7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fae7fc700 1 -- 172.21.15.132:0/2804656233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fb00b87a0 msgr2=0x7f2fb01e82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fae7fc700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fb00b87a0 0x7f2fb01e82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fae7fc700 1 -- 172.21.15.132:0/2804656233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fb00d1100 msgr2=0x7f2fb01e7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:29.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fae7fc700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fb00d1100 0x7f2fb01e7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:29.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.703+0000 7f2fae7fc700 1 -- 172.21.15.132:0/2804656233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa40094a0 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.704+0000 7f2fae7fc700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb015d6f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40097c0 tx=0x7f2fa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:29.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.704+0000 7f2f977fe700 1 -- 172.21.15.132:0/2804656233 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa40036a0 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.704+0000 7f2f977fe700 1 -- 172.21.15.132:0/2804656233 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa401f070 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.704+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb00cd980 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.704+0000 7f2f977fe700 1 -- 172.21.15.132:0/2804656233 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4003a60 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.704+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb00cd6a0 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.705+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0160e30 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.706+0000 7f2f977fe700 1 -- 172.21.15.132:0/2804656233 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2fa4003bc0 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.707+0000 7f2f977fe700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f9c06ace0 0x7f2f9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.707+0000 7f2f977fe700 1 -- 172.21.15.132:0/2804656233 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2fa4021070 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.707+0000 7f2faeffd700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f9c06ace0 0x7f2f9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:29.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.708+0000 7f2faeffd700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f9c06ace0 0x7f2f9c06d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0005910 tx=0x7f2fa0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:29.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.711+0000 7f2f977fe700 1 -- 172.21.15.132:0/2804656233 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2fa4055d90 con 0x7f2fb00cfbf0 2023-05-10T04:19:29.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:29.951+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2fb0074430 con 0x7f2fb00cfbf0 2023-05-10T04:19:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.477+0000 7f2f977fe700 1 -- 172.21.15.132:0/2804656233 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2fa40150b0 con 0x7f2fb00cfbf0 2023-05-10T04:19:30.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f9c06ace0 msgr2=0x7f2f9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:30.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f9c06ace0 0x7f2f9c06d190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0005910 tx=0x7f2fa0009040 comp rx=0 tx=0).stop 2023-05-10T04:19:30.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 msgr2=0x7f2fb015d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:30.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb015d6f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40097c0 tx=0x7f2fa4004750 comp rx=0 tx=0).stop 2023-05-10T04:19:30.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 shutdown_connections 2023-05-10T04:19:30.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f9c06ace0 0x7f2f9c06d190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2fb00d1100 0x7f2fb01e7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2fb00b87a0 0x7f2fb01e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 --2- 172.21.15.132:0/2804656233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb00cfbf0 0x7f2fb015d6f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 >> 172.21.15.132:0/2804656233 conn(0x7f2fb0071b10 msgr2=0x7f2fb00b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:30.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 shutdown_connections 2023-05-10T04:19:30.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.480+0000 7f2fb55ff700 1 -- 172.21.15.132:0/2804656233 wait complete. 2023-05-10T04:19:30.502 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-05-10T04:19:30.502 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T04:19:30.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.687+0000 7f2e2cdff700 1 Processor -- start 2023-05-10T04:19:30.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.687+0000 7f2e2cdff700 1 -- start start 2023-05-10T04:19:30.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.688+0000 7f2e2cdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280cfbf0 0x7f2e281608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:30.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.688+0000 7f2e2cdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e280d1100 0x7f2e280d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:30.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.688+0000 7f2e2cdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e280d0020 con 0x7f2e280b87a0 2023-05-10T04:19:30.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.688+0000 7f2e2cdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e280d02d0 con 0x7f2e280d1100 2023-05-10T04:19:30.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.688+0000 7f2e2cdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e280d0cb0 con 0x7f2e280cfbf0 2023-05-10T04:19:30.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e26d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e280d1100 0x7f2e280d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:30.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e25d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280cfbf0 0x7f2e281608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:30.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e25d9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280cfbf0 0x7f2e281608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:51938/0 (socket says 172.21.15.132:51938) 2023-05-10T04:19:30.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e26d9d700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2e280d1100 0x7f2e280d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:49776/0 (socket says 172.21.15.132:49776) 2023-05-10T04:19:30.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e25d9b700 1 -- 172.21.15.132:0/919616459 learned_addr learned my addr 172.21.15.132:0/919616459 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:30.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e25d9b700 1 -- 172.21.15.132:0/919616459 >> v2:172.21.15.154:3300/0 conn(0x7f2e280d1100 msgr2=0x7f2e280d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:30.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e25d9b700 1 --2- 172.21.15.132:0/919616459 >> v2:172.21.15.154:3300/0 conn(0x7f2e280d1100 0x7f2e280d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e25d9b700 1 -- 172.21.15.132:0/919616459 >> v1:172.21.15.154:6789/0 conn(0x7f2e280b87a0 legacy=0x7f2e281601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:30.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e25d9b700 1 -- 172.21.15.132:0/919616459 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e280cdc60 con 0x7f2e280cfbf0 2023-05-10T04:19:30.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e26d9d700 1 --2- 172.21.15.132:0/919616459 >> v2:172.21.15.154:3300/0 conn(0x7f2e280d1100 0x7f2e280d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:30.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.689+0000 7f2e2559a700 1 -- 172.21.15.132:0/919616459 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875691495 0 0) 0x7f2e280d0020 con 0x7f2e280b87a0 2023-05-10T04:19:30.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e25d9b700 1 --2- 172.21.15.132:0/919616459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280cfbf0 0x7f2e281608f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0098f0 tx=0x7f2e1c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e744eaa79e034a47 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:30.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2559a700 1 -- 172.21.15.132:0/919616459 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c011830 con 0x7f2e280cfbf0 2023-05-10T04:19:30.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2559a700 1 -- 172.21.15.132:0/919616459 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c011990 con 0x7f2e280cfbf0 2023-05-10T04:19:30.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2559a700 1 -- 172.21.15.132:0/919616459 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c011d20 con 0x7f2e280cfbf0 2023-05-10T04:19:30.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2cdff700 1 -- 172.21.15.132:0/919616459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280cfbf0 msgr2=0x7f2e281608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:30.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/919616459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280cfbf0 0x7f2e281608f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c0098f0 tx=0x7f2e1c009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:30.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2cdff700 1 -- 172.21.15.132:0/919616459 shutdown_connections 2023-05-10T04:19:30.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/919616459 >> v2:172.21.15.154:3300/0 conn(0x7f2e280d1100 0x7f2e280d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/919616459 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280cfbf0 0x7f2e281608f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2cdff700 1 -- 172.21.15.132:0/919616459 >> 172.21.15.132:0/919616459 conn(0x7f2e28071b10 msgr2=0x7f2e28071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:30.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.690+0000 7f2e2cdff700 1 -- 172.21.15.132:0/919616459 shutdown_connections 2023-05-10T04:19:30.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.691+0000 7f2e2cdff700 1 -- 172.21.15.132:0/919616459 wait complete. 2023-05-10T04:19:30.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.692+0000 7f2e2cdff700 1 Processor -- start 2023-05-10T04:19:30.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.692+0000 7f2e2cdff700 1 -- start start 2023-05-10T04:19:30.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.693+0000 7f2e2cdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280b87a0 0x7f2e28152760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:30.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.693+0000 7f2e2cdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e280cfbf0 0x7f2e2815cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:30.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.693+0000 7f2e2cdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280d1100 0x7f2e2815d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:30.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.693+0000 7f2e2cdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2815f4b0 con 0x7f2e280cfbf0 2023-05-10T04:19:30.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.693+0000 7f2e2cdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e280cb7f0 con 0x7f2e280b87a0 2023-05-10T04:19:30.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.693+0000 7f2e2cdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e280cbad0 con 0x7f2e280d1100 2023-05-10T04:19:30.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e280cfbf0 0x7f2e2815cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:30.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e280cfbf0 0x7f2e2815cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51540/0 (socket says 172.21.15.132:51540) 2023-05-10T04:19:30.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 -- 172.21.15.132:0/4290892811 learned_addr learned my addr 172.21.15.132:0/4290892811 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:30.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e26d9d700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280d1100 0x7f2e2815d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:30.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e2659c700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280b87a0 0x7f2e28152760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:30.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 -- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280d1100 msgr2=0x7f2e2815d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280d1100 0x7f2e2815d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 -- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280b87a0 msgr2=0x7f2e28152760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280b87a0 0x7f2e28152760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 -- 172.21.15.132:0/4290892811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e20009a70 con 0x7f2e280cfbf0 2023-05-10T04:19:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e2659c700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280b87a0 0x7f2e28152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e25d9b700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e280cfbf0 0x7f2e2815cca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009c40 tx=0x7f2e1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:30.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.694+0000 7f2e16ffd700 1 -- 172.21.15.132:0/4290892811 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0043c0 con 0x7f2e280cfbf0 2023-05-10T04:19:30.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.695+0000 7f2e16ffd700 1 -- 172.21.15.132:0/4290892811 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e1c01f070 con 0x7f2e280cfbf0 2023-05-10T04:19:30.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.695+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c009550 con 0x7f2e280cfbf0 2023-05-10T04:19:30.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.695+0000 7f2e16ffd700 1 -- 172.21.15.132:0/4290892811 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e1c0036a0 con 0x7f2e280cfbf0 2023-05-10T04:19:30.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.695+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e280cd980 con 0x7f2e280cfbf0 2023-05-10T04:19:30.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.696+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e280cd6a0 con 0x7f2e280cfbf0 2023-05-10T04:19:30.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.697+0000 7f2e16ffd700 1 -- 172.21.15.132:0/4290892811 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2e1c021030 con 0x7f2e280cfbf0 2023-05-10T04:19:30.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.698+0000 7f2e16ffd700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e0806ace0 0x7f2e0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:30.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.698+0000 7f2e16ffd700 1 -- 172.21.15.132:0/4290892811 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2e1c08ad20 con 0x7f2e280cfbf0 2023-05-10T04:19:30.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.698+0000 7f2e2659c700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e0806ace0 0x7f2e0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:30.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.698+0000 7f2e2659c700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e0806ace0 0x7f2e0806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e18000f60 tx=0x7f2e18009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:30.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.702+0000 7f2e16ffd700 1 -- 172.21.15.132:0/4290892811 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2e1c091080 con 0x7f2e280cfbf0 2023-05-10T04:19:30.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:30.942+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2e28160e30 con 0x7f2e280cfbf0 2023-05-10T04:19:31.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.484+0000 7f2e16ffd700 1 -- 172.21.15.132:0/4290892811 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2e1c055ad0 con 0x7f2e280cfbf0 2023-05-10T04:19:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e0806ace0 msgr2=0x7f2e0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e0806ace0 0x7f2e0806d190 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2e18000f60 tx=0x7f2e18009040 comp rx=0 tx=0).stop 2023-05-10T04:19:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e280cfbf0 msgr2=0x7f2e2815cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e280cfbf0 0x7f2e2815cca0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2e1c009c40 tx=0x7f2e1c004750 comp rx=0 tx=0).stop 2023-05-10T04:19:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 shutdown_connections 2023-05-10T04:19:31.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2e0806ace0 0x7f2e0806d190 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2e280d1100 0x7f2e2815d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2e280b87a0 0x7f2e28152760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 --2- 172.21.15.132:0/4290892811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e280cfbf0 0x7f2e2815cca0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 >> 172.21.15.132:0/4290892811 conn(0x7f2e28071b10 msgr2=0x7f2e280b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 shutdown_connections 2023-05-10T04:19:31.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.487+0000 7f2e2cdff700 1 -- 172.21.15.132:0/4290892811 wait complete. 2023-05-10T04:19:31.509 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-10T04:19:31.509 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:19:31.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.692+0000 7fd22cdff700 1 Processor -- start 2023-05-10T04:19:31.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.692+0000 7fd22cdff700 1 -- start start 2023-05-10T04:19:31.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd22cdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd2281589d0 0x7fd2280cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd22cdff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2280ca890 con 0x7fd2280cd690 2023-05-10T04:19:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd22cdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2280ca5b0 con 0x7fd22806cdd0 2023-05-10T04:19:31.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd22cdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2280cc670 con 0x7fd2281589d0 2023-05-10T04:19:31.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd225d9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd2280cd690 0x7fd22806c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59348/0 (socket says 172.21.15.132:59348) 2023-05-10T04:19:31.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd225d9b700 1 -- 172.21.15.132:0/243336728 learned_addr learned my addr 172.21.15.132:0/243336728 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:31.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd22659c700 1 --2- 172.21.15.132:0/243336728 >> v2:172.21.15.154:3300/0 conn(0x7fd2281589d0 0x7fd2280cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:31.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd22559a700 1 -- 172.21.15.132:0/243336728 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978918474 0 0) 0x7fd2280ca890 con 0x7fd2280cd690 2023-05-10T04:19:31.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.694+0000 7fd22559a700 1 -- 172.21.15.132:0/243336728 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2100035b0 con 0x7fd2280cd690 2023-05-10T04:19:31.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22559a700 1 -- 172.21.15.132:0/243336728 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41360695 0 0) 0x7fd2280ca5b0 con 0x7fd22806cdd0 2023-05-10T04:19:31.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22559a700 1 -- 172.21.15.132:0/243336728 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2280ca890 con 0x7fd22806cdd0 2023-05-10T04:19:31.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22659c700 1 -- 172.21.15.132:0/243336728 >> v1:172.21.15.154:6789/0 conn(0x7fd22806cdd0 legacy=0x7fd22806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22659c700 1 -- 172.21.15.132:0/243336728 >> v1:172.21.15.132:6789/0 conn(0x7fd2280cd690 legacy=0x7fd22806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22659c700 1 -- 172.21.15.132:0/243336728 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2280cc950 con 0x7fd2281589d0 2023-05-10T04:19:31.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22659c700 1 --2- 172.21.15.132:0/243336728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2281589d0 0x7fd2280cd150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd218009840 tx=0x7fd218009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d333679c5ae9d48 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:31.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22559a700 1 -- 172.21.15.132:0/243336728 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218011830 con 0x7fd2281589d0 2023-05-10T04:19:31.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22559a700 1 -- 172.21.15.132:0/243336728 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd218011990 con 0x7fd2281589d0 2023-05-10T04:19:31.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.695+0000 7fd22559a700 1 -- 172.21.15.132:0/243336728 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd218011d20 con 0x7fd2281589d0 2023-05-10T04:19:31.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.696+0000 7fd22cdff700 1 -- 172.21.15.132:0/243336728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2281589d0 msgr2=0x7fd2280cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.696+0000 7fd22cdff700 1 --2- 172.21.15.132:0/243336728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2281589d0 0x7fd2280cd150 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd218009840 tx=0x7fd218009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:31.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.696+0000 7fd22cdff700 1 -- 172.21.15.132:0/243336728 shutdown_connections 2023-05-10T04:19:31.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.696+0000 7fd22cdff700 1 --2- 172.21.15.132:0/243336728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd2281589d0 0x7fd2280cd150 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.696+0000 7fd22cdff700 1 -- 172.21.15.132:0/243336728 >> 172.21.15.132:0/243336728 conn(0x7fd2280cf720 msgr2=0x7fd2280cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:31.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.696+0000 7fd22cdff700 1 -- 172.21.15.132:0/243336728 shutdown_connections 2023-05-10T04:19:31.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.696+0000 7fd22cdff700 1 -- 172.21.15.132:0/243336728 wait complete. 2023-05-10T04:19:31.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.698+0000 7fd22cdff700 1 Processor -- start 2023-05-10T04:19:31.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.698+0000 7fd22cdff700 1 -- start start 2023-05-10T04:19:31.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.699+0000 7fd22cdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22806cdd0 0x7fd2280b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:31.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd22cdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2280cd690 0x7fd228159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:31.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd22cdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2281589d0 0x7fd2280c3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:31.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd22cdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280c3560 con 0x7fd2281589d0 2023-05-10T04:19:31.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd22cdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22815a6c0 con 0x7fd22806cdd0 2023-05-10T04:19:31.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd22cdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2280c3790 con 0x7fd2280cd690 2023-05-10T04:19:31.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd226d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2281589d0 0x7fd2280c3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:31.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd226d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2281589d0 0x7fd2280c3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51554/0 (socket says 172.21.15.132:51554) 2023-05-10T04:19:31.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd226d9d700 1 -- 172.21.15.132:0/14430759 learned_addr learned my addr 172.21.15.132:0/14430759 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:31.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd22659c700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22806cdd0 0x7fd2280b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:31.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd225d9b700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2280cd690 0x7fd228159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:31.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd226d9d700 1 -- 172.21.15.132:0/14430759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2280cd690 msgr2=0x7fd228159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd226d9d700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2280cd690 0x7fd228159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd226d9d700 1 -- 172.21.15.132:0/14430759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22806cdd0 msgr2=0x7fd2280b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd226d9d700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22806cdd0 0x7fd2280b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.700+0000 7fd226d9d700 1 -- 172.21.15.132:0/14430759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2180094a0 con 0x7fd2281589d0 2023-05-10T04:19:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.701+0000 7fd226d9d700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2281589d0 0x7fd2280c3020 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd22000cc20 tx=0x7fd22000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.701+0000 7fd216ffd700 1 -- 172.21.15.132:0/14430759 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd220003c00 con 0x7fd2281589d0 2023-05-10T04:19:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.701+0000 7fd216ffd700 1 -- 172.21.15.132:0/14430759 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd220003d60 con 0x7fd2281589d0 2023-05-10T04:19:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.701+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22806aaf0 con 0x7fd2281589d0 2023-05-10T04:19:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.701+0000 7fd216ffd700 1 -- 172.21.15.132:0/14430759 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd22000aae0 con 0x7fd2281589d0 2023-05-10T04:19:31.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.701+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2280ccc30 con 0x7fd2281589d0 2023-05-10T04:19:31.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.702+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22806ac80 con 0x7fd2281589d0 2023-05-10T04:19:31.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.703+0000 7fd216ffd700 1 -- 172.21.15.132:0/14430759 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd22000ac40 con 0x7fd2281589d0 2023-05-10T04:19:31.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.704+0000 7fd216ffd700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd20806ace0 0x7fd20806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.704+0000 7fd216ffd700 1 -- 172.21.15.132:0/14430759 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd220089880 con 0x7fd2281589d0 2023-05-10T04:19:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.704+0000 7fd22659c700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd20806ace0 0x7fd20806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.705+0000 7fd22659c700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd20806ace0 0x7fd20806d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd218009fd0 tx=0x7fd21801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:31.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.708+0000 7fd216ffd700 1 -- 172.21.15.132:0/14430759 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd2200545a0 con 0x7fd2281589d0 2023-05-10T04:19:31.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.949+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd22815a850 con 0x7fd2281589d0 2023-05-10T04:19:31.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.949+0000 7fd216ffd700 1 -- 172.21.15.132:0/14430759 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fd220057bc0 con 0x7fd2281589d0 2023-05-10T04:19:31.952 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:31.953 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:31.478753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-10T04:19:31.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd20806ace0 msgr2=0x7fd20806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd20806ace0 0x7fd20806d190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd218009fd0 tx=0x7fd21801c040 comp rx=0 tx=0).stop 2023-05-10T04:19:31.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2281589d0 msgr2=0x7fd2280c3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:31.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2281589d0 0x7fd2280c3020 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd22000cc20 tx=0x7fd22000cf30 comp rx=0 tx=0).stop 2023-05-10T04:19:31.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 shutdown_connections 2023-05-10T04:19:31.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd20806ace0 0x7fd20806d190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2281589d0 0x7fd2280c3020 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd22806cdd0 0x7fd2280b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 --2- 172.21.15.132:0/14430759 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd2280cd690 0x7fd228159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 >> 172.21.15.132:0/14430759 conn(0x7fd2280cf720 msgr2=0x7fd2280af880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 shutdown_connections 2023-05-10T04:19:31.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:31.952+0000 7fd22cdff700 1 -- 172.21.15.132:0/14430759 wait complete. 2023-05-10T04:19:31.957 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2023-05-10T04:19:31.972 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:32.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:19:32.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:19:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.156+0000 7fdeb6dff700 1 Processor -- start 2023-05-10T04:19:32.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.157+0000 7fdeb6dff700 1 -- start start 2023-05-10T04:19:32.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeb6dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdeb00cfbf0 0x7fdeb01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeb6dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdeb00d1100 0x7fdeb00d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeb6dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdeb00d0020 con 0x7fdeb00b87a0 2023-05-10T04:19:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeb6dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00d02d0 con 0x7fdeb00cfbf0 2023-05-10T04:19:32.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeb6dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdeb00d0cb0 con 0x7fdeb00d1100 2023-05-10T04:19:32.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeaffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdeb00cfbf0 0x7fdeb01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeaffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdeb00cfbf0 0x7fdeb01608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51570/0 (socket says 172.21.15.132:51570) 2023-05-10T04:19:32.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeaffff700 1 -- 172.21.15.132:0/3092115139 learned_addr learned my addr 172.21.15.132:0/3092115139 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:32.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeb539c700 1 --2- 172.21.15.132:0/3092115139 >> v2:172.21.15.154:3300/0 conn(0x7fdeb00d1100 0x7fdeb00d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeaffff700 1 -- 172.21.15.132:0/3092115139 >> v2:172.21.15.154:3300/0 conn(0x7fdeb00d1100 msgr2=0x7fdeb00d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:32.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeaffff700 1 --2- 172.21.15.132:0/3092115139 >> v2:172.21.15.154:3300/0 conn(0x7fdeb00d1100 0x7fdeb00d1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeaffff700 1 -- 172.21.15.132:0/3092115139 >> v1:172.21.15.154:6789/0 conn(0x7fdeb00b87a0 legacy=0x7fdeb01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.158+0000 7fdeaffff700 1 -- 172.21.15.132:0/3092115139 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb00cdc60 con 0x7fdeb00cfbf0 2023-05-10T04:19:32.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.159+0000 7fdeaffff700 1 --2- 172.21.15.132:0/3092115139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00cfbf0 0x7fdeb01608f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00d0820 tx=0x7fde9c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b557433712a15a19 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:32.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.159+0000 7fdeaf7fe700 1 -- 172.21.15.132:0/3092115139 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c011830 con 0x7fdeb00cfbf0 2023-05-10T04:19:32.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.159+0000 7fdeaf7fe700 1 -- 172.21.15.132:0/3092115139 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde9c011990 con 0x7fdeb00cfbf0 2023-05-10T04:19:32.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.159+0000 7fdeaf7fe700 1 -- 172.21.15.132:0/3092115139 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9c011d20 con 0x7fdeb00cfbf0 2023-05-10T04:19:32.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.159+0000 7fdeb6dff700 1 -- 172.21.15.132:0/3092115139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00cfbf0 msgr2=0x7fdeb01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.159+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/3092115139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00cfbf0 0x7fdeb01608f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fdeb00d0820 tx=0x7fde9c009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:32.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.160+0000 7fdeb6dff700 1 -- 172.21.15.132:0/3092115139 shutdown_connections 2023-05-10T04:19:32.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.160+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/3092115139 >> v2:172.21.15.154:3300/0 conn(0x7fdeb00d1100 0x7fdeb00d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.160+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/3092115139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00cfbf0 0x7fdeb01608f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.160+0000 7fdeb6dff700 1 -- 172.21.15.132:0/3092115139 >> 172.21.15.132:0/3092115139 conn(0x7fdeb0071b10 msgr2=0x7fdeb0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:32.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.160+0000 7fdeb6dff700 1 -- 172.21.15.132:0/3092115139 shutdown_connections 2023-05-10T04:19:32.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.160+0000 7fdeb6dff700 1 -- 172.21.15.132:0/3092115139 wait complete. 2023-05-10T04:19:32.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.161+0000 7fdeb6dff700 1 Processor -- start 2023-05-10T04:19:32.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.161+0000 7fdeb6dff700 1 -- start start 2023-05-10T04:19:32.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.162+0000 7fdeb6dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeb00b87a0 0x7fdeb01e82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.162+0000 7fdeb6dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdeb00cfbf0 0x7fdeb015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.162+0000 7fdeb6dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00d1100 0x7fdeb01e7630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.162+0000 7fdeb6dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015dc30 con 0x7fdeb00d1100 2023-05-10T04:19:32.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.162+0000 7fdeb6dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015ea70 con 0x7fdeb00b87a0 2023-05-10T04:19:32.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.162+0000 7fdeb6dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdeb015de60 con 0x7fdeb00cfbf0 2023-05-10T04:19:32.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00d1100 0x7fdeb01e7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00d1100 0x7fdeb01e7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51582/0 (socket says 172.21.15.132:51582) 2023-05-10T04:19:32.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 -- 172.21.15.132:0/1816371022 learned_addr learned my addr 172.21.15.132:0/1816371022 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:32.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb4b9b700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeb00b87a0 0x7fdeb01e82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeaffff700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdeb00cfbf0 0x7fdeb015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 -- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdeb00cfbf0 msgr2=0x7fdeb015d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdeb00cfbf0 0x7fdeb015d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 -- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeb00b87a0 msgr2=0x7fdeb01e82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeb00b87a0 0x7fdeb01e82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 -- 172.21.15.132:0/1816371022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9c009550 con 0x7fdeb00d1100 2023-05-10T04:19:32.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb4b9b700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeb00b87a0 0x7fdeb01e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:32.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb539c700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00d1100 0x7fdeb01e7630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdea800efc0 tx=0x7fdea800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:32.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdead7fa700 1 -- 172.21.15.132:0/1816371022 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8009ea0 con 0x7fdeb00d1100 2023-05-10T04:19:32.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdead7fa700 1 -- 172.21.15.132:0/1816371022 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdea800f040 con 0x7fdeb00d1100 2023-05-10T04:19:32.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdead7fa700 1 -- 172.21.15.132:0/1816371022 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdea8014480 con 0x7fdeb00d1100 2023-05-10T04:19:32.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.163+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdeb00cd980 con 0x7fdeb00d1100 2023-05-10T04:19:32.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.164+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdeb00cd6a0 con 0x7fdeb00d1100 2023-05-10T04:19:32.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.165+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdeb0160e30 con 0x7fdeb00d1100 2023-05-10T04:19:32.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.165+0000 7fdead7fa700 1 -- 172.21.15.132:0/1816371022 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdea80145e0 con 0x7fdeb00d1100 2023-05-10T04:19:32.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.166+0000 7fdead7fa700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde9406ace0 0x7fde9406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.167+0000 7fdead7fa700 1 -- 172.21.15.132:0/1816371022 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdea808a0d0 con 0x7fdeb00d1100 2023-05-10T04:19:32.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.167+0000 7fdeb4b9b700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde9406ace0 0x7fde9406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.167+0000 7fdeb4b9b700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde9406ace0 0x7fde9406d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000f60 tx=0x7fdea4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:32.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.171+0000 7fdead7fa700 1 -- 172.21.15.132:0/1816371022 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdea8054df0 con 0x7fdeb00d1100 2023-05-10T04:19:32.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.367+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdeb0074430 con 0x7fdeb00d1100 2023-05-10T04:19:32.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.368+0000 7fdead7fa700 1 -- 172.21.15.132:0/1816371022 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fdea8058410 con 0x7fdeb00d1100 2023-05-10T04:19:32.372 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:32.372 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde9406ace0 msgr2=0x7fde9406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde9406ace0 0x7fde9406d190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdea4000f60 tx=0x7fdea4009040 comp rx=0 tx=0).stop 2023-05-10T04:19:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00d1100 msgr2=0x7fdeb01e7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00d1100 0x7fdeb01e7630 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fdea800efc0 tx=0x7fdea800c3a0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 shutdown_connections 2023-05-10T04:19:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde9406ace0 0x7fde9406d190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdeb00d1100 0x7fdeb01e7630 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdeb00b87a0 0x7fdeb01e82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 --2- 172.21.15.132:0/1816371022 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdeb00cfbf0 0x7fdeb015d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 >> 172.21.15.132:0/1816371022 conn(0x7fdeb0071b10 msgr2=0x7fdeb00b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 shutdown_connections 2023-05-10T04:19:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.371+0000 7fdeb6dff700 1 -- 172.21.15.132:0/1816371022 wait complete. 2023-05-10T04:19:32.391 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T04:19:32.392 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T04:19:32.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.573+0000 7fb1383ff700 1 Processor -- start 2023-05-10T04:19:32.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.573+0000 7fb1383ff700 1 -- start start 2023-05-10T04:19:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.574+0000 7fb1383ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1300b87a0 0x7fb1300cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.574+0000 7fb1383ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1301601e0 0x7fb130160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.574+0000 7fb1383ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb130160ff0 con 0x7fb130160b70 2023-05-10T04:19:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.574+0000 7fb1383ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1300d02d0 con 0x7fb1301601e0 2023-05-10T04:19:32.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.574+0000 7fb1383ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300d0cb0 con 0x7fb1300b87a0 2023-05-10T04:19:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13599a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1301601e0 0x7fb130160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13619b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1300b87a0 0x7fb1300cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13619b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1300b87a0 0x7fb1300cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58492/0 (socket says 172.21.15.132:58492) 2023-05-10T04:19:32.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13619b700 1 -- 172.21.15.132:0/457803928 learned_addr learned my addr 172.21.15.132:0/457803928 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:32.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13599a700 1 -- 172.21.15.132:0/457803928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1300b87a0 msgr2=0x7fb1300cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:32.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13599a700 1 --2- 172.21.15.132:0/457803928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1300b87a0 0x7fb1300cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13599a700 1 -- 172.21.15.132:0/457803928 >> v1:172.21.15.154:6789/0 conn(0x7fb130160b70 legacy=0x7fb1300d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13599a700 1 -- 172.21.15.132:0/457803928 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1300cdc60 con 0x7fb1301601e0 2023-05-10T04:19:32.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.575+0000 7fb13599a700 1 --2- 172.21.15.132:0/457803928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1301601e0 0x7fb130160630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb120009840 tx=0x7fb120009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=544b551fea575850 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:32.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb135199700 1 -- 172.21.15.132:0/457803928 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011830 con 0x7fb1301601e0 2023-05-10T04:19:32.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb135199700 1 -- 172.21.15.132:0/457803928 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120011990 con 0x7fb1301601e0 2023-05-10T04:19:32.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb135199700 1 -- 172.21.15.132:0/457803928 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011d20 con 0x7fb1301601e0 2023-05-10T04:19:32.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb1383ff700 1 -- 172.21.15.132:0/457803928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1301601e0 msgr2=0x7fb130160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb1383ff700 1 --2- 172.21.15.132:0/457803928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1301601e0 0x7fb130160630 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb120009840 tx=0x7fb120009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:32.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb1383ff700 1 -- 172.21.15.132:0/457803928 shutdown_connections 2023-05-10T04:19:32.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb1383ff700 1 --2- 172.21.15.132:0/457803928 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1300b87a0 0x7fb1300cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb1383ff700 1 --2- 172.21.15.132:0/457803928 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1301601e0 0x7fb130160630 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb1383ff700 1 -- 172.21.15.132:0/457803928 >> 172.21.15.132:0/457803928 conn(0x7fb130071b10 msgr2=0x7fb130071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:32.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb1383ff700 1 -- 172.21.15.132:0/457803928 shutdown_connections 2023-05-10T04:19:32.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.576+0000 7fb1383ff700 1 -- 172.21.15.132:0/457803928 wait complete. 2023-05-10T04:19:32.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.578+0000 7fb1383ff700 1 Processor -- start 2023-05-10T04:19:32.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.578+0000 7fb1383ff700 1 -- start start 2023-05-10T04:19:32.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb1383ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1300b87a0 0x7fb130151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb1383ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1301601e0 0x7fb13015a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb1383ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb130160b70 0x7fb1300cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb1383ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13014ac00 con 0x7fb130160b70 2023-05-10T04:19:32.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb1383ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13015a6a0 con 0x7fb1300b87a0 2023-05-10T04:19:32.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb1383ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1300cb9c0 con 0x7fb1301601e0 2023-05-10T04:19:32.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb13699c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb130160b70 0x7fb1300cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb13699c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb130160b70 0x7fb1300cb480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47966/0 (socket says 172.21.15.132:47966) 2023-05-10T04:19:32.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb13699c700 1 -- 172.21.15.132:0/1590351634 learned_addr learned my addr 172.21.15.132:0/1590351634 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:32.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.579+0000 7fb13599a700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1301601e0 0x7fb13015a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13619b700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1300b87a0 0x7fb130151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13699c700 1 -- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1301601e0 msgr2=0x7fb13015a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13699c700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1301601e0 0x7fb13015a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13699c700 1 -- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1300b87a0 msgr2=0x7fb130151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13699c700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1300b87a0 0x7fb130151890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13699c700 1 -- 172.21.15.132:0/1590351634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1200094a0 con 0x7fb130160b70 2023-05-10T04:19:32.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13599a700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1301601e0 0x7fb13015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:32.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13619b700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1300b87a0 0x7fb130151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:32.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb13699c700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb130160b70 0x7fb1300cb480 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb12800cb50 tx=0x7fb12800cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:32.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb126ffd700 1 -- 172.21.15.132:0/1590351634 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128003c00 con 0x7fb130160b70 2023-05-10T04:19:32.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb126ffd700 1 -- 172.21.15.132:0/1590351634 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb128003d60 con 0x7fb130160b70 2023-05-10T04:19:32.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1300cd980 con 0x7fb130160b70 2023-05-10T04:19:32.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb126ffd700 1 -- 172.21.15.132:0/1590351634 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12800ab70 con 0x7fb130160b70 2023-05-10T04:19:32.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.580+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1300cd6a0 con 0x7fb130160b70 2023-05-10T04:19:32.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.581+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1300d2110 con 0x7fb130160b70 2023-05-10T04:19:32.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.582+0000 7fb126ffd700 1 -- 172.21.15.132:0/1590351634 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb12800acd0 con 0x7fb130160b70 2023-05-10T04:19:32.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.583+0000 7fb126ffd700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb11406ace0 0x7fb11406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:32.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.583+0000 7fb126ffd700 1 -- 172.21.15.132:0/1590351634 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb128089810 con 0x7fb130160b70 2023-05-10T04:19:32.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.583+0000 7fb13619b700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb11406ace0 0x7fb11406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:32.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.584+0000 7fb13619b700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb11406ace0 0x7fb11406d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009b50 tx=0x7fb12c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:32.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.588+0000 7fb126ffd700 1 -- 172.21.15.132:0/1590351634 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb1280545c0 con 0x7fb130160b70 2023-05-10T04:19:32.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.781+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 --> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb130074430 con 0x7fb11406ace0 2023-05-10T04:19:32.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.793+0000 7fb126ffd700 1 -- 172.21.15.132:0/1590351634 <== mgr.4100 v2:172.21.15.132:6832/1621031024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367356 (secure 0 0 0) 0x7fb130074430 con 0x7fb11406ace0 2023-05-10T04:19:32.800 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb11406ace0 msgr2=0x7fb11406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb11406ace0 0x7fb11406d190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb12c009b50 tx=0x7fb12c008040 comp rx=0 tx=0).stop 2023-05-10T04:19:32.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb130160b70 msgr2=0x7fb1300cb480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb130160b70 0x7fb1300cb480 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb12800cb50 tx=0x7fb12800cf10 comp rx=0 tx=0).stop 2023-05-10T04:19:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 shutdown_connections 2023-05-10T04:19:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb11406ace0 0x7fb11406d190 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb130160b70 0x7fb1300cb480 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1300b87a0 0x7fb130151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 --2- 172.21.15.132:0/1590351634 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1301601e0 0x7fb13015a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:32.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 >> 172.21.15.132:0/1590351634 conn(0x7fb130071b10 msgr2=0x7fb1300b6d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:32.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 shutdown_connections 2023-05-10T04:19:32.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:32.798+0000 7fb1383ff700 1 -- 172.21.15.132:0/1590351634 wait complete. 2023-05-10T04:19:32.804 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-05-10T04:19:32.818 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-05-10T04:19:31.320847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67720,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":64064,"kb_avail":754907000,"statfs":{"total":773094113280,"available":773024768000,"internally_reserved":0,"allocated":3678208,"data_stored":2182864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65601536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002634"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578590+0000","last_change":"2023-05-10T04:19:09.980944+0000","last_active":"2023-05-10T04:19:14.578590+0000","last_peered":"2023-05-10T04:19:14.578590+0000","last_clean":"2023-05-10T04:19:14.578590+0000","last_became_active":"2023-05-10T04:19:09.980469+0000","last_became_peered":"2023-05-10T04:19:09.980469+0000","last_unstale":"2023-05-10T04:19:14.578590+0000","last_undegraded":"2023-05-10T04:19:14.578590+0000","last_fullsized":"2023-05-10T04:19:14.578590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:55:07.690476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202665+0000","last_change":"2023-05-10T04:19:09.966435+0000","last_active":"2023-05-10T04:19:15.202665+0000","last_peered":"2023-05-10T04:19:15.202665+0000","last_clean":"2023-05-10T04:19:15.202665+0000","last_became_active":"2023-05-10T04:19:09.966166+0000","last_became_peered":"2023-05-10T04:19:09.966166+0000","last_unstale":"2023-05-10T04:19:15.202665+0000","last_undegraded":"2023-05-10T04:19:15.202665+0000","last_fullsized":"2023-05-10T04:19:15.202665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:27:35.392807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468705+0000","last_change":"2023-05-10T04:19:09.984558+0000","last_active":"2023-05-10T04:19:14.468705+0000","last_peered":"2023-05-10T04:19:14.468705+0000","last_clean":"2023-05-10T04:19:14.468705+0000","last_became_active":"2023-05-10T04:19:09.984302+0000","last_became_peered":"2023-05-10T04:19:09.984302+0000","last_unstale":"2023-05-10T04:19:14.468705+0000","last_undegraded":"2023-05-10T04:19:14.468705+0000","last_fullsized":"2023-05-10T04:19:14.468705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:04:32.114370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468704+0000","last_change":"2023-05-10T04:19:09.974290+0000","last_active":"2023-05-10T04:19:14.468704+0000","last_peered":"2023-05-10T04:19:14.468704+0000","last_clean":"2023-05-10T04:19:14.468704+0000","last_became_active":"2023-05-10T04:19:09.973974+0000","last_became_peered":"2023-05-10T04:19:09.973974+0000","last_unstale":"2023-05-10T04:19:14.468704+0000","last_undegraded":"2023-05-10T04:19:14.468704+0000","last_fullsized":"2023-05-10T04:19:14.468704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:42.762389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469158+0000","last_change":"2023-05-10T04:19:09.969611+0000","last_active":"2023-05-10T04:19:14.469158+0000","last_peered":"2023-05-10T04:19:14.469158+0000","last_clean":"2023-05-10T04:19:14.469158+0000","last_became_active":"2023-05-10T04:19:09.969348+0000","last_became_peered":"2023-05-10T04:19:09.969348+0000","last_unstale":"2023-05-10T04:19:14.469158+0000","last_undegraded":"2023-05-10T04:19:14.469158+0000","last_fullsized":"2023-05-10T04:19:14.469158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:09:45.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202245+0000","last_change":"2023-05-10T04:19:09.958269+0000","last_active":"2023-05-10T04:19:15.202245+0000","last_peered":"2023-05-10T04:19:15.202245+0000","last_clean":"2023-05-10T04:19:15.202245+0000","last_became_active":"2023-05-10T04:19:09.958012+0000","last_became_peered":"2023-05-10T04:19:09.958012+0000","last_unstale":"2023-05-10T04:19:15.202245+0000","last_undegraded":"2023-05-10T04:19:15.202245+0000","last_fullsized":"2023-05-10T04:19:15.202245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:46:10.564631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201730+0000","last_change":"2023-05-10T04:19:09.977451+0000","last_active":"2023-05-10T04:19:15.201730+0000","last_peered":"2023-05-10T04:19:15.201730+0000","last_clean":"2023-05-10T04:19:15.201730+0000","last_became_active":"2023-05-10T04:19:09.977096+0000","last_became_peered":"2023-05-10T04:19:09.977096+0000","last_unstale":"2023-05-10T04:19:15.201730+0000","last_undegraded":"2023-05-10T04:19:15.201730+0000","last_fullsized":"2023-05-10T04:19:15.201730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:08:03.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203498+0000","last_change":"2023-05-10T04:19:09.983987+0000","last_active":"2023-05-10T04:19:15.203498+0000","last_peered":"2023-05-10T04:19:15.203498+0000","last_clean":"2023-05-10T04:19:15.203498+0000","last_became_active":"2023-05-10T04:19:09.983498+0000","last_became_peered":"2023-05-10T04:19:09.983498+0000","last_unstale":"2023-05-10T04:19:15.203498+0000","last_undegraded":"2023-05-10T04:19:15.203498+0000","last_fullsized":"2023-05-10T04:19:15.203498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:24:07.309535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470244+0000","last_change":"2023-05-10T04:19:09.985793+0000","last_active":"2023-05-10T04:19:14.470244+0000","last_peered":"2023-05-10T04:19:14.470244+0000","last_clean":"2023-05-10T04:19:14.470244+0000","last_became_active":"2023-05-10T04:19:09.985536+0000","last_became_peered":"2023-05-10T04:19:09.985536+0000","last_unstale":"2023-05-10T04:19:14.470244+0000","last_undegraded":"2023-05-10T04:19:14.470244+0000","last_fullsized":"2023-05-10T04:19:14.470244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:26:03.971644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204267+0000","last_change":"2023-05-10T04:19:09.977082+0000","last_active":"2023-05-10T04:19:15.204267+0000","last_peered":"2023-05-10T04:19:15.204267+0000","last_clean":"2023-05-10T04:19:15.204267+0000","last_became_active":"2023-05-10T04:19:09.976807+0000","last_became_peered":"2023-05-10T04:19:09.976807+0000","last_unstale":"2023-05-10T04:19:15.204267+0000","last_undegraded":"2023-05-10T04:19:15.204267+0000","last_fullsized":"2023-05-10T04:19:15.204267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:57.684710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204207+0000","last_change":"2023-05-10T04:19:09.977165+0000","last_active":"2023-05-10T04:19:15.204207+0000","last_peered":"2023-05-10T04:19:15.204207+0000","last_clean":"2023-05-10T04:19:15.204207+0000","last_became_active":"2023-05-10T04:19:09.976881+0000","last_became_peered":"2023-05-10T04:19:09.976881+0000","last_unstale":"2023-05-10T04:19:15.204207+0000","last_undegraded":"2023-05-10T04:19:15.204207+0000","last_fullsized":"2023-05-10T04:19:15.204207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:33:39.200185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578113+0000","last_change":"2023-05-10T04:19:09.981309+0000","last_active":"2023-05-10T04:19:14.578113+0000","last_peered":"2023-05-10T04:19:14.578113+0000","last_clean":"2023-05-10T04:19:14.578113+0000","last_became_active":"2023-05-10T04:19:09.981029+0000","last_became_peered":"2023-05-10T04:19:09.981029+0000","last_unstale":"2023-05-10T04:19:14.578113+0000","last_undegraded":"2023-05-10T04:19:14.578113+0000","last_fullsized":"2023-05-10T04:19:14.578113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:39:32.302218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468965+0000","last_change":"2023-05-10T04:19:09.986829+0000","last_active":"2023-05-10T04:19:14.468965+0000","last_peered":"2023-05-10T04:19:14.468965+0000","last_clean":"2023-05-10T04:19:14.468965+0000","last_became_active":"2023-05-10T04:19:09.986539+0000","last_became_peered":"2023-05-10T04:19:09.986539+0000","last_unstale":"2023-05-10T04:19:14.468965+0000","last_undegraded":"2023-05-10T04:19:14.468965+0000","last_fullsized":"2023-05-10T04:19:14.468965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:01.243491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203681+0000","last_change":"2023-05-10T04:19:09.985452+0000","last_active":"2023-05-10T04:19:15.203681+0000","last_peered":"2023-05-10T04:19:15.203681+0000","last_clean":"2023-05-10T04:19:15.203681+0000","last_became_active":"2023-05-10T04:19:09.985150+0000","last_became_peered":"2023-05-10T04:19:09.985150+0000","last_unstale":"2023-05-10T04:19:15.203681+0000","last_undegraded":"2023-05-10T04:19:15.203681+0000","last_fullsized":"2023-05-10T04:19:15.203681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:01:52.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468391+0000","last_change":"2023-05-10T04:19:09.976517+0000","last_active":"2023-05-10T04:19:14.468391+0000","last_peered":"2023-05-10T04:19:14.468391+0000","last_clean":"2023-05-10T04:19:14.468391+0000","last_became_active":"2023-05-10T04:19:09.976213+0000","last_became_peered":"2023-05-10T04:19:09.976213+0000","last_unstale":"2023-05-10T04:19:14.468391+0000","last_undegraded":"2023-05-10T04:19:14.468391+0000","last_fullsized":"2023-05-10T04:19:14.468391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:16.831438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201721+0000","last_change":"2023-05-10T04:19:09.974190+0000","last_active":"2023-05-10T04:19:15.201721+0000","last_peered":"2023-05-10T04:19:15.201721+0000","last_clean":"2023-05-10T04:19:15.201721+0000","last_became_active":"2023-05-10T04:19:09.973917+0000","last_became_peered":"2023-05-10T04:19:09.973917+0000","last_unstale":"2023-05-10T04:19:15.201721+0000","last_undegraded":"2023-05-10T04:19:15.201721+0000","last_fullsized":"2023-05-10T04:19:15.201721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:23:32.089101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628444+0000","last_change":"2023-05-10T04:19:09.976310+0000","last_active":"2023-05-10T04:19:14.628444+0000","last_peered":"2023-05-10T04:19:14.628444+0000","last_clean":"2023-05-10T04:19:14.628444+0000","last_became_active":"2023-05-10T04:19:09.975809+0000","last_became_peered":"2023-05-10T04:19:09.975809+0000","last_unstale":"2023-05-10T04:19:14.628444+0000","last_undegraded":"2023-05-10T04:19:14.628444+0000","last_fullsized":"2023-05-10T04:19:14.628444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:07.446800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468880+0000","last_change":"2023-05-10T04:19:09.980962+0000","last_active":"2023-05-10T04:19:14.468880+0000","last_peered":"2023-05-10T04:19:14.468880+0000","last_clean":"2023-05-10T04:19:14.468880+0000","last_became_active":"2023-05-10T04:19:09.980600+0000","last_became_peered":"2023-05-10T04:19:09.980600+0000","last_unstale":"2023-05-10T04:19:14.468880+0000","last_undegraded":"2023-05-10T04:19:14.468880+0000","last_fullsized":"2023-05-10T04:19:14.468880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:02.084506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578180+0000","last_change":"2023-05-10T04:19:09.983155+0000","last_active":"2023-05-10T04:19:14.578180+0000","last_peered":"2023-05-10T04:19:14.578180+0000","last_clean":"2023-05-10T04:19:14.578180+0000","last_became_active":"2023-05-10T04:19:09.982831+0000","last_became_peered":"2023-05-10T04:19:09.982831+0000","last_unstale":"2023-05-10T04:19:14.578180+0000","last_undegraded":"2023-05-10T04:19:14.578180+0000","last_fullsized":"2023-05-10T04:19:14.578180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:33:39.200185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204200+0000","last_change":"2023-05-10T04:19:09.974974+0000","last_active":"2023-05-10T04:19:15.204200+0000","last_peered":"2023-05-10T04:19:15.204200+0000","last_clean":"2023-05-10T04:19:15.204200+0000","last_became_active":"2023-05-10T04:19:09.974693+0000","last_became_peered":"2023-05-10T04:19:09.974693+0000","last_unstale":"2023-05-10T04:19:15.204200+0000","last_undegraded":"2023-05-10T04:19:15.204200+0000","last_fullsized":"2023-05-10T04:19:15.204200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:55:21.820447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203862+0000","last_change":"2023-05-10T04:19:09.986983+0000","last_active":"2023-05-10T04:19:15.203862+0000","last_peered":"2023-05-10T04:19:15.203862+0000","last_clean":"2023-05-10T04:19:15.203862+0000","last_became_active":"2023-05-10T04:19:09.986701+0000","last_became_peered":"2023-05-10T04:19:09.986701+0000","last_unstale":"2023-05-10T04:19:15.203862+0000","last_undegraded":"2023-05-10T04:19:15.203862+0000","last_fullsized":"2023-05-10T04:19:15.203862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:21:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627999+0000","last_change":"2023-05-10T04:19:09.977136+0000","last_active":"2023-05-10T04:19:14.627999+0000","last_peered":"2023-05-10T04:19:14.627999+0000","last_clean":"2023-05-10T04:19:14.627999+0000","last_became_active":"2023-05-10T04:19:09.976794+0000","last_became_peered":"2023-05-10T04:19:09.976794+0000","last_unstale":"2023-05-10T04:19:14.627999+0000","last_undegraded":"2023-05-10T04:19:14.627999+0000","last_fullsized":"2023-05-10T04:19:14.627999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:19:39.672723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469767+0000","last_change":"2023-05-10T04:19:09.984844+0000","last_active":"2023-05-10T04:19:14.469767+0000","last_peered":"2023-05-10T04:19:14.469767+0000","last_clean":"2023-05-10T04:19:14.469767+0000","last_became_active":"2023-05-10T04:19:09.984531+0000","last_became_peered":"2023-05-10T04:19:09.984531+0000","last_unstale":"2023-05-10T04:19:14.469767+0000","last_undegraded":"2023-05-10T04:19:14.469767+0000","last_fullsized":"2023-05-10T04:19:14.469767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:33.935006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203424+0000","last_change":"2023-05-10T04:19:09.986208+0000","last_active":"2023-05-10T04:19:15.203424+0000","last_peered":"2023-05-10T04:19:15.203424+0000","last_clean":"2023-05-10T04:19:15.203424+0000","last_became_active":"2023-05-10T04:19:09.985544+0000","last_became_peered":"2023-05-10T04:19:09.985544+0000","last_unstale":"2023-05-10T04:19:15.203424+0000","last_undegraded":"2023-05-10T04:19:15.203424+0000","last_fullsized":"2023-05-10T04:19:15.203424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:08.821912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470497+0000","last_change":"2023-05-10T04:19:09.960642+0000","last_active":"2023-05-10T04:19:14.470497+0000","last_peered":"2023-05-10T04:19:14.470497+0000","last_clean":"2023-05-10T04:19:14.470497+0000","last_became_active":"2023-05-10T04:19:09.960283+0000","last_became_peered":"2023-05-10T04:19:09.960283+0000","last_unstale":"2023-05-10T04:19:14.470497+0000","last_undegraded":"2023-05-10T04:19:14.470497+0000","last_fullsized":"2023-05-10T04:19:14.470497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:57:41.293004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628247+0000","last_change":"2023-05-10T04:19:09.977728+0000","last_active":"2023-05-10T04:19:14.628247+0000","last_peered":"2023-05-10T04:19:14.628247+0000","last_clean":"2023-05-10T04:19:14.628247+0000","last_became_active":"2023-05-10T04:19:09.971618+0000","last_became_peered":"2023-05-10T04:19:09.971618+0000","last_unstale":"2023-05-10T04:19:14.628247+0000","last_undegraded":"2023-05-10T04:19:14.628247+0000","last_fullsized":"2023-05-10T04:19:14.628247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:55.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202232+0000","last_change":"2023-05-10T04:19:09.972981+0000","last_active":"2023-05-10T04:19:15.202232+0000","last_peered":"2023-05-10T04:19:15.202232+0000","last_clean":"2023-05-10T04:19:15.202232+0000","last_became_active":"2023-05-10T04:19:09.972690+0000","last_became_peered":"2023-05-10T04:19:09.972690+0000","last_unstale":"2023-05-10T04:19:15.202232+0000","last_undegraded":"2023-05-10T04:19:15.202232+0000","last_fullsized":"2023-05-10T04:19:15.202232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:35:07.369264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202719+0000","last_change":"2023-05-10T04:19:13.994524+0000","last_active":"2023-05-10T04:19:15.202719+0000","last_peered":"2023-05-10T04:19:15.202719+0000","last_clean":"2023-05-10T04:19:15.202719+0000","last_became_active":"2023-05-10T04:19:13.994164+0000","last_became_peered":"2023-05-10T04:19:13.994164+0000","last_unstale":"2023-05-10T04:19:15.202719+0000","last_undegraded":"2023-05-10T04:19:15.202719+0000","last_fullsized":"2023-05-10T04:19:15.202719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:16.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203829+0000","last_change":"2023-05-10T04:19:09.487208+0000","last_active":"2023-05-10T04:19:15.203829+0000","last_peered":"2023-05-10T04:19:15.203829+0000","last_clean":"2023-05-10T04:19:15.203829+0000","last_became_active":"2023-05-10T04:19:09.486969+0000","last_became_peered":"2023-05-10T04:19:09.486969+0000","last_unstale":"2023-05-10T04:19:15.203829+0000","last_undegraded":"2023-05-10T04:19:15.203829+0000","last_fullsized":"2023-05-10T04:19:15.203829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:03.029871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628183+0000","last_change":"2023-05-10T04:19:09.982864+0000","last_active":"2023-05-10T04:19:14.628183+0000","last_peered":"2023-05-10T04:19:14.628183+0000","last_clean":"2023-05-10T04:19:14.628183+0000","last_became_active":"2023-05-10T04:19:09.982599+0000","last_became_peered":"2023-05-10T04:19:09.982599+0000","last_unstale":"2023-05-10T04:19:14.628183+0000","last_undegraded":"2023-05-10T04:19:14.628183+0000","last_fullsized":"2023-05-10T04:19:14.628183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:56:49.205595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203762+0000","last_change":"2023-05-10T04:19:13.991870+0000","last_active":"2023-05-10T04:19:15.203762+0000","last_peered":"2023-05-10T04:19:15.203762+0000","last_clean":"2023-05-10T04:19:15.203762+0000","last_became_active":"2023-05-10T04:19:13.991396+0000","last_became_peered":"2023-05-10T04:19:13.991396+0000","last_unstale":"2023-05-10T04:19:15.203762+0000","last_undegraded":"2023-05-10T04:19:15.203762+0000","last_fullsized":"2023-05-10T04:19:15.203762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:04.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469470+0000","last_change":"2023-05-10T04:19:09.483051+0000","last_active":"2023-05-10T04:19:14.469470+0000","last_peered":"2023-05-10T04:19:14.469470+0000","last_clean":"2023-05-10T04:19:14.469470+0000","last_became_active":"2023-05-10T04:19:09.482746+0000","last_became_peered":"2023-05-10T04:19:09.482746+0000","last_unstale":"2023-05-10T04:19:14.469470+0000","last_undegraded":"2023-05-10T04:19:14.469470+0000","last_fullsized":"2023-05-10T04:19:14.469470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:40:44.146612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470309+0000","last_change":"2023-05-10T04:19:09.983015+0000","last_active":"2023-05-10T04:19:14.470309+0000","last_peered":"2023-05-10T04:19:14.470309+0000","last_clean":"2023-05-10T04:19:14.470309+0000","last_became_active":"2023-05-10T04:19:09.982704+0000","last_became_peered":"2023-05-10T04:19:09.982704+0000","last_unstale":"2023-05-10T04:19:14.470309+0000","last_undegraded":"2023-05-10T04:19:14.470309+0000","last_fullsized":"2023-05-10T04:19:14.470309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:01:13.105870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468779+0000","last_change":"2023-05-10T04:19:13.991979+0000","last_active":"2023-05-10T04:19:14.468779+0000","last_peered":"2023-05-10T04:19:14.468779+0000","last_clean":"2023-05-10T04:19:14.468779+0000","last_became_active":"2023-05-10T04:19:13.991551+0000","last_became_peered":"2023-05-10T04:19:13.991551+0000","last_unstale":"2023-05-10T04:19:14.468779+0000","last_undegraded":"2023-05-10T04:19:14.468779+0000","last_fullsized":"2023-05-10T04:19:14.468779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:08:02.858561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577630+0000","last_change":"2023-05-10T04:19:09.480268+0000","last_active":"2023-05-10T04:19:14.577630+0000","last_peered":"2023-05-10T04:19:14.577630+0000","last_clean":"2023-05-10T04:19:14.577630+0000","last_became_active":"2023-05-10T04:19:09.480011+0000","last_became_peered":"2023-05-10T04:19:09.480011+0000","last_unstale":"2023-05-10T04:19:14.577630+0000","last_undegraded":"2023-05-10T04:19:14.577630+0000","last_fullsized":"2023-05-10T04:19:14.577630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:21.331301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202970+0000","last_change":"2023-05-10T04:19:09.981253+0000","last_active":"2023-05-10T04:19:15.202970+0000","last_peered":"2023-05-10T04:19:15.202970+0000","last_clean":"2023-05-10T04:19:15.202970+0000","last_became_active":"2023-05-10T04:19:09.981006+0000","last_became_peered":"2023-05-10T04:19:09.981006+0000","last_unstale":"2023-05-10T04:19:15.202970+0000","last_undegraded":"2023-05-10T04:19:15.202970+0000","last_fullsized":"2023-05-10T04:19:15.202970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:03.498156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201539+0000","last_change":"2023-05-10T04:19:13.987144+0000","last_active":"2023-05-10T04:19:15.201539+0000","last_peered":"2023-05-10T04:19:15.201539+0000","last_clean":"2023-05-10T04:19:15.201539+0000","last_became_active":"2023-05-10T04:19:13.986831+0000","last_became_peered":"2023-05-10T04:19:13.986831+0000","last_unstale":"2023-05-10T04:19:15.201539+0000","last_undegraded":"2023-05-10T04:19:15.201539+0000","last_fullsized":"2023-05-10T04:19:15.201539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:17:32.556742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578392+0000","last_change":"2023-05-10T04:19:09.478894+0000","last_active":"2023-05-10T04:19:14.578392+0000","last_peered":"2023-05-10T04:19:14.578392+0000","last_clean":"2023-05-10T04:19:14.578392+0000","last_became_active":"2023-05-10T04:19:09.478612+0000","last_became_peered":"2023-05-10T04:19:09.478612+0000","last_unstale":"2023-05-10T04:19:14.578392+0000","last_undegraded":"2023-05-10T04:19:14.578392+0000","last_fullsized":"2023-05-10T04:19:14.578392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:18:29.989914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627929+0000","last_change":"2023-05-10T04:19:09.975444+0000","last_active":"2023-05-10T04:19:14.627929+0000","last_peered":"2023-05-10T04:19:14.627929+0000","last_clean":"2023-05-10T04:19:14.627929+0000","last_became_active":"2023-05-10T04:19:09.971745+0000","last_became_peered":"2023-05-10T04:19:09.971745+0000","last_unstale":"2023-05-10T04:19:14.627929+0000","last_undegraded":"2023-05-10T04:19:14.627929+0000","last_fullsized":"2023-05-10T04:19:14.627929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:35:02.017465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201957+0000","last_change":"2023-05-10T04:19:14.001881+0000","last_active":"2023-05-10T04:19:15.201957+0000","last_peered":"2023-05-10T04:19:15.201957+0000","last_clean":"2023-05-10T04:19:15.201957+0000","last_became_active":"2023-05-10T04:19:14.001490+0000","last_became_peered":"2023-05-10T04:19:14.001490+0000","last_unstale":"2023-05-10T04:19:15.201957+0000","last_undegraded":"2023-05-10T04:19:15.201957+0000","last_fullsized":"2023-05-10T04:19:15.201957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:10.947560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202406+0000","last_change":"2023-05-10T04:19:09.479617+0000","last_active":"2023-05-10T04:19:15.202406+0000","last_peered":"2023-05-10T04:19:15.202406+0000","last_clean":"2023-05-10T04:19:15.202406+0000","last_became_active":"2023-05-10T04:19:09.479285+0000","last_became_peered":"2023-05-10T04:19:09.479285+0000","last_unstale":"2023-05-10T04:19:15.202406+0000","last_undegraded":"2023-05-10T04:19:15.202406+0000","last_fullsized":"2023-05-10T04:19:15.202406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:39:56.952219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469360+0000","last_change":"2023-05-10T04:19:09.972832+0000","last_active":"2023-05-10T04:19:14.469360+0000","last_peered":"2023-05-10T04:19:14.469360+0000","last_clean":"2023-05-10T04:19:14.469360+0000","last_became_active":"2023-05-10T04:19:09.972564+0000","last_became_peered":"2023-05-10T04:19:09.972564+0000","last_unstale":"2023-05-10T04:19:14.469360+0000","last_undegraded":"2023-05-10T04:19:14.469360+0000","last_fullsized":"2023-05-10T04:19:14.469360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:04:31.918880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468579+0000","last_change":"2023-05-10T04:19:13.994267+0000","last_active":"2023-05-10T04:19:14.468579+0000","last_peered":"2023-05-10T04:19:14.468579+0000","last_clean":"2023-05-10T04:19:14.468579+0000","last_became_active":"2023-05-10T04:19:13.993865+0000","last_became_peered":"2023-05-10T04:19:13.993865+0000","last_unstale":"2023-05-10T04:19:14.468579+0000","last_undegraded":"2023-05-10T04:19:14.468579+0000","last_fullsized":"2023-05-10T04:19:14.468579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:51:00.039452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468689+0000","last_change":"2023-05-10T04:19:09.484992+0000","last_active":"2023-05-10T04:19:14.468689+0000","last_peered":"2023-05-10T04:19:14.468689+0000","last_clean":"2023-05-10T04:19:14.468689+0000","last_became_active":"2023-05-10T04:19:09.484709+0000","last_became_peered":"2023-05-10T04:19:09.484709+0000","last_unstale":"2023-05-10T04:19:14.468689+0000","last_undegraded":"2023-05-10T04:19:14.468689+0000","last_fullsized":"2023-05-10T04:19:14.468689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:06.444490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469770+0000","last_change":"2023-05-10T04:19:09.964540+0000","last_active":"2023-05-10T04:19:14.469770+0000","last_peered":"2023-05-10T04:19:14.469770+0000","last_clean":"2023-05-10T04:19:14.469770+0000","last_became_active":"2023-05-10T04:19:09.964164+0000","last_became_peered":"2023-05-10T04:19:09.964164+0000","last_unstale":"2023-05-10T04:19:14.469770+0000","last_undegraded":"2023-05-10T04:19:14.469770+0000","last_fullsized":"2023-05-10T04:19:14.469770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:13:47.427518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468432+0000","last_change":"2023-05-10T04:19:13.997349+0000","last_active":"2023-05-10T04:19:14.468432+0000","last_peered":"2023-05-10T04:19:14.468432+0000","last_clean":"2023-05-10T04:19:14.468432+0000","last_became_active":"2023-05-10T04:19:13.996910+0000","last_became_peered":"2023-05-10T04:19:13.996910+0000","last_unstale":"2023-05-10T04:19:14.468432+0000","last_undegraded":"2023-05-10T04:19:14.468432+0000","last_fullsized":"2023-05-10T04:19:14.468432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:27:38.893568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:28.525847+0000","last_change":"2023-05-10T04:19:09.487001+0000","last_active":"2023-05-10T04:19:28.525847+0000","last_peered":"2023-05-10T04:19:28.525847+0000","last_clean":"2023-05-10T04:19:28.525847+0000","last_became_active":"2023-05-10T04:19:09.486586+0000","last_became_peered":"2023-05-10T04:19:09.486586+0000","last_unstale":"2023-05-10T04:19:28.525847+0000","last_undegraded":"2023-05-10T04:19:28.525847+0000","last_fullsized":"2023-05-10T04:19:28.525847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:00:37.583297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202590+0000","last_change":"2023-05-10T04:19:09.957140+0000","last_active":"2023-05-10T04:19:15.202590+0000","last_peered":"2023-05-10T04:19:15.202590+0000","last_clean":"2023-05-10T04:19:15.202590+0000","last_became_active":"2023-05-10T04:19:09.956865+0000","last_became_peered":"2023-05-10T04:19:09.956865+0000","last_unstale":"2023-05-10T04:19:15.202590+0000","last_undegraded":"2023-05-10T04:19:15.202590+0000","last_fullsized":"2023-05-10T04:19:15.202590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:02.330187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202728+0000","last_change":"2023-05-10T04:19:13.993185+0000","last_active":"2023-05-10T04:19:15.202728+0000","last_peered":"2023-05-10T04:19:15.202728+0000","last_clean":"2023-05-10T04:19:15.202728+0000","last_became_active":"2023-05-10T04:19:13.992692+0000","last_became_peered":"2023-05-10T04:19:13.992692+0000","last_unstale":"2023-05-10T04:19:15.202728+0000","last_undegraded":"2023-05-10T04:19:15.202728+0000","last_fullsized":"2023-05-10T04:19:15.202728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:47:10.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202224+0000","last_change":"2023-05-10T04:19:09.484968+0000","last_active":"2023-05-10T04:19:15.202224+0000","last_peered":"2023-05-10T04:19:15.202224+0000","last_clean":"2023-05-10T04:19:15.202224+0000","last_became_active":"2023-05-10T04:19:09.484666+0000","last_became_peered":"2023-05-10T04:19:09.484666+0000","last_unstale":"2023-05-10T04:19:15.202224+0000","last_undegraded":"2023-05-10T04:19:15.202224+0000","last_fullsized":"2023-05-10T04:19:15.202224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:34:47.348283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468720+0000","last_change":"2023-05-10T04:19:09.965098+0000","last_active":"2023-05-10T04:19:14.468720+0000","last_peered":"2023-05-10T04:19:14.468720+0000","last_clean":"2023-05-10T04:19:14.468720+0000","last_became_active":"2023-05-10T04:19:09.964725+0000","last_became_peered":"2023-05-10T04:19:09.964725+0000","last_unstale":"2023-05-10T04:19:14.468720+0000","last_undegraded":"2023-05-10T04:19:14.468720+0000","last_fullsized":"2023-05-10T04:19:14.468720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:03.210099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469999+0000","last_change":"2023-05-10T04:19:13.993540+0000","last_active":"2023-05-10T04:19:14.469999+0000","last_peered":"2023-05-10T04:19:14.469999+0000","last_clean":"2023-05-10T04:19:14.469999+0000","last_became_active":"2023-05-10T04:19:13.993066+0000","last_became_peered":"2023-05-10T04:19:13.993066+0000","last_unstale":"2023-05-10T04:19:14.469999+0000","last_undegraded":"2023-05-10T04:19:14.469999+0000","last_fullsized":"2023-05-10T04:19:14.469999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:14:45.505584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470101+0000","last_change":"2023-05-10T04:19:09.488098+0000","last_active":"2023-05-10T04:19:14.470101+0000","last_peered":"2023-05-10T04:19:14.470101+0000","last_clean":"2023-05-10T04:19:14.470101+0000","last_became_active":"2023-05-10T04:19:09.487742+0000","last_became_peered":"2023-05-10T04:19:09.487742+0000","last_unstale":"2023-05-10T04:19:14.470101+0000","last_undegraded":"2023-05-10T04:19:14.470101+0000","last_fullsized":"2023-05-10T04:19:14.470101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:07.819601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202937+0000","last_change":"2023-05-10T04:19:09.972874+0000","last_active":"2023-05-10T04:19:15.202937+0000","last_peered":"2023-05-10T04:19:15.202937+0000","last_clean":"2023-05-10T04:19:15.202937+0000","last_became_active":"2023-05-10T04:19:09.972566+0000","last_became_peered":"2023-05-10T04:19:09.972566+0000","last_unstale":"2023-05-10T04:19:15.202937+0000","last_undegraded":"2023-05-10T04:19:15.202937+0000","last_fullsized":"2023-05-10T04:19:15.202937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:13:49.010588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470263+0000","last_change":"2023-05-10T04:19:13.993797+0000","last_active":"2023-05-10T04:19:14.470263+0000","last_peered":"2023-05-10T04:19:14.470263+0000","last_clean":"2023-05-10T04:19:14.470263+0000","last_became_active":"2023-05-10T04:19:13.993365+0000","last_became_peered":"2023-05-10T04:19:13.993365+0000","last_unstale":"2023-05-10T04:19:14.470263+0000","last_undegraded":"2023-05-10T04:19:14.470263+0000","last_fullsized":"2023-05-10T04:19:14.470263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:09:47.459492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201324+0000","last_change":"2023-05-10T04:19:09.486993+0000","last_active":"2023-05-10T04:19:15.201324+0000","last_peered":"2023-05-10T04:19:15.201324+0000","last_clean":"2023-05-10T04:19:15.201324+0000","last_became_active":"2023-05-10T04:19:09.486669+0000","last_became_peered":"2023-05-10T04:19:09.486669+0000","last_unstale":"2023-05-10T04:19:15.201324+0000","last_undegraded":"2023-05-10T04:19:15.201324+0000","last_fullsized":"2023-05-10T04:19:15.201324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:16:36.569982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578044+0000","last_change":"2023-05-10T04:19:09.983016+0000","last_active":"2023-05-10T04:19:14.578044+0000","last_peered":"2023-05-10T04:19:14.578044+0000","last_clean":"2023-05-10T04:19:14.578044+0000","last_became_active":"2023-05-10T04:19:09.982497+0000","last_became_peered":"2023-05-10T04:19:09.982497+0000","last_unstale":"2023-05-10T04:19:14.578044+0000","last_undegraded":"2023-05-10T04:19:14.578044+0000","last_fullsized":"2023-05-10T04:19:14.578044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:21:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203604+0000","last_change":"2023-05-10T04:19:13.994827+0000","last_active":"2023-05-10T04:19:15.203604+0000","last_peered":"2023-05-10T04:19:15.203604+0000","last_clean":"2023-05-10T04:19:15.203604+0000","last_became_active":"2023-05-10T04:19:13.994438+0000","last_became_peered":"2023-05-10T04:19:13.994438+0000","last_unstale":"2023-05-10T04:19:15.203604+0000","last_undegraded":"2023-05-10T04:19:15.203604+0000","last_fullsized":"2023-05-10T04:19:15.203604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:46.248734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203225+0000","last_change":"2023-05-10T04:19:09.487877+0000","last_active":"2023-05-10T04:19:15.203225+0000","last_peered":"2023-05-10T04:19:15.203225+0000","last_clean":"2023-05-10T04:19:15.203225+0000","last_became_active":"2023-05-10T04:19:09.487604+0000","last_became_peered":"2023-05-10T04:19:09.487604+0000","last_unstale":"2023-05-10T04:19:15.203225+0000","last_undegraded":"2023-05-10T04:19:15.203225+0000","last_fullsized":"2023-05-10T04:19:15.203225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:53:17.665016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578524+0000","last_change":"2023-05-10T04:19:09.980726+0000","last_active":"2023-05-10T04:19:14.578524+0000","last_peered":"2023-05-10T04:19:14.578524+0000","last_clean":"2023-05-10T04:19:14.578524+0000","last_became_active":"2023-05-10T04:19:09.980180+0000","last_became_peered":"2023-05-10T04:19:09.980180+0000","last_unstale":"2023-05-10T04:19:14.578524+0000","last_undegraded":"2023-05-10T04:19:14.578524+0000","last_fullsized":"2023-05-10T04:19:14.578524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:00.301504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203398+0000","last_change":"2023-05-10T04:19:14.003780+0000","last_active":"2023-05-10T04:19:15.203398+0000","last_peered":"2023-05-10T04:19:15.203398+0000","last_clean":"2023-05-10T04:19:15.203398+0000","last_became_active":"2023-05-10T04:19:14.003409+0000","last_became_peered":"2023-05-10T04:19:14.003409+0000","last_unstale":"2023-05-10T04:19:15.203398+0000","last_undegraded":"2023-05-10T04:19:15.203398+0000","last_fullsized":"2023-05-10T04:19:15.203398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:50:12.629644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469034+0000","last_change":"2023-05-10T04:19:09.483762+0000","last_active":"2023-05-10T04:19:14.469034+0000","last_peered":"2023-05-10T04:19:14.469034+0000","last_clean":"2023-05-10T04:19:14.469034+0000","last_became_active":"2023-05-10T04:19:09.483508+0000","last_became_peered":"2023-05-10T04:19:09.483508+0000","last_unstale":"2023-05-10T04:19:14.469034+0000","last_undegraded":"2023-05-10T04:19:14.469034+0000","last_fullsized":"2023-05-10T04:19:14.469034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:01.327876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201995+0000","last_change":"2023-05-10T04:19:09.978563+0000","last_active":"2023-05-10T04:19:15.201995+0000","last_peered":"2023-05-10T04:19:15.201995+0000","last_clean":"2023-05-10T04:19:15.201995+0000","last_became_active":"2023-05-10T04:19:09.978238+0000","last_became_peered":"2023-05-10T04:19:09.978238+0000","last_unstale":"2023-05-10T04:19:15.201995+0000","last_undegraded":"2023-05-10T04:19:15.201995+0000","last_fullsized":"2023-05-10T04:19:15.201995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:20:11.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468304+0000","last_change":"2023-05-10T04:19:13.991533+0000","last_active":"2023-05-10T04:19:14.468304+0000","last_peered":"2023-05-10T04:19:14.468304+0000","last_clean":"2023-05-10T04:19:14.468304+0000","last_became_active":"2023-05-10T04:19:13.990999+0000","last_became_peered":"2023-05-10T04:19:13.990999+0000","last_unstale":"2023-05-10T04:19:14.468304+0000","last_undegraded":"2023-05-10T04:19:14.468304+0000","last_fullsized":"2023-05-10T04:19:14.468304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:05.585266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202273+0000","last_change":"2023-05-10T04:19:09.485526+0000","last_active":"2023-05-10T04:19:15.202273+0000","last_peered":"2023-05-10T04:19:15.202273+0000","last_clean":"2023-05-10T04:19:15.202273+0000","last_became_active":"2023-05-10T04:19:09.485273+0000","last_became_peered":"2023-05-10T04:19:09.485273+0000","last_unstale":"2023-05-10T04:19:15.202273+0000","last_undegraded":"2023-05-10T04:19:15.202273+0000","last_fullsized":"2023-05-10T04:19:15.202273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:41.760079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203432+0000","last_change":"2023-05-10T04:19:09.985453+0000","last_active":"2023-05-10T04:19:15.203432+0000","last_peered":"2023-05-10T04:19:15.203432+0000","last_clean":"2023-05-10T04:19:15.203432+0000","last_became_active":"2023-05-10T04:19:09.985167+0000","last_became_peered":"2023-05-10T04:19:09.985167+0000","last_unstale":"2023-05-10T04:19:15.203432+0000","last_undegraded":"2023-05-10T04:19:15.203432+0000","last_fullsized":"2023-05-10T04:19:15.203432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:22.333611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577827+0000","last_change":"2023-05-10T04:19:14.004309+0000","last_active":"2023-05-10T04:19:14.577827+0000","last_peered":"2023-05-10T04:19:14.577827+0000","last_clean":"2023-05-10T04:19:14.577827+0000","last_became_active":"2023-05-10T04:19:14.003928+0000","last_became_peered":"2023-05-10T04:19:14.003928+0000","last_unstale":"2023-05-10T04:19:14.577827+0000","last_undegraded":"2023-05-10T04:19:14.577827+0000","last_fullsized":"2023-05-10T04:19:14.577827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:24:10.810295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202378+0000","last_change":"2023-05-10T04:19:09.482542+0000","last_active":"2023-05-10T04:19:15.202378+0000","last_peered":"2023-05-10T04:19:15.202378+0000","last_clean":"2023-05-10T04:19:15.202378+0000","last_became_active":"2023-05-10T04:19:09.482173+0000","last_became_peered":"2023-05-10T04:19:09.482173+0000","last_unstale":"2023-05-10T04:19:15.202378+0000","last_undegraded":"2023-05-10T04:19:15.202378+0000","last_fullsized":"2023-05-10T04:19:15.202378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:55:03.870485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202375+0000","last_change":"2023-05-10T04:19:09.957801+0000","last_active":"2023-05-10T04:19:15.202375+0000","last_peered":"2023-05-10T04:19:15.202375+0000","last_clean":"2023-05-10T04:19:15.202375+0000","last_became_active":"2023-05-10T04:19:09.957469+0000","last_became_peered":"2023-05-10T04:19:09.957469+0000","last_unstale":"2023-05-10T04:19:15.202375+0000","last_undegraded":"2023-05-10T04:19:15.202375+0000","last_fullsized":"2023-05-10T04:19:15.202375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:26:39.953202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469741+0000","last_change":"2023-05-10T04:19:13.991736+0000","last_active":"2023-05-10T04:19:14.469741+0000","last_peered":"2023-05-10T04:19:14.469741+0000","last_clean":"2023-05-10T04:19:14.469741+0000","last_became_active":"2023-05-10T04:19:13.991194+0000","last_became_peered":"2023-05-10T04:19:13.991194+0000","last_unstale":"2023-05-10T04:19:14.469741+0000","last_undegraded":"2023-05-10T04:19:14.469741+0000","last_fullsized":"2023-05-10T04:19:14.469741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:50:12.629644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468850+0000","last_change":"2023-05-10T04:19:09.483818+0000","last_active":"2023-05-10T04:19:14.468850+0000","last_peered":"2023-05-10T04:19:14.468850+0000","last_clean":"2023-05-10T04:19:14.468850+0000","last_became_active":"2023-05-10T04:19:09.483516+0000","last_became_peered":"2023-05-10T04:19:09.483516+0000","last_unstale":"2023-05-10T04:19:14.468850+0000","last_undegraded":"2023-05-10T04:19:14.468850+0000","last_fullsized":"2023-05-10T04:19:14.468850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:39:56.952219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577909+0000","last_change":"2023-05-10T04:19:09.979521+0000","last_active":"2023-05-10T04:19:14.577909+0000","last_peered":"2023-05-10T04:19:14.577909+0000","last_clean":"2023-05-10T04:19:14.577909+0000","last_became_active":"2023-05-10T04:19:09.979271+0000","last_became_peered":"2023-05-10T04:19:09.979271+0000","last_unstale":"2023-05-10T04:19:14.577909+0000","last_undegraded":"2023-05-10T04:19:14.577909+0000","last_fullsized":"2023-05-10T04:19:14.577909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:05:43.697518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628055+0000","last_change":"2023-05-10T04:19:13.998610+0000","last_active":"2023-05-10T04:19:14.628055+0000","last_peered":"2023-05-10T04:19:14.628055+0000","last_clean":"2023-05-10T04:19:14.628055+0000","last_became_active":"2023-05-10T04:19:13.996908+0000","last_became_peered":"2023-05-10T04:19:13.996908+0000","last_unstale":"2023-05-10T04:19:14.628055+0000","last_undegraded":"2023-05-10T04:19:14.628055+0000","last_fullsized":"2023-05-10T04:19:14.628055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:00:47.831221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628332+0000","last_change":"2023-05-10T04:19:09.482944+0000","last_active":"2023-05-10T04:19:14.628332+0000","last_peered":"2023-05-10T04:19:14.628332+0000","last_clean":"2023-05-10T04:19:14.628332+0000","last_became_active":"2023-05-10T04:19:09.482584+0000","last_became_peered":"2023-05-10T04:19:09.482584+0000","last_unstale":"2023-05-10T04:19:14.628332+0000","last_undegraded":"2023-05-10T04:19:14.628332+0000","last_fullsized":"2023-05-10T04:19:14.628332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:22:54.728492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468803+0000","last_change":"2023-05-10T04:19:09.971873+0000","last_active":"2023-05-10T04:19:14.468803+0000","last_peered":"2023-05-10T04:19:14.468803+0000","last_clean":"2023-05-10T04:19:14.468803+0000","last_became_active":"2023-05-10T04:19:09.971597+0000","last_became_peered":"2023-05-10T04:19:09.971597+0000","last_unstale":"2023-05-10T04:19:14.468803+0000","last_undegraded":"2023-05-10T04:19:14.468803+0000","last_fullsized":"2023-05-10T04:19:14.468803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:26:39.953202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577980+0000","last_change":"2023-05-10T04:19:14.004765+0000","last_active":"2023-05-10T04:19:14.577980+0000","last_peered":"2023-05-10T04:19:14.577980+0000","last_clean":"2023-05-10T04:19:14.577980+0000","last_became_active":"2023-05-10T04:19:14.004329+0000","last_became_peered":"2023-05-10T04:19:14.004329+0000","last_unstale":"2023-05-10T04:19:14.577980+0000","last_undegraded":"2023-05-10T04:19:14.577980+0000","last_fullsized":"2023-05-10T04:19:14.577980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:01:56.052239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202125+0000","last_change":"2023-05-10T04:19:09.477530+0000","last_active":"2023-05-10T04:19:15.202125+0000","last_peered":"2023-05-10T04:19:15.202125+0000","last_clean":"2023-05-10T04:19:15.202125+0000","last_became_active":"2023-05-10T04:19:09.477212+0000","last_became_peered":"2023-05-10T04:19:09.477212+0000","last_unstale":"2023-05-10T04:19:15.202125+0000","last_undegraded":"2023-05-10T04:19:15.202125+0000","last_fullsized":"2023-05-10T04:19:15.202125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:43.682176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203043+0000","last_change":"2023-05-10T04:19:09.979824+0000","last_active":"2023-05-10T04:19:15.203043+0000","last_peered":"2023-05-10T04:19:15.203043+0000","last_clean":"2023-05-10T04:19:15.203043+0000","last_became_active":"2023-05-10T04:19:09.979050+0000","last_became_peered":"2023-05-10T04:19:09.979050+0000","last_unstale":"2023-05-10T04:19:15.203043+0000","last_undegraded":"2023-05-10T04:19:15.203043+0000","last_fullsized":"2023-05-10T04:19:15.203043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:38:42.232230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203438+0000","last_change":"2023-05-10T04:19:14.002975+0000","last_active":"2023-05-10T04:19:15.203438+0000","last_peered":"2023-05-10T04:19:15.203438+0000","last_clean":"2023-05-10T04:19:15.203438+0000","last_became_active":"2023-05-10T04:19:14.002560+0000","last_became_peered":"2023-05-10T04:19:14.002560+0000","last_unstale":"2023-05-10T04:19:15.203438+0000","last_undegraded":"2023-05-10T04:19:15.203438+0000","last_fullsized":"2023-05-10T04:19:15.203438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:23:30.609594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201619+0000","last_change":"2023-05-10T04:19:09.474972+0000","last_active":"2023-05-10T04:19:15.201619+0000","last_peered":"2023-05-10T04:19:15.201619+0000","last_clean":"2023-05-10T04:19:15.201619+0000","last_became_active":"2023-05-10T04:19:09.474099+0000","last_became_peered":"2023-05-10T04:19:09.474099+0000","last_unstale":"2023-05-10T04:19:15.201619+0000","last_undegraded":"2023-05-10T04:19:15.201619+0000","last_fullsized":"2023-05-10T04:19:15.201619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:54:08.193033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202858+0000","last_change":"2023-05-10T04:19:09.957614+0000","last_active":"2023-05-10T04:19:15.202858+0000","last_peered":"2023-05-10T04:19:15.202858+0000","last_clean":"2023-05-10T04:19:15.202858+0000","last_became_active":"2023-05-10T04:19:09.957357+0000","last_became_peered":"2023-05-10T04:19:09.957357+0000","last_unstale":"2023-05-10T04:19:15.202858+0000","last_undegraded":"2023-05-10T04:19:15.202858+0000","last_fullsized":"2023-05-10T04:19:15.202858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:58:35.622573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202916+0000","last_change":"2023-05-10T04:19:13.993397+0000","last_active":"2023-05-10T04:19:15.202916+0000","last_peered":"2023-05-10T04:19:15.202916+0000","last_clean":"2023-05-10T04:19:15.202916+0000","last_became_active":"2023-05-10T04:19:13.992829+0000","last_became_peered":"2023-05-10T04:19:13.992829+0000","last_unstale":"2023-05-10T04:19:15.202916+0000","last_undegraded":"2023-05-10T04:19:15.202916+0000","last_fullsized":"2023-05-10T04:19:15.202916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:20:16.772499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469100+0000","last_change":"2023-05-10T04:19:09.473096+0000","last_active":"2023-05-10T04:19:14.469100+0000","last_peered":"2023-05-10T04:19:14.469100+0000","last_clean":"2023-05-10T04:19:14.469100+0000","last_became_active":"2023-05-10T04:19:09.472782+0000","last_became_peered":"2023-05-10T04:19:09.472782+0000","last_unstale":"2023-05-10T04:19:14.469100+0000","last_undegraded":"2023-05-10T04:19:14.469100+0000","last_fullsized":"2023-05-10T04:19:14.469100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:55:45.107377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628277+0000","last_change":"2023-05-10T04:19:09.976127+0000","last_active":"2023-05-10T04:19:14.628277+0000","last_peered":"2023-05-10T04:19:14.628277+0000","last_clean":"2023-05-10T04:19:14.628277+0000","last_became_active":"2023-05-10T04:19:09.975290+0000","last_became_peered":"2023-05-10T04:19:09.975290+0000","last_unstale":"2023-05-10T04:19:14.628277+0000","last_undegraded":"2023-05-10T04:19:14.628277+0000","last_fullsized":"2023-05-10T04:19:14.628277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:16.352843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468740+0000","last_change":"2023-05-10T04:19:13.993845+0000","last_active":"2023-05-10T04:19:14.468740+0000","last_peered":"2023-05-10T04:19:14.468740+0000","last_clean":"2023-05-10T04:19:14.468740+0000","last_became_active":"2023-05-10T04:19:13.993409+0000","last_became_peered":"2023-05-10T04:19:13.993409+0000","last_unstale":"2023-05-10T04:19:14.468740+0000","last_undegraded":"2023-05-10T04:19:14.468740+0000","last_fullsized":"2023-05-10T04:19:14.468740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:43:57.821791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578256+0000","last_change":"2023-05-10T04:19:04.607342+0000","last_active":"2023-05-10T04:19:14.578256+0000","last_peered":"2023-05-10T04:19:14.578256+0000","last_clean":"2023-05-10T04:19:14.578256+0000","last_became_active":"2023-05-10T04:19:04.606956+0000","last_became_peered":"2023-05-10T04:19:04.606956+0000","last_unstale":"2023-05-10T04:19:14.578256+0000","last_undegraded":"2023-05-10T04:19:14.578256+0000","last_fullsized":"2023-05-10T04:19:14.578256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:51.656021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203073+0000","last_change":"2023-05-10T04:19:09.480586+0000","last_active":"2023-05-10T04:19:15.203073+0000","last_peered":"2023-05-10T04:19:15.203073+0000","last_clean":"2023-05-10T04:19:15.203073+0000","last_became_active":"2023-05-10T04:19:09.480088+0000","last_became_peered":"2023-05-10T04:19:09.480088+0000","last_unstale":"2023-05-10T04:19:15.203073+0000","last_undegraded":"2023-05-10T04:19:15.203073+0000","last_fullsized":"2023-05-10T04:19:15.203073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:07:58.355490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469903+0000","last_change":"2023-05-10T04:19:09.961077+0000","last_active":"2023-05-10T04:19:14.469903+0000","last_peered":"2023-05-10T04:19:14.469903+0000","last_clean":"2023-05-10T04:19:14.469903+0000","last_became_active":"2023-05-10T04:19:09.960790+0000","last_became_peered":"2023-05-10T04:19:09.960790+0000","last_unstale":"2023-05-10T04:19:14.469903+0000","last_undegraded":"2023-05-10T04:19:14.469903+0000","last_fullsized":"2023-05-10T04:19:14.469903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:23:27.108834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628434+0000","last_change":"2023-05-10T04:19:13.996996+0000","last_active":"2023-05-10T04:19:14.628434+0000","last_peered":"2023-05-10T04:19:14.628434+0000","last_clean":"2023-05-10T04:19:14.628434+0000","last_became_active":"2023-05-10T04:19:13.996598+0000","last_became_peered":"2023-05-10T04:19:13.996598+0000","last_unstale":"2023-05-10T04:19:14.628434+0000","last_undegraded":"2023-05-10T04:19:14.628434+0000","last_fullsized":"2023-05-10T04:19:14.628434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:28.777158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204389+0000","last_change":"2023-05-10T04:19:04.607370+0000","last_active":"2023-05-10T04:19:15.204389+0000","last_peered":"2023-05-10T04:19:15.204389+0000","last_clean":"2023-05-10T04:19:15.204389+0000","last_became_active":"2023-05-10T04:19:04.606959+0000","last_became_peered":"2023-05-10T04:19:04.606959+0000","last_unstale":"2023-05-10T04:19:15.204389+0000","last_undegraded":"2023-05-10T04:19:15.204389+0000","last_fullsized":"2023-05-10T04:19:15.204389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:46:45.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468586+0000","last_change":"2023-05-10T04:19:09.485273+0000","last_active":"2023-05-10T04:19:14.468586+0000","last_peered":"2023-05-10T04:19:14.468586+0000","last_clean":"2023-05-10T04:19:14.468586+0000","last_became_active":"2023-05-10T04:19:09.484339+0000","last_became_peered":"2023-05-10T04:19:09.484339+0000","last_unstale":"2023-05-10T04:19:14.468586+0000","last_undegraded":"2023-05-10T04:19:14.468586+0000","last_fullsized":"2023-05-10T04:19:14.468586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:22:54.728492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468949+0000","last_change":"2023-05-10T04:19:09.972782+0000","last_active":"2023-05-10T04:19:14.468949+0000","last_peered":"2023-05-10T04:19:14.468949+0000","last_clean":"2023-05-10T04:19:14.468949+0000","last_became_active":"2023-05-10T04:19:09.972529+0000","last_became_peered":"2023-05-10T04:19:09.972529+0000","last_unstale":"2023-05-10T04:19:14.468949+0000","last_undegraded":"2023-05-10T04:19:14.468949+0000","last_fullsized":"2023-05-10T04:19:14.468949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:58:35.622573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628526+0000","last_change":"2023-05-10T04:19:13.998192+0000","last_active":"2023-05-10T04:19:14.628526+0000","last_peered":"2023-05-10T04:19:14.628526+0000","last_clean":"2023-05-10T04:19:14.628526+0000","last_became_active":"2023-05-10T04:19:13.997769+0000","last_became_peered":"2023-05-10T04:19:13.997769+0000","last_unstale":"2023-05-10T04:19:14.628526+0000","last_undegraded":"2023-05-10T04:19:14.628526+0000","last_fullsized":"2023-05-10T04:19:14.628526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:46.263150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627832+0000","last_change":"2023-05-10T04:19:04.443832+0000","last_active":"2023-05-10T04:19:14.627832+0000","last_peered":"2023-05-10T04:19:14.627832+0000","last_clean":"2023-05-10T04:19:14.627832+0000","last_became_active":"2023-05-10T04:19:04.443487+0000","last_became_peered":"2023-05-10T04:19:04.443487+0000","last_unstale":"2023-05-10T04:19:14.627832+0000","last_undegraded":"2023-05-10T04:19:14.627832+0000","last_fullsized":"2023-05-10T04:19:14.627832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:15:00.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577489+0000","last_change":"2023-05-10T04:19:09.485735+0000","last_active":"2023-05-10T04:19:14.577489+0000","last_peered":"2023-05-10T04:19:14.577489+0000","last_clean":"2023-05-10T04:19:14.577489+0000","last_became_active":"2023-05-10T04:19:09.485425+0000","last_became_peered":"2023-05-10T04:19:09.485425+0000","last_unstale":"2023-05-10T04:19:14.577489+0000","last_undegraded":"2023-05-10T04:19:14.577489+0000","last_fullsized":"2023-05-10T04:19:14.577489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:07.819601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469043+0000","last_change":"2023-05-10T04:19:09.977673+0000","last_active":"2023-05-10T04:19:14.469043+0000","last_peered":"2023-05-10T04:19:14.469043+0000","last_clean":"2023-05-10T04:19:14.469043+0000","last_became_active":"2023-05-10T04:19:09.977396+0000","last_became_peered":"2023-05-10T04:19:09.977396+0000","last_unstale":"2023-05-10T04:19:14.469043+0000","last_undegraded":"2023-05-10T04:19:14.469043+0000","last_fullsized":"2023-05-10T04:19:14.469043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:19.596953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468711+0000","last_change":"2023-05-10T04:19:13.997725+0000","last_active":"2023-05-10T04:19:14.468711+0000","last_peered":"2023-05-10T04:19:14.468711+0000","last_clean":"2023-05-10T04:19:14.468711+0000","last_became_active":"2023-05-10T04:19:13.997358+0000","last_became_peered":"2023-05-10T04:19:13.997358+0000","last_unstale":"2023-05-10T04:19:14.468711+0000","last_undegraded":"2023-05-10T04:19:14.468711+0000","last_fullsized":"2023-05-10T04:19:14.468711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:28.777158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202014+0000","last_change":"2023-05-10T04:19:04.443331+0000","last_active":"2023-05-10T04:19:15.202014+0000","last_peered":"2023-05-10T04:19:15.202014+0000","last_clean":"2023-05-10T04:19:15.202014+0000","last_became_active":"2023-05-10T04:19:04.443060+0000","last_became_peered":"2023-05-10T04:19:04.443060+0000","last_unstale":"2023-05-10T04:19:15.202014+0000","last_undegraded":"2023-05-10T04:19:15.202014+0000","last_fullsized":"2023-05-10T04:19:15.202014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:57:20.264880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203569+0000","last_change":"2023-05-10T04:18:57.192195+0000","last_active":"2023-05-10T04:19:15.203569+0000","last_peered":"2023-05-10T04:19:15.203569+0000","last_clean":"2023-05-10T04:19:15.203569+0000","last_became_active":"2023-05-10T04:18:57.191298+0000","last_became_peered":"2023-05-10T04:18:57.191298+0000","last_unstale":"2023-05-10T04:19:15.203569+0000","last_undegraded":"2023-05-10T04:19:15.203569+0000","last_fullsized":"2023-05-10T04:19:15.203569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_clean_scrub_stamp":"2023-05-10T04:18:56.172967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:05:30.415630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469650+0000","last_change":"2023-05-10T04:19:09.473780+0000","last_active":"2023-05-10T04:19:14.469650+0000","last_peered":"2023-05-10T04:19:14.469650+0000","last_clean":"2023-05-10T04:19:14.469650+0000","last_became_active":"2023-05-10T04:19:09.473417+0000","last_became_peered":"2023-05-10T04:19:09.473417+0000","last_unstale":"2023-05-10T04:19:14.469650+0000","last_undegraded":"2023-05-10T04:19:14.469650+0000","last_fullsized":"2023-05-10T04:19:14.469650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:35:58.690053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202817+0000","last_change":"2023-05-10T04:19:09.980022+0000","last_active":"2023-05-10T04:19:15.202817+0000","last_peered":"2023-05-10T04:19:15.202817+0000","last_clean":"2023-05-10T04:19:15.202817+0000","last_became_active":"2023-05-10T04:19:09.979557+0000","last_became_peered":"2023-05-10T04:19:09.979557+0000","last_unstale":"2023-05-10T04:19:15.202817+0000","last_undegraded":"2023-05-10T04:19:15.202817+0000","last_fullsized":"2023-05-10T04:19:15.202817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:27:31.317037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202554+0000","last_change":"2023-05-10T04:19:13.990077+0000","last_active":"2023-05-10T04:19:15.202554+0000","last_peered":"2023-05-10T04:19:15.202554+0000","last_clean":"2023-05-10T04:19:15.202554+0000","last_became_active":"2023-05-10T04:19:13.989665+0000","last_became_peered":"2023-05-10T04:19:13.989665+0000","last_unstale":"2023-05-10T04:19:15.202554+0000","last_undegraded":"2023-05-10T04:19:15.202554+0000","last_fullsized":"2023-05-10T04:19:15.202554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:56:23.432293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201872+0000","last_change":"2023-05-10T04:19:04.443785+0000","last_active":"2023-05-10T04:19:15.201872+0000","last_peered":"2023-05-10T04:19:15.201872+0000","last_clean":"2023-05-10T04:19:15.201872+0000","last_became_active":"2023-05-10T04:19:04.443499+0000","last_became_peered":"2023-05-10T04:19:04.443499+0000","last_unstale":"2023-05-10T04:19:15.201872+0000","last_undegraded":"2023-05-10T04:19:15.201872+0000","last_fullsized":"2023-05-10T04:19:15.201872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:36:06.817648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468318+0000","last_change":"2023-05-10T04:19:09.480112+0000","last_active":"2023-05-10T04:19:14.468318+0000","last_peered":"2023-05-10T04:19:14.468318+0000","last_clean":"2023-05-10T04:19:14.468318+0000","last_became_active":"2023-05-10T04:19:09.479809+0000","last_became_peered":"2023-05-10T04:19:09.479809+0000","last_unstale":"2023-05-10T04:19:14.468318+0000","last_undegraded":"2023-05-10T04:19:14.468318+0000","last_fullsized":"2023-05-10T04:19:14.468318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:01.327876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578367+0000","last_change":"2023-05-10T04:19:09.982844+0000","last_active":"2023-05-10T04:19:14.578367+0000","last_peered":"2023-05-10T04:19:14.578367+0000","last_clean":"2023-05-10T04:19:14.578367+0000","last_became_active":"2023-05-10T04:19:09.982169+0000","last_became_peered":"2023-05-10T04:19:09.982169+0000","last_unstale":"2023-05-10T04:19:14.578367+0000","last_undegraded":"2023-05-10T04:19:14.578367+0000","last_fullsized":"2023-05-10T04:19:14.578367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:15:37.641989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468590+0000","last_change":"2023-05-10T04:19:13.996191+0000","last_active":"2023-05-10T04:19:14.468590+0000","last_peered":"2023-05-10T04:19:14.468590+0000","last_clean":"2023-05-10T04:19:14.468590+0000","last_became_active":"2023-05-10T04:19:13.995821+0000","last_became_peered":"2023-05-10T04:19:13.995821+0000","last_unstale":"2023-05-10T04:19:14.468590+0000","last_undegraded":"2023-05-10T04:19:14.468590+0000","last_fullsized":"2023-05-10T04:19:14.468590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:19.853603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202501+0000","last_change":"2023-05-10T04:19:04.442968+0000","last_active":"2023-05-10T04:19:15.202501+0000","last_peered":"2023-05-10T04:19:15.202501+0000","last_clean":"2023-05-10T04:19:15.202501+0000","last_became_active":"2023-05-10T04:19:04.442633+0000","last_became_peered":"2023-05-10T04:19:04.442633+0000","last_unstale":"2023-05-10T04:19:15.202501+0000","last_undegraded":"2023-05-10T04:19:15.202501+0000","last_fullsized":"2023-05-10T04:19:15.202501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:25:07.501670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469097+0000","last_change":"2023-05-10T04:19:09.484103+0000","last_active":"2023-05-10T04:19:14.469097+0000","last_peered":"2023-05-10T04:19:14.469097+0000","last_clean":"2023-05-10T04:19:14.469097+0000","last_became_active":"2023-05-10T04:19:09.483770+0000","last_became_peered":"2023-05-10T04:19:09.483770+0000","last_unstale":"2023-05-10T04:19:14.469097+0000","last_undegraded":"2023-05-10T04:19:14.469097+0000","last_fullsized":"2023-05-10T04:19:14.469097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:53:17.665016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469128+0000","last_change":"2023-05-10T04:19:09.971611+0000","last_active":"2023-05-10T04:19:14.469128+0000","last_peered":"2023-05-10T04:19:14.469128+0000","last_clean":"2023-05-10T04:19:14.469128+0000","last_became_active":"2023-05-10T04:19:09.971338+0000","last_became_peered":"2023-05-10T04:19:09.971338+0000","last_unstale":"2023-05-10T04:19:14.469128+0000","last_undegraded":"2023-05-10T04:19:14.469128+0000","last_fullsized":"2023-05-10T04:19:14.469128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:54:23.670496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202060+0000","last_change":"2023-05-10T04:19:13.990413+0000","last_active":"2023-05-10T04:19:15.202060+0000","last_peered":"2023-05-10T04:19:15.202060+0000","last_clean":"2023-05-10T04:19:15.202060+0000","last_became_active":"2023-05-10T04:19:13.988555+0000","last_became_peered":"2023-05-10T04:19:13.988555+0000","last_unstale":"2023-05-10T04:19:15.202060+0000","last_undegraded":"2023-05-10T04:19:15.202060+0000","last_fullsized":"2023-05-10T04:19:15.202060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:44:59.851980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470404+0000","last_change":"2023-05-10T04:19:09.480141+0000","last_active":"2023-05-10T04:19:14.470404+0000","last_peered":"2023-05-10T04:19:14.470404+0000","last_clean":"2023-05-10T04:19:14.470404+0000","last_became_active":"2023-05-10T04:19:09.479868+0000","last_became_peered":"2023-05-10T04:19:09.479868+0000","last_unstale":"2023-05-10T04:19:14.470404+0000","last_undegraded":"2023-05-10T04:19:14.470404+0000","last_fullsized":"2023-05-10T04:19:14.470404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:40:32.714684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470401+0000","last_change":"2023-05-10T04:19:04.440282+0000","last_active":"2023-05-10T04:19:14.470401+0000","last_peered":"2023-05-10T04:19:14.470401+0000","last_clean":"2023-05-10T04:19:14.470401+0000","last_became_active":"2023-05-10T04:19:04.439945+0000","last_became_peered":"2023-05-10T04:19:04.439945+0000","last_unstale":"2023-05-10T04:19:14.470401+0000","last_undegraded":"2023-05-10T04:19:14.470401+0000","last_fullsized":"2023-05-10T04:19:14.470401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:08:26.159897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468913+0000","last_change":"2023-05-10T04:19:09.983026+0000","last_active":"2023-05-10T04:19:14.468913+0000","last_peered":"2023-05-10T04:19:14.468913+0000","last_clean":"2023-05-10T04:19:14.468913+0000","last_became_active":"2023-05-10T04:19:09.982665+0000","last_became_peered":"2023-05-10T04:19:09.982665+0000","last_unstale":"2023-05-10T04:19:14.468913+0000","last_undegraded":"2023-05-10T04:19:14.468913+0000","last_fullsized":"2023-05-10T04:19:14.468913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:36:35.332796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469350+0000","last_change":"2023-05-10T04:19:14.006885+0000","last_active":"2023-05-10T04:19:14.469350+0000","last_peered":"2023-05-10T04:19:14.469350+0000","last_clean":"2023-05-10T04:19:14.469350+0000","last_became_active":"2023-05-10T04:19:14.006506+0000","last_became_peered":"2023-05-10T04:19:14.006506+0000","last_unstale":"2023-05-10T04:19:14.469350+0000","last_undegraded":"2023-05-10T04:19:14.469350+0000","last_fullsized":"2023-05-10T04:19:14.469350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:31:03.826068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202770+0000","last_change":"2023-05-10T04:19:04.444610+0000","last_active":"2023-05-10T04:19:15.202770+0000","last_peered":"2023-05-10T04:19:15.202770+0000","last_clean":"2023-05-10T04:19:15.202770+0000","last_became_active":"2023-05-10T04:19:04.444273+0000","last_became_peered":"2023-05-10T04:19:04.444273+0000","last_unstale":"2023-05-10T04:19:15.202770+0000","last_undegraded":"2023-05-10T04:19:15.202770+0000","last_fullsized":"2023-05-10T04:19:15.202770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:16:40.114985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470258+0000","last_change":"2023-05-10T04:19:09.477274+0000","last_active":"2023-05-10T04:19:14.470258+0000","last_peered":"2023-05-10T04:19:14.470258+0000","last_clean":"2023-05-10T04:19:14.470258+0000","last_became_active":"2023-05-10T04:19:09.476956+0000","last_became_peered":"2023-05-10T04:19:09.476956+0000","last_unstale":"2023-05-10T04:19:14.470258+0000","last_undegraded":"2023-05-10T04:19:14.470258+0000","last_fullsized":"2023-05-10T04:19:14.470258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:59.737968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202341+0000","last_change":"2023-05-10T04:19:09.959284+0000","last_active":"2023-05-10T04:19:15.202341+0000","last_peered":"2023-05-10T04:19:15.202341+0000","last_clean":"2023-05-10T04:19:15.202341+0000","last_became_active":"2023-05-10T04:19:09.959030+0000","last_became_peered":"2023-05-10T04:19:09.959030+0000","last_unstale":"2023-05-10T04:19:15.202341+0000","last_undegraded":"2023-05-10T04:19:15.202341+0000","last_fullsized":"2023-05-10T04:19:15.202341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:04:32.114370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469919+0000","last_change":"2023-05-10T04:19:13.995438+0000","last_active":"2023-05-10T04:19:14.469919+0000","last_peered":"2023-05-10T04:19:14.469919+0000","last_clean":"2023-05-10T04:19:14.469919+0000","last_became_active":"2023-05-10T04:19:13.994966+0000","last_became_peered":"2023-05-10T04:19:13.994966+0000","last_unstale":"2023-05-10T04:19:14.469919+0000","last_undegraded":"2023-05-10T04:19:14.469919+0000","last_fullsized":"2023-05-10T04:19:14.469919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:05:44.625042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468987+0000","last_change":"2023-05-10T04:19:09.485131+0000","last_active":"2023-05-10T04:19:14.468987+0000","last_peered":"2023-05-10T04:19:14.468987+0000","last_clean":"2023-05-10T04:19:14.468987+0000","last_became_active":"2023-05-10T04:19:09.484754+0000","last_became_peered":"2023-05-10T04:19:09.484754+0000","last_unstale":"2023-05-10T04:19:14.468987+0000","last_undegraded":"2023-05-10T04:19:14.468987+0000","last_fullsized":"2023-05-10T04:19:14.468987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:30:21.704079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469574+0000","last_change":"2023-05-10T04:19:09.970210+0000","last_active":"2023-05-10T04:19:14.469574+0000","last_peered":"2023-05-10T04:19:14.469574+0000","last_clean":"2023-05-10T04:19:14.469574+0000","last_became_active":"2023-05-10T04:19:09.969916+0000","last_became_peered":"2023-05-10T04:19:09.969916+0000","last_unstale":"2023-05-10T04:19:14.469574+0000","last_undegraded":"2023-05-10T04:19:14.469574+0000","last_fullsized":"2023-05-10T04:19:14.469574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:08:49.572839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203900+0000","last_change":"2023-05-10T04:19:14.000125+0000","last_active":"2023-05-10T04:19:15.203900+0000","last_peered":"2023-05-10T04:19:15.203900+0000","last_clean":"2023-05-10T04:19:15.203900+0000","last_became_active":"2023-05-10T04:19:13.998988+0000","last_became_peered":"2023-05-10T04:19:13.998988+0000","last_unstale":"2023-05-10T04:19:15.203900+0000","last_undegraded":"2023-05-10T04:19:15.203900+0000","last_fullsized":"2023-05-10T04:19:15.203900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:39:35.802978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204178+0000","last_change":"2023-05-10T04:19:09.488600+0000","last_active":"2023-05-10T04:19:15.204178+0000","last_peered":"2023-05-10T04:19:15.204178+0000","last_clean":"2023-05-10T04:19:15.204178+0000","last_became_active":"2023-05-10T04:19:09.488320+0000","last_became_peered":"2023-05-10T04:19:09.488320+0000","last_unstale":"2023-05-10T04:19:15.204178+0000","last_undegraded":"2023-05-10T04:19:15.204178+0000","last_fullsized":"2023-05-10T04:19:15.204178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:14:10.406433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202715+0000","last_change":"2023-05-10T04:19:09.986548+0000","last_active":"2023-05-10T04:19:15.202715+0000","last_peered":"2023-05-10T04:19:15.202715+0000","last_clean":"2023-05-10T04:19:15.202715+0000","last_became_active":"2023-05-10T04:19:09.986228+0000","last_became_peered":"2023-05-10T04:19:09.986228+0000","last_unstale":"2023-05-10T04:19:15.202715+0000","last_undegraded":"2023-05-10T04:19:15.202715+0000","last_fullsized":"2023-05-10T04:19:15.202715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:03.210099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202625+0000","last_change":"2023-05-10T04:19:13.997285+0000","last_active":"2023-05-10T04:19:15.202625+0000","last_peered":"2023-05-10T04:19:15.202625+0000","last_clean":"2023-05-10T04:19:15.202625+0000","last_became_active":"2023-05-10T04:19:13.996851+0000","last_became_peered":"2023-05-10T04:19:13.996851+0000","last_unstale":"2023-05-10T04:19:15.202625+0000","last_undegraded":"2023-05-10T04:19:15.202625+0000","last_fullsized":"2023-05-10T04:19:15.202625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:05.585266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202534+0000","last_change":"2023-05-10T04:19:09.485989+0000","last_active":"2023-05-10T04:19:15.202534+0000","last_peered":"2023-05-10T04:19:15.202534+0000","last_clean":"2023-05-10T04:19:15.202534+0000","last_became_active":"2023-05-10T04:19:09.485739+0000","last_became_peered":"2023-05-10T04:19:09.485739+0000","last_unstale":"2023-05-10T04:19:15.202534+0000","last_undegraded":"2023-05-10T04:19:15.202534+0000","last_fullsized":"2023-05-10T04:19:15.202534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:34.153625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203031+0000","last_change":"2023-05-10T04:19:09.966736+0000","last_active":"2023-05-10T04:19:15.203031+0000","last_peered":"2023-05-10T04:19:15.203031+0000","last_clean":"2023-05-10T04:19:15.203031+0000","last_became_active":"2023-05-10T04:19:09.966474+0000","last_became_peered":"2023-05-10T04:19:09.966474+0000","last_unstale":"2023-05-10T04:19:15.203031+0000","last_undegraded":"2023-05-10T04:19:15.203031+0000","last_fullsized":"2023-05-10T04:19:15.203031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:19.596953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203129+0000","last_change":"2023-05-10T04:19:13.993407+0000","last_active":"2023-05-10T04:19:15.203129+0000","last_peered":"2023-05-10T04:19:15.203129+0000","last_clean":"2023-05-10T04:19:15.203129+0000","last_became_active":"2023-05-10T04:19:13.992979+0000","last_became_peered":"2023-05-10T04:19:13.992979+0000","last_unstale":"2023-05-10T04:19:15.203129+0000","last_undegraded":"2023-05-10T04:19:15.203129+0000","last_fullsized":"2023-05-10T04:19:15.203129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:23.097714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578128+0000","last_change":"2023-05-10T04:19:09.482747+0000","last_active":"2023-05-10T04:19:14.578128+0000","last_peered":"2023-05-10T04:19:14.578128+0000","last_clean":"2023-05-10T04:19:14.578128+0000","last_became_active":"2023-05-10T04:19:09.482405+0000","last_became_peered":"2023-05-10T04:19:09.482405+0000","last_unstale":"2023-05-10T04:19:14.578128+0000","last_undegraded":"2023-05-10T04:19:14.578128+0000","last_fullsized":"2023-05-10T04:19:14.578128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:14:10.406433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628203+0000","last_change":"2023-05-10T04:19:09.976125+0000","last_active":"2023-05-10T04:19:14.628203+0000","last_peered":"2023-05-10T04:19:14.628203+0000","last_clean":"2023-05-10T04:19:14.628203+0000","last_became_active":"2023-05-10T04:19:09.975822+0000","last_became_peered":"2023-05-10T04:19:09.975822+0000","last_unstale":"2023-05-10T04:19:14.628203+0000","last_undegraded":"2023-05-10T04:19:14.628203+0000","last_fullsized":"2023-05-10T04:19:14.628203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:16.831438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469659+0000","last_change":"2023-05-10T04:19:13.995689+0000","last_active":"2023-05-10T04:19:14.469659+0000","last_peered":"2023-05-10T04:19:14.469659+0000","last_clean":"2023-05-10T04:19:14.469659+0000","last_became_active":"2023-05-10T04:19:13.995260+0000","last_became_peered":"2023-05-10T04:19:13.995260+0000","last_unstale":"2023-05-10T04:19:14.469659+0000","last_undegraded":"2023-05-10T04:19:14.469659+0000","last_fullsized":"2023-05-10T04:19:14.469659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:23:01.528439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578389+0000","last_change":"2023-05-10T04:19:09.483097+0000","last_active":"2023-05-10T04:19:14.578389+0000","last_peered":"2023-05-10T04:19:14.578389+0000","last_clean":"2023-05-10T04:19:14.578389+0000","last_became_active":"2023-05-10T04:19:09.482753+0000","last_became_peered":"2023-05-10T04:19:09.482753+0000","last_unstale":"2023-05-10T04:19:14.578389+0000","last_undegraded":"2023-05-10T04:19:14.578389+0000","last_fullsized":"2023-05-10T04:19:14.578389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:47:36.189819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201669+0000","last_change":"2023-05-10T04:19:09.965711+0000","last_active":"2023-05-10T04:19:15.201669+0000","last_peered":"2023-05-10T04:19:15.201669+0000","last_clean":"2023-05-10T04:19:15.201669+0000","last_became_active":"2023-05-10T04:19:09.965427+0000","last_became_peered":"2023-05-10T04:19:09.965427+0000","last_unstale":"2023-05-10T04:19:15.201669+0000","last_undegraded":"2023-05-10T04:19:15.201669+0000","last_fullsized":"2023-05-10T04:19:15.201669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:25.276398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203303+0000","last_change":"2023-05-10T04:19:09.977970+0000","last_active":"2023-05-10T04:19:15.203303+0000","last_peered":"2023-05-10T04:19:15.203303+0000","last_clean":"2023-05-10T04:19:15.203303+0000","last_became_active":"2023-05-10T04:19:09.977559+0000","last_became_peered":"2023-05-10T04:19:09.977559+0000","last_unstale":"2023-05-10T04:19:15.203303+0000","last_undegraded":"2023-05-10T04:19:15.203303+0000","last_fullsized":"2023-05-10T04:19:15.203303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:54:23.670496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468413+0000","last_change":"2023-05-10T04:19:09.985063+0000","last_active":"2023-05-10T04:19:14.468413+0000","last_peered":"2023-05-10T04:19:14.468413+0000","last_clean":"2023-05-10T04:19:14.468413+0000","last_became_active":"2023-05-10T04:19:09.984788+0000","last_became_peered":"2023-05-10T04:19:09.984788+0000","last_unstale":"2023-05-10T04:19:14.468413+0000","last_undegraded":"2023-05-10T04:19:14.468413+0000","last_fullsized":"2023-05-10T04:19:14.468413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:13.062393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468430+0000","last_change":"2023-05-10T04:19:09.969178+0000","last_active":"2023-05-10T04:19:14.468430+0000","last_peered":"2023-05-10T04:19:14.468430+0000","last_clean":"2023-05-10T04:19:14.468430+0000","last_became_active":"2023-05-10T04:19:09.968882+0000","last_became_peered":"2023-05-10T04:19:09.968882+0000","last_unstale":"2023-05-10T04:19:14.468430+0000","last_undegraded":"2023-05-10T04:19:14.468430+0000","last_fullsized":"2023-05-10T04:19:14.468430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:55.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577956+0000","last_change":"2023-05-10T04:19:09.978972+0000","last_active":"2023-05-10T04:19:14.577956+0000","last_peered":"2023-05-10T04:19:14.577956+0000","last_clean":"2023-05-10T04:19:14.577956+0000","last_became_active":"2023-05-10T04:19:09.978677+0000","last_became_peered":"2023-05-10T04:19:09.978677+0000","last_unstale":"2023-05-10T04:19:14.577956+0000","last_undegraded":"2023-05-10T04:19:14.577956+0000","last_fullsized":"2023-05-10T04:19:14.577956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:04.032181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578091+0000","last_change":"2023-05-10T04:19:09.982469+0000","last_active":"2023-05-10T04:19:14.578091+0000","last_peered":"2023-05-10T04:19:14.578091+0000","last_clean":"2023-05-10T04:19:14.578091+0000","last_became_active":"2023-05-10T04:19:09.982174+0000","last_became_peered":"2023-05-10T04:19:09.982174+0000","last_unstale":"2023-05-10T04:19:14.578091+0000","last_undegraded":"2023-05-10T04:19:14.578091+0000","last_fullsized":"2023-05-10T04:19:14.578091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:55:21.820447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":16,"seq":68719476745,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":909312,"data_stored":715160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":124264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":127912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8260,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363580,"statfs":{"total":96636764160,"available":96628305920,"internally_reserved":0,"allocated":323584,"data_stored":128016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":124208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T04:19:32.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T04:19:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.038+0000 7f133efff700 1 Processor -- start 2023-05-10T04:19:33.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.038+0000 7f133efff700 1 -- start start 2023-05-10T04:19:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.039+0000 7f133efff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f13380b87a0 0x7f13380cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.039+0000 7f133efff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 0x7f1338160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.039+0000 7f133efff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1338160ff0 con 0x7f1338160b70 2023-05-10T04:19:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.039+0000 7f133efff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13380d02d0 con 0x7f13380b87a0 2023-05-10T04:19:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.039+0000 7f133efff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13380d0cb0 con 0x7f13381601e0 2023-05-10T04:19:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f133d59c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1338160b70 0x7f13380d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50742/0 (socket says 172.21.15.132:50742) 2023-05-10T04:19:33.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f133d59c700 1 -- 172.21.15.132:0/929084086 learned_addr learned my addr 172.21.15.132:0/929084086 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f133cd9b700 1 --2- 172.21.15.132:0/929084086 >> v2:172.21.15.154:3300/0 conn(0x7f13380b87a0 0x7f13380cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f1337fff700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 0x7f1338160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217621447 0 0) 0x7f1338160ff0 con 0x7f1338160b70 2023-05-10T04:19:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13280035b0 con 0x7f1338160b70 2023-05-10T04:19:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2022172552 0 0) 0x7f13280035b0 con 0x7f1338160b70 2023-05-10T04:19:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 msgr2=0x7f1338160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 0x7f1338160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 >> v2:172.21.15.154:3300/0 conn(0x7f13380b87a0 msgr2=0x7f13380cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 --2- 172.21.15.132:0/929084086 >> v2:172.21.15.154:3300/0 conn(0x7f13380b87a0 0x7f13380cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380cdc60 con 0x7f1338160b70 2023-05-10T04:19:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f13300019f0 con 0x7f1338160b70 2023-05-10T04:19:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.040+0000 7f133cd9b700 1 --2- 172.21.15.132:0/929084086 >> v2:172.21.15.154:3300/0 conn(0x7f13380b87a0 0x7f13380cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f1337fff700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 0x7f1338160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 >> v1:172.21.15.132:6789/0 conn(0x7f1338160b70 legacy=0x7f13380d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f13377fe700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 0x7f1328003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f13377fe700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1328003f90 0x7f1328004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f13377fe700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f1328005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13380d02d0 con 0x7f1328004d90 2023-05-10T04:19:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132800ba10 con 0x7f1328003f90 2023-05-10T04:19:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132800bb50 con 0x7f13381601e0 2023-05-10T04:19:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f133d59c700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f1328005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f1337fff700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1328003f90 0x7f1328004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f133cd9b700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 0x7f1328003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f133d59c700 1 -- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 msgr2=0x7f1328003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:33.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f133d59c700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f13381601e0 0x7f1328003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f133d59c700 1 -- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1328003f90 msgr2=0x7f1328004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f133d59c700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1328003f90 0x7f1328004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.041+0000 7f133d59c700 1 -- 172.21.15.132:0/929084086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240094a0 con 0x7f1328004d90 2023-05-10T04:19:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f133d59c700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f1328005200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f133000a790 tx=0x7f1328005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa58d67eb37750c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133000a250 con 0x7f1328004d90 2023-05-10T04:19:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1330012600 con 0x7f1328004d90 2023-05-10T04:19:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f13377fe700 1 -- 172.21.15.132:0/929084086 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300129b0 con 0x7f1328004d90 2023-05-10T04:19:33.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f133efff700 1 -- 172.21.15.132:0/929084086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 msgr2=0x7f1328005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f133efff700 1 --2- 172.21.15.132:0/929084086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f1328005200 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f133000a790 tx=0x7f1328005880 comp rx=0 tx=0).stop 2023-05-10T04:19:33.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f133d59c700 1 -- 172.21.15.132:0/929084086 reap_dead start 2023-05-10T04:19:33.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f133efff700 1 -- 172.21.15.132:0/929084086 shutdown_connections 2023-05-10T04:19:33.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f133efff700 1 -- 172.21.15.132:0/929084086 >> 172.21.15.132:0/929084086 conn(0x7f1338071b10 msgr2=0x7f1338071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:33.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f133efff700 1 -- 172.21.15.132:0/929084086 shutdown_connections 2023-05-10T04:19:33.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.042+0000 7f133efff700 1 -- 172.21.15.132:0/929084086 wait complete. 2023-05-10T04:19:33.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.044+0000 7f133efff700 1 Processor -- start 2023-05-10T04:19:33.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.044+0000 7f133efff700 1 -- start start 2023-05-10T04:19:33.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133efff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f13380c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133efff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1338153ce0 0x7f13380c8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133efff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13380b3960 0x7f13380b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133efff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13380c9800 con 0x7f1328004d90 2023-05-10T04:19:33.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133efff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13380b4320 con 0x7f13380b3960 2023-05-10T04:19:33.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133efff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13380c8b80 con 0x7f1338153ce0 2023-05-10T04:19:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133cd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f13380c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133cd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f13380c76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47988/0 (socket says 172.21.15.132:47988) 2023-05-10T04:19:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.045+0000 7f133cd9b700 1 -- 172.21.15.132:0/3467490369 learned_addr learned my addr 172.21.15.132:0/3467490369 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:33.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133d59c700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13380b3960 0x7f13380b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f1337fff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1338153ce0 0x7f13380c8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133cd9b700 1 -- 172.21.15.132:0/3467490369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1338153ce0 msgr2=0x7f13380c8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133cd9b700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1338153ce0 0x7f13380c8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133cd9b700 1 -- 172.21.15.132:0/3467490369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13380b3960 msgr2=0x7f13380b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133cd9b700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13380b3960 0x7f13380b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133cd9b700 1 -- 172.21.15.132:0/3467490369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380cd980 con 0x7f1328004d90 2023-05-10T04:19:33.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133cd9b700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f13380c76b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f132c011c20 tx=0x7f132c00f240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f13357fa700 1 -- 172.21.15.132:0/3467490369 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c00fb80 con 0x7f1328004d90 2023-05-10T04:19:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f13357fa700 1 -- 172.21.15.132:0/3467490369 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c00fce0 con 0x7f1328004d90 2023-05-10T04:19:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13380cd6a0 con 0x7f1328004d90 2023-05-10T04:19:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f13357fa700 1 -- 172.21.15.132:0/3467490369 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c004240 con 0x7f1328004d90 2023-05-10T04:19:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.046+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13380d2110 con 0x7f1328004d90 2023-05-10T04:19:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.047+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1338158380 con 0x7f1328004d90 2023-05-10T04:19:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.048+0000 7f13357fa700 1 -- 172.21.15.132:0/3467490369 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f132c0043a0 con 0x7f1328004d90 2023-05-10T04:19:33.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.049+0000 7f13357fa700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f131c06ace0 0x7f131c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.049+0000 7f13357fa700 1 -- 172.21.15.132:0/3467490369 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f132c089e90 con 0x7f1328004d90 2023-05-10T04:19:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.050+0000 7f1337fff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f131c06ace0 0x7f131c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.050+0000 7f1337fff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f131c06ace0 0x7f131c06d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1324009d30 tx=0x7f1324008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.053+0000 7f13357fa700 1 -- 172.21.15.132:0/3467490369 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f132c054c40 con 0x7f1328004d90 2023-05-10T04:19:33.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.243+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 --> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13381540b0 con 0x7f131c06ace0 2023-05-10T04:19:33.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.253+0000 7f13357fa700 1 -- 172.21.15.132:0/3467490369 <== mgr.4100 v2:172.21.15.132:6832/1621031024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367356 (secure 0 0 0) 0x7f1324009e70 con 0x7f131c06ace0 2023-05-10T04:19:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f131c06ace0 msgr2=0x7f131c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f131c06ace0 0x7f131c06d190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1324009d30 tx=0x7f1324008040 comp rx=0 tx=0).stop 2023-05-10T04:19:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 msgr2=0x7f13380c76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f13380c76b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f132c011c20 tx=0x7f132c00f240 comp rx=0 tx=0).stop 2023-05-10T04:19:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 shutdown_connections 2023-05-10T04:19:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f131c06ace0 0x7f131c06d190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f13380b3960 0x7f13380b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1328004d90 0x7f13380c76b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 --2- 172.21.15.132:0/3467490369 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1338153ce0 0x7f13380c8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 >> 172.21.15.132:0/3467490369 conn(0x7f1338071b10 msgr2=0x7f13380b6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 shutdown_connections 2023-05-10T04:19:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.258+0000 7f133efff700 1 -- 172.21.15.132:0/3467490369 wait complete. 2023-05-10T04:19:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-05-10T04:19:33.278 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-05-10T04:19:31.320847+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67720,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":64064,"kb_avail":754907000,"statfs":{"total":773094113280,"available":773024768000,"internally_reserved":0,"allocated":3678208,"data_stored":2182864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65601536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002634"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578590+0000","last_change":"2023-05-10T04:19:09.980944+0000","last_active":"2023-05-10T04:19:14.578590+0000","last_peered":"2023-05-10T04:19:14.578590+0000","last_clean":"2023-05-10T04:19:14.578590+0000","last_became_active":"2023-05-10T04:19:09.980469+0000","last_became_peered":"2023-05-10T04:19:09.980469+0000","last_unstale":"2023-05-10T04:19:14.578590+0000","last_undegraded":"2023-05-10T04:19:14.578590+0000","last_fullsized":"2023-05-10T04:19:14.578590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:55:07.690476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202665+0000","last_change":"2023-05-10T04:19:09.966435+0000","last_active":"2023-05-10T04:19:15.202665+0000","last_peered":"2023-05-10T04:19:15.202665+0000","last_clean":"2023-05-10T04:19:15.202665+0000","last_became_active":"2023-05-10T04:19:09.966166+0000","last_became_peered":"2023-05-10T04:19:09.966166+0000","last_unstale":"2023-05-10T04:19:15.202665+0000","last_undegraded":"2023-05-10T04:19:15.202665+0000","last_fullsized":"2023-05-10T04:19:15.202665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:27:35.392807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468705+0000","last_change":"2023-05-10T04:19:09.984558+0000","last_active":"2023-05-10T04:19:14.468705+0000","last_peered":"2023-05-10T04:19:14.468705+0000","last_clean":"2023-05-10T04:19:14.468705+0000","last_became_active":"2023-05-10T04:19:09.984302+0000","last_became_peered":"2023-05-10T04:19:09.984302+0000","last_unstale":"2023-05-10T04:19:14.468705+0000","last_undegraded":"2023-05-10T04:19:14.468705+0000","last_fullsized":"2023-05-10T04:19:14.468705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:04:32.114370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468704+0000","last_change":"2023-05-10T04:19:09.974290+0000","last_active":"2023-05-10T04:19:14.468704+0000","last_peered":"2023-05-10T04:19:14.468704+0000","last_clean":"2023-05-10T04:19:14.468704+0000","last_became_active":"2023-05-10T04:19:09.973974+0000","last_became_peered":"2023-05-10T04:19:09.973974+0000","last_unstale":"2023-05-10T04:19:14.468704+0000","last_undegraded":"2023-05-10T04:19:14.468704+0000","last_fullsized":"2023-05-10T04:19:14.468704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:42.762389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469158+0000","last_change":"2023-05-10T04:19:09.969611+0000","last_active":"2023-05-10T04:19:14.469158+0000","last_peered":"2023-05-10T04:19:14.469158+0000","last_clean":"2023-05-10T04:19:14.469158+0000","last_became_active":"2023-05-10T04:19:09.969348+0000","last_became_peered":"2023-05-10T04:19:09.969348+0000","last_unstale":"2023-05-10T04:19:14.469158+0000","last_undegraded":"2023-05-10T04:19:14.469158+0000","last_fullsized":"2023-05-10T04:19:14.469158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:09:45.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202245+0000","last_change":"2023-05-10T04:19:09.958269+0000","last_active":"2023-05-10T04:19:15.202245+0000","last_peered":"2023-05-10T04:19:15.202245+0000","last_clean":"2023-05-10T04:19:15.202245+0000","last_became_active":"2023-05-10T04:19:09.958012+0000","last_became_peered":"2023-05-10T04:19:09.958012+0000","last_unstale":"2023-05-10T04:19:15.202245+0000","last_undegraded":"2023-05-10T04:19:15.202245+0000","last_fullsized":"2023-05-10T04:19:15.202245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:46:10.564631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201730+0000","last_change":"2023-05-10T04:19:09.977451+0000","last_active":"2023-05-10T04:19:15.201730+0000","last_peered":"2023-05-10T04:19:15.201730+0000","last_clean":"2023-05-10T04:19:15.201730+0000","last_became_active":"2023-05-10T04:19:09.977096+0000","last_became_peered":"2023-05-10T04:19:09.977096+0000","last_unstale":"2023-05-10T04:19:15.201730+0000","last_undegraded":"2023-05-10T04:19:15.201730+0000","last_fullsized":"2023-05-10T04:19:15.201730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:08:03.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203498+0000","last_change":"2023-05-10T04:19:09.983987+0000","last_active":"2023-05-10T04:19:15.203498+0000","last_peered":"2023-05-10T04:19:15.203498+0000","last_clean":"2023-05-10T04:19:15.203498+0000","last_became_active":"2023-05-10T04:19:09.983498+0000","last_became_peered":"2023-05-10T04:19:09.983498+0000","last_unstale":"2023-05-10T04:19:15.203498+0000","last_undegraded":"2023-05-10T04:19:15.203498+0000","last_fullsized":"2023-05-10T04:19:15.203498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:24:07.309535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470244+0000","last_change":"2023-05-10T04:19:09.985793+0000","last_active":"2023-05-10T04:19:14.470244+0000","last_peered":"2023-05-10T04:19:14.470244+0000","last_clean":"2023-05-10T04:19:14.470244+0000","last_became_active":"2023-05-10T04:19:09.985536+0000","last_became_peered":"2023-05-10T04:19:09.985536+0000","last_unstale":"2023-05-10T04:19:14.470244+0000","last_undegraded":"2023-05-10T04:19:14.470244+0000","last_fullsized":"2023-05-10T04:19:14.470244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:26:03.971644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204267+0000","last_change":"2023-05-10T04:19:09.977082+0000","last_active":"2023-05-10T04:19:15.204267+0000","last_peered":"2023-05-10T04:19:15.204267+0000","last_clean":"2023-05-10T04:19:15.204267+0000","last_became_active":"2023-05-10T04:19:09.976807+0000","last_became_peered":"2023-05-10T04:19:09.976807+0000","last_unstale":"2023-05-10T04:19:15.204267+0000","last_undegraded":"2023-05-10T04:19:15.204267+0000","last_fullsized":"2023-05-10T04:19:15.204267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:57.684710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204207+0000","last_change":"2023-05-10T04:19:09.977165+0000","last_active":"2023-05-10T04:19:15.204207+0000","last_peered":"2023-05-10T04:19:15.204207+0000","last_clean":"2023-05-10T04:19:15.204207+0000","last_became_active":"2023-05-10T04:19:09.976881+0000","last_became_peered":"2023-05-10T04:19:09.976881+0000","last_unstale":"2023-05-10T04:19:15.204207+0000","last_undegraded":"2023-05-10T04:19:15.204207+0000","last_fullsized":"2023-05-10T04:19:15.204207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:33:39.200185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578113+0000","last_change":"2023-05-10T04:19:09.981309+0000","last_active":"2023-05-10T04:19:14.578113+0000","last_peered":"2023-05-10T04:19:14.578113+0000","last_clean":"2023-05-10T04:19:14.578113+0000","last_became_active":"2023-05-10T04:19:09.981029+0000","last_became_peered":"2023-05-10T04:19:09.981029+0000","last_unstale":"2023-05-10T04:19:14.578113+0000","last_undegraded":"2023-05-10T04:19:14.578113+0000","last_fullsized":"2023-05-10T04:19:14.578113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:39:32.302218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468965+0000","last_change":"2023-05-10T04:19:09.986829+0000","last_active":"2023-05-10T04:19:14.468965+0000","last_peered":"2023-05-10T04:19:14.468965+0000","last_clean":"2023-05-10T04:19:14.468965+0000","last_became_active":"2023-05-10T04:19:09.986539+0000","last_became_peered":"2023-05-10T04:19:09.986539+0000","last_unstale":"2023-05-10T04:19:14.468965+0000","last_undegraded":"2023-05-10T04:19:14.468965+0000","last_fullsized":"2023-05-10T04:19:14.468965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:01.243491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203681+0000","last_change":"2023-05-10T04:19:09.985452+0000","last_active":"2023-05-10T04:19:15.203681+0000","last_peered":"2023-05-10T04:19:15.203681+0000","last_clean":"2023-05-10T04:19:15.203681+0000","last_became_active":"2023-05-10T04:19:09.985150+0000","last_became_peered":"2023-05-10T04:19:09.985150+0000","last_unstale":"2023-05-10T04:19:15.203681+0000","last_undegraded":"2023-05-10T04:19:15.203681+0000","last_fullsized":"2023-05-10T04:19:15.203681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:01:52.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468391+0000","last_change":"2023-05-10T04:19:09.976517+0000","last_active":"2023-05-10T04:19:14.468391+0000","last_peered":"2023-05-10T04:19:14.468391+0000","last_clean":"2023-05-10T04:19:14.468391+0000","last_became_active":"2023-05-10T04:19:09.976213+0000","last_became_peered":"2023-05-10T04:19:09.976213+0000","last_unstale":"2023-05-10T04:19:14.468391+0000","last_undegraded":"2023-05-10T04:19:14.468391+0000","last_fullsized":"2023-05-10T04:19:14.468391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:16.831438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201721+0000","last_change":"2023-05-10T04:19:09.974190+0000","last_active":"2023-05-10T04:19:15.201721+0000","last_peered":"2023-05-10T04:19:15.201721+0000","last_clean":"2023-05-10T04:19:15.201721+0000","last_became_active":"2023-05-10T04:19:09.973917+0000","last_became_peered":"2023-05-10T04:19:09.973917+0000","last_unstale":"2023-05-10T04:19:15.201721+0000","last_undegraded":"2023-05-10T04:19:15.201721+0000","last_fullsized":"2023-05-10T04:19:15.201721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:23:32.089101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628444+0000","last_change":"2023-05-10T04:19:09.976310+0000","last_active":"2023-05-10T04:19:14.628444+0000","last_peered":"2023-05-10T04:19:14.628444+0000","last_clean":"2023-05-10T04:19:14.628444+0000","last_became_active":"2023-05-10T04:19:09.975809+0000","last_became_peered":"2023-05-10T04:19:09.975809+0000","last_unstale":"2023-05-10T04:19:14.628444+0000","last_undegraded":"2023-05-10T04:19:14.628444+0000","last_fullsized":"2023-05-10T04:19:14.628444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:07.446800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468880+0000","last_change":"2023-05-10T04:19:09.980962+0000","last_active":"2023-05-10T04:19:14.468880+0000","last_peered":"2023-05-10T04:19:14.468880+0000","last_clean":"2023-05-10T04:19:14.468880+0000","last_became_active":"2023-05-10T04:19:09.980600+0000","last_became_peered":"2023-05-10T04:19:09.980600+0000","last_unstale":"2023-05-10T04:19:14.468880+0000","last_undegraded":"2023-05-10T04:19:14.468880+0000","last_fullsized":"2023-05-10T04:19:14.468880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:02.084506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578180+0000","last_change":"2023-05-10T04:19:09.983155+0000","last_active":"2023-05-10T04:19:14.578180+0000","last_peered":"2023-05-10T04:19:14.578180+0000","last_clean":"2023-05-10T04:19:14.578180+0000","last_became_active":"2023-05-10T04:19:09.982831+0000","last_became_peered":"2023-05-10T04:19:09.982831+0000","last_unstale":"2023-05-10T04:19:14.578180+0000","last_undegraded":"2023-05-10T04:19:14.578180+0000","last_fullsized":"2023-05-10T04:19:14.578180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:33:39.200185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204200+0000","last_change":"2023-05-10T04:19:09.974974+0000","last_active":"2023-05-10T04:19:15.204200+0000","last_peered":"2023-05-10T04:19:15.204200+0000","last_clean":"2023-05-10T04:19:15.204200+0000","last_became_active":"2023-05-10T04:19:09.974693+0000","last_became_peered":"2023-05-10T04:19:09.974693+0000","last_unstale":"2023-05-10T04:19:15.204200+0000","last_undegraded":"2023-05-10T04:19:15.204200+0000","last_fullsized":"2023-05-10T04:19:15.204200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:55:21.820447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203862+0000","last_change":"2023-05-10T04:19:09.986983+0000","last_active":"2023-05-10T04:19:15.203862+0000","last_peered":"2023-05-10T04:19:15.203862+0000","last_clean":"2023-05-10T04:19:15.203862+0000","last_became_active":"2023-05-10T04:19:09.986701+0000","last_became_peered":"2023-05-10T04:19:09.986701+0000","last_unstale":"2023-05-10T04:19:15.203862+0000","last_undegraded":"2023-05-10T04:19:15.203862+0000","last_fullsized":"2023-05-10T04:19:15.203862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:21:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627999+0000","last_change":"2023-05-10T04:19:09.977136+0000","last_active":"2023-05-10T04:19:14.627999+0000","last_peered":"2023-05-10T04:19:14.627999+0000","last_clean":"2023-05-10T04:19:14.627999+0000","last_became_active":"2023-05-10T04:19:09.976794+0000","last_became_peered":"2023-05-10T04:19:09.976794+0000","last_unstale":"2023-05-10T04:19:14.627999+0000","last_undegraded":"2023-05-10T04:19:14.627999+0000","last_fullsized":"2023-05-10T04:19:14.627999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:19:39.672723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469767+0000","last_change":"2023-05-10T04:19:09.984844+0000","last_active":"2023-05-10T04:19:14.469767+0000","last_peered":"2023-05-10T04:19:14.469767+0000","last_clean":"2023-05-10T04:19:14.469767+0000","last_became_active":"2023-05-10T04:19:09.984531+0000","last_became_peered":"2023-05-10T04:19:09.984531+0000","last_unstale":"2023-05-10T04:19:14.469767+0000","last_undegraded":"2023-05-10T04:19:14.469767+0000","last_fullsized":"2023-05-10T04:19:14.469767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:33.935006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203424+0000","last_change":"2023-05-10T04:19:09.986208+0000","last_active":"2023-05-10T04:19:15.203424+0000","last_peered":"2023-05-10T04:19:15.203424+0000","last_clean":"2023-05-10T04:19:15.203424+0000","last_became_active":"2023-05-10T04:19:09.985544+0000","last_became_peered":"2023-05-10T04:19:09.985544+0000","last_unstale":"2023-05-10T04:19:15.203424+0000","last_undegraded":"2023-05-10T04:19:15.203424+0000","last_fullsized":"2023-05-10T04:19:15.203424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:08.821912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470497+0000","last_change":"2023-05-10T04:19:09.960642+0000","last_active":"2023-05-10T04:19:14.470497+0000","last_peered":"2023-05-10T04:19:14.470497+0000","last_clean":"2023-05-10T04:19:14.470497+0000","last_became_active":"2023-05-10T04:19:09.960283+0000","last_became_peered":"2023-05-10T04:19:09.960283+0000","last_unstale":"2023-05-10T04:19:14.470497+0000","last_undegraded":"2023-05-10T04:19:14.470497+0000","last_fullsized":"2023-05-10T04:19:14.470497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:57:41.293004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628247+0000","last_change":"2023-05-10T04:19:09.977728+0000","last_active":"2023-05-10T04:19:14.628247+0000","last_peered":"2023-05-10T04:19:14.628247+0000","last_clean":"2023-05-10T04:19:14.628247+0000","last_became_active":"2023-05-10T04:19:09.971618+0000","last_became_peered":"2023-05-10T04:19:09.971618+0000","last_unstale":"2023-05-10T04:19:14.628247+0000","last_undegraded":"2023-05-10T04:19:14.628247+0000","last_fullsized":"2023-05-10T04:19:14.628247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:55.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202232+0000","last_change":"2023-05-10T04:19:09.972981+0000","last_active":"2023-05-10T04:19:15.202232+0000","last_peered":"2023-05-10T04:19:15.202232+0000","last_clean":"2023-05-10T04:19:15.202232+0000","last_became_active":"2023-05-10T04:19:09.972690+0000","last_became_peered":"2023-05-10T04:19:09.972690+0000","last_unstale":"2023-05-10T04:19:15.202232+0000","last_undegraded":"2023-05-10T04:19:15.202232+0000","last_fullsized":"2023-05-10T04:19:15.202232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:35:07.369264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202719+0000","last_change":"2023-05-10T04:19:13.994524+0000","last_active":"2023-05-10T04:19:15.202719+0000","last_peered":"2023-05-10T04:19:15.202719+0000","last_clean":"2023-05-10T04:19:15.202719+0000","last_became_active":"2023-05-10T04:19:13.994164+0000","last_became_peered":"2023-05-10T04:19:13.994164+0000","last_unstale":"2023-05-10T04:19:15.202719+0000","last_undegraded":"2023-05-10T04:19:15.202719+0000","last_fullsized":"2023-05-10T04:19:15.202719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:16.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203829+0000","last_change":"2023-05-10T04:19:09.487208+0000","last_active":"2023-05-10T04:19:15.203829+0000","last_peered":"2023-05-10T04:19:15.203829+0000","last_clean":"2023-05-10T04:19:15.203829+0000","last_became_active":"2023-05-10T04:19:09.486969+0000","last_became_peered":"2023-05-10T04:19:09.486969+0000","last_unstale":"2023-05-10T04:19:15.203829+0000","last_undegraded":"2023-05-10T04:19:15.203829+0000","last_fullsized":"2023-05-10T04:19:15.203829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:03.029871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628183+0000","last_change":"2023-05-10T04:19:09.982864+0000","last_active":"2023-05-10T04:19:14.628183+0000","last_peered":"2023-05-10T04:19:14.628183+0000","last_clean":"2023-05-10T04:19:14.628183+0000","last_became_active":"2023-05-10T04:19:09.982599+0000","last_became_peered":"2023-05-10T04:19:09.982599+0000","last_unstale":"2023-05-10T04:19:14.628183+0000","last_undegraded":"2023-05-10T04:19:14.628183+0000","last_fullsized":"2023-05-10T04:19:14.628183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:56:49.205595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203762+0000","last_change":"2023-05-10T04:19:13.991870+0000","last_active":"2023-05-10T04:19:15.203762+0000","last_peered":"2023-05-10T04:19:15.203762+0000","last_clean":"2023-05-10T04:19:15.203762+0000","last_became_active":"2023-05-10T04:19:13.991396+0000","last_became_peered":"2023-05-10T04:19:13.991396+0000","last_unstale":"2023-05-10T04:19:15.203762+0000","last_undegraded":"2023-05-10T04:19:15.203762+0000","last_fullsized":"2023-05-10T04:19:15.203762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:04.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469470+0000","last_change":"2023-05-10T04:19:09.483051+0000","last_active":"2023-05-10T04:19:14.469470+0000","last_peered":"2023-05-10T04:19:14.469470+0000","last_clean":"2023-05-10T04:19:14.469470+0000","last_became_active":"2023-05-10T04:19:09.482746+0000","last_became_peered":"2023-05-10T04:19:09.482746+0000","last_unstale":"2023-05-10T04:19:14.469470+0000","last_undegraded":"2023-05-10T04:19:14.469470+0000","last_fullsized":"2023-05-10T04:19:14.469470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:40:44.146612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470309+0000","last_change":"2023-05-10T04:19:09.983015+0000","last_active":"2023-05-10T04:19:14.470309+0000","last_peered":"2023-05-10T04:19:14.470309+0000","last_clean":"2023-05-10T04:19:14.470309+0000","last_became_active":"2023-05-10T04:19:09.982704+0000","last_became_peered":"2023-05-10T04:19:09.982704+0000","last_unstale":"2023-05-10T04:19:14.470309+0000","last_undegraded":"2023-05-10T04:19:14.470309+0000","last_fullsized":"2023-05-10T04:19:14.470309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:01:13.105870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468779+0000","last_change":"2023-05-10T04:19:13.991979+0000","last_active":"2023-05-10T04:19:14.468779+0000","last_peered":"2023-05-10T04:19:14.468779+0000","last_clean":"2023-05-10T04:19:14.468779+0000","last_became_active":"2023-05-10T04:19:13.991551+0000","last_became_peered":"2023-05-10T04:19:13.991551+0000","last_unstale":"2023-05-10T04:19:14.468779+0000","last_undegraded":"2023-05-10T04:19:14.468779+0000","last_fullsized":"2023-05-10T04:19:14.468779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:08:02.858561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577630+0000","last_change":"2023-05-10T04:19:09.480268+0000","last_active":"2023-05-10T04:19:14.577630+0000","last_peered":"2023-05-10T04:19:14.577630+0000","last_clean":"2023-05-10T04:19:14.577630+0000","last_became_active":"2023-05-10T04:19:09.480011+0000","last_became_peered":"2023-05-10T04:19:09.480011+0000","last_unstale":"2023-05-10T04:19:14.577630+0000","last_undegraded":"2023-05-10T04:19:14.577630+0000","last_fullsized":"2023-05-10T04:19:14.577630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:21.331301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202970+0000","last_change":"2023-05-10T04:19:09.981253+0000","last_active":"2023-05-10T04:19:15.202970+0000","last_peered":"2023-05-10T04:19:15.202970+0000","last_clean":"2023-05-10T04:19:15.202970+0000","last_became_active":"2023-05-10T04:19:09.981006+0000","last_became_peered":"2023-05-10T04:19:09.981006+0000","last_unstale":"2023-05-10T04:19:15.202970+0000","last_undegraded":"2023-05-10T04:19:15.202970+0000","last_fullsized":"2023-05-10T04:19:15.202970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:03.498156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201539+0000","last_change":"2023-05-10T04:19:13.987144+0000","last_active":"2023-05-10T04:19:15.201539+0000","last_peered":"2023-05-10T04:19:15.201539+0000","last_clean":"2023-05-10T04:19:15.201539+0000","last_became_active":"2023-05-10T04:19:13.986831+0000","last_became_peered":"2023-05-10T04:19:13.986831+0000","last_unstale":"2023-05-10T04:19:15.201539+0000","last_undegraded":"2023-05-10T04:19:15.201539+0000","last_fullsized":"2023-05-10T04:19:15.201539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:17:32.556742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578392+0000","last_change":"2023-05-10T04:19:09.478894+0000","last_active":"2023-05-10T04:19:14.578392+0000","last_peered":"2023-05-10T04:19:14.578392+0000","last_clean":"2023-05-10T04:19:14.578392+0000","last_became_active":"2023-05-10T04:19:09.478612+0000","last_became_peered":"2023-05-10T04:19:09.478612+0000","last_unstale":"2023-05-10T04:19:14.578392+0000","last_undegraded":"2023-05-10T04:19:14.578392+0000","last_fullsized":"2023-05-10T04:19:14.578392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:18:29.989914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627929+0000","last_change":"2023-05-10T04:19:09.975444+0000","last_active":"2023-05-10T04:19:14.627929+0000","last_peered":"2023-05-10T04:19:14.627929+0000","last_clean":"2023-05-10T04:19:14.627929+0000","last_became_active":"2023-05-10T04:19:09.971745+0000","last_became_peered":"2023-05-10T04:19:09.971745+0000","last_unstale":"2023-05-10T04:19:14.627929+0000","last_undegraded":"2023-05-10T04:19:14.627929+0000","last_fullsized":"2023-05-10T04:19:14.627929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:35:02.017465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201957+0000","last_change":"2023-05-10T04:19:14.001881+0000","last_active":"2023-05-10T04:19:15.201957+0000","last_peered":"2023-05-10T04:19:15.201957+0000","last_clean":"2023-05-10T04:19:15.201957+0000","last_became_active":"2023-05-10T04:19:14.001490+0000","last_became_peered":"2023-05-10T04:19:14.001490+0000","last_unstale":"2023-05-10T04:19:15.201957+0000","last_undegraded":"2023-05-10T04:19:15.201957+0000","last_fullsized":"2023-05-10T04:19:15.201957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:10.947560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202406+0000","last_change":"2023-05-10T04:19:09.479617+0000","last_active":"2023-05-10T04:19:15.202406+0000","last_peered":"2023-05-10T04:19:15.202406+0000","last_clean":"2023-05-10T04:19:15.202406+0000","last_became_active":"2023-05-10T04:19:09.479285+0000","last_became_peered":"2023-05-10T04:19:09.479285+0000","last_unstale":"2023-05-10T04:19:15.202406+0000","last_undegraded":"2023-05-10T04:19:15.202406+0000","last_fullsized":"2023-05-10T04:19:15.202406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:39:56.952219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469360+0000","last_change":"2023-05-10T04:19:09.972832+0000","last_active":"2023-05-10T04:19:14.469360+0000","last_peered":"2023-05-10T04:19:14.469360+0000","last_clean":"2023-05-10T04:19:14.469360+0000","last_became_active":"2023-05-10T04:19:09.972564+0000","last_became_peered":"2023-05-10T04:19:09.972564+0000","last_unstale":"2023-05-10T04:19:14.469360+0000","last_undegraded":"2023-05-10T04:19:14.469360+0000","last_fullsized":"2023-05-10T04:19:14.469360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:04:31.918880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468579+0000","last_change":"2023-05-10T04:19:13.994267+0000","last_active":"2023-05-10T04:19:14.468579+0000","last_peered":"2023-05-10T04:19:14.468579+0000","last_clean":"2023-05-10T04:19:14.468579+0000","last_became_active":"2023-05-10T04:19:13.993865+0000","last_became_peered":"2023-05-10T04:19:13.993865+0000","last_unstale":"2023-05-10T04:19:14.468579+0000","last_undegraded":"2023-05-10T04:19:14.468579+0000","last_fullsized":"2023-05-10T04:19:14.468579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:51:00.039452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468689+0000","last_change":"2023-05-10T04:19:09.484992+0000","last_active":"2023-05-10T04:19:14.468689+0000","last_peered":"2023-05-10T04:19:14.468689+0000","last_clean":"2023-05-10T04:19:14.468689+0000","last_became_active":"2023-05-10T04:19:09.484709+0000","last_became_peered":"2023-05-10T04:19:09.484709+0000","last_unstale":"2023-05-10T04:19:14.468689+0000","last_undegraded":"2023-05-10T04:19:14.468689+0000","last_fullsized":"2023-05-10T04:19:14.468689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:06.444490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469770+0000","last_change":"2023-05-10T04:19:09.964540+0000","last_active":"2023-05-10T04:19:14.469770+0000","last_peered":"2023-05-10T04:19:14.469770+0000","last_clean":"2023-05-10T04:19:14.469770+0000","last_became_active":"2023-05-10T04:19:09.964164+0000","last_became_peered":"2023-05-10T04:19:09.964164+0000","last_unstale":"2023-05-10T04:19:14.469770+0000","last_undegraded":"2023-05-10T04:19:14.469770+0000","last_fullsized":"2023-05-10T04:19:14.469770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:13:47.427518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468432+0000","last_change":"2023-05-10T04:19:13.997349+0000","last_active":"2023-05-10T04:19:14.468432+0000","last_peered":"2023-05-10T04:19:14.468432+0000","last_clean":"2023-05-10T04:19:14.468432+0000","last_became_active":"2023-05-10T04:19:13.996910+0000","last_became_peered":"2023-05-10T04:19:13.996910+0000","last_unstale":"2023-05-10T04:19:14.468432+0000","last_undegraded":"2023-05-10T04:19:14.468432+0000","last_fullsized":"2023-05-10T04:19:14.468432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:27:38.893568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:28.525847+0000","last_change":"2023-05-10T04:19:09.487001+0000","last_active":"2023-05-10T04:19:28.525847+0000","last_peered":"2023-05-10T04:19:28.525847+0000","last_clean":"2023-05-10T04:19:28.525847+0000","last_became_active":"2023-05-10T04:19:09.486586+0000","last_became_peered":"2023-05-10T04:19:09.486586+0000","last_unstale":"2023-05-10T04:19:28.525847+0000","last_undegraded":"2023-05-10T04:19:28.525847+0000","last_fullsized":"2023-05-10T04:19:28.525847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:00:37.583297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202590+0000","last_change":"2023-05-10T04:19:09.957140+0000","last_active":"2023-05-10T04:19:15.202590+0000","last_peered":"2023-05-10T04:19:15.202590+0000","last_clean":"2023-05-10T04:19:15.202590+0000","last_became_active":"2023-05-10T04:19:09.956865+0000","last_became_peered":"2023-05-10T04:19:09.956865+0000","last_unstale":"2023-05-10T04:19:15.202590+0000","last_undegraded":"2023-05-10T04:19:15.202590+0000","last_fullsized":"2023-05-10T04:19:15.202590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:02.330187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202728+0000","last_change":"2023-05-10T04:19:13.993185+0000","last_active":"2023-05-10T04:19:15.202728+0000","last_peered":"2023-05-10T04:19:15.202728+0000","last_clean":"2023-05-10T04:19:15.202728+0000","last_became_active":"2023-05-10T04:19:13.992692+0000","last_became_peered":"2023-05-10T04:19:13.992692+0000","last_unstale":"2023-05-10T04:19:15.202728+0000","last_undegraded":"2023-05-10T04:19:15.202728+0000","last_fullsized":"2023-05-10T04:19:15.202728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:47:10.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202224+0000","last_change":"2023-05-10T04:19:09.484968+0000","last_active":"2023-05-10T04:19:15.202224+0000","last_peered":"2023-05-10T04:19:15.202224+0000","last_clean":"2023-05-10T04:19:15.202224+0000","last_became_active":"2023-05-10T04:19:09.484666+0000","last_became_peered":"2023-05-10T04:19:09.484666+0000","last_unstale":"2023-05-10T04:19:15.202224+0000","last_undegraded":"2023-05-10T04:19:15.202224+0000","last_fullsized":"2023-05-10T04:19:15.202224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:34:47.348283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468720+0000","last_change":"2023-05-10T04:19:09.965098+0000","last_active":"2023-05-10T04:19:14.468720+0000","last_peered":"2023-05-10T04:19:14.468720+0000","last_clean":"2023-05-10T04:19:14.468720+0000","last_became_active":"2023-05-10T04:19:09.964725+0000","last_became_peered":"2023-05-10T04:19:09.964725+0000","last_unstale":"2023-05-10T04:19:14.468720+0000","last_undegraded":"2023-05-10T04:19:14.468720+0000","last_fullsized":"2023-05-10T04:19:14.468720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:03.210099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469999+0000","last_change":"2023-05-10T04:19:13.993540+0000","last_active":"2023-05-10T04:19:14.469999+0000","last_peered":"2023-05-10T04:19:14.469999+0000","last_clean":"2023-05-10T04:19:14.469999+0000","last_became_active":"2023-05-10T04:19:13.993066+0000","last_became_peered":"2023-05-10T04:19:13.993066+0000","last_unstale":"2023-05-10T04:19:14.469999+0000","last_undegraded":"2023-05-10T04:19:14.469999+0000","last_fullsized":"2023-05-10T04:19:14.469999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:14:45.505584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470101+0000","last_change":"2023-05-10T04:19:09.488098+0000","last_active":"2023-05-10T04:19:14.470101+0000","last_peered":"2023-05-10T04:19:14.470101+0000","last_clean":"2023-05-10T04:19:14.470101+0000","last_became_active":"2023-05-10T04:19:09.487742+0000","last_became_peered":"2023-05-10T04:19:09.487742+0000","last_unstale":"2023-05-10T04:19:14.470101+0000","last_undegraded":"2023-05-10T04:19:14.470101+0000","last_fullsized":"2023-05-10T04:19:14.470101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:07.819601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202937+0000","last_change":"2023-05-10T04:19:09.972874+0000","last_active":"2023-05-10T04:19:15.202937+0000","last_peered":"2023-05-10T04:19:15.202937+0000","last_clean":"2023-05-10T04:19:15.202937+0000","last_became_active":"2023-05-10T04:19:09.972566+0000","last_became_peered":"2023-05-10T04:19:09.972566+0000","last_unstale":"2023-05-10T04:19:15.202937+0000","last_undegraded":"2023-05-10T04:19:15.202937+0000","last_fullsized":"2023-05-10T04:19:15.202937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:13:49.010588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470263+0000","last_change":"2023-05-10T04:19:13.993797+0000","last_active":"2023-05-10T04:19:14.470263+0000","last_peered":"2023-05-10T04:19:14.470263+0000","last_clean":"2023-05-10T04:19:14.470263+0000","last_became_active":"2023-05-10T04:19:13.993365+0000","last_became_peered":"2023-05-10T04:19:13.993365+0000","last_unstale":"2023-05-10T04:19:14.470263+0000","last_undegraded":"2023-05-10T04:19:14.470263+0000","last_fullsized":"2023-05-10T04:19:14.470263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:09:47.459492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201324+0000","last_change":"2023-05-10T04:19:09.486993+0000","last_active":"2023-05-10T04:19:15.201324+0000","last_peered":"2023-05-10T04:19:15.201324+0000","last_clean":"2023-05-10T04:19:15.201324+0000","last_became_active":"2023-05-10T04:19:09.486669+0000","last_became_peered":"2023-05-10T04:19:09.486669+0000","last_unstale":"2023-05-10T04:19:15.201324+0000","last_undegraded":"2023-05-10T04:19:15.201324+0000","last_fullsized":"2023-05-10T04:19:15.201324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:16:36.569982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578044+0000","last_change":"2023-05-10T04:19:09.983016+0000","last_active":"2023-05-10T04:19:14.578044+0000","last_peered":"2023-05-10T04:19:14.578044+0000","last_clean":"2023-05-10T04:19:14.578044+0000","last_became_active":"2023-05-10T04:19:09.982497+0000","last_became_peered":"2023-05-10T04:19:09.982497+0000","last_unstale":"2023-05-10T04:19:14.578044+0000","last_undegraded":"2023-05-10T04:19:14.578044+0000","last_fullsized":"2023-05-10T04:19:14.578044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:21:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203604+0000","last_change":"2023-05-10T04:19:13.994827+0000","last_active":"2023-05-10T04:19:15.203604+0000","last_peered":"2023-05-10T04:19:15.203604+0000","last_clean":"2023-05-10T04:19:15.203604+0000","last_became_active":"2023-05-10T04:19:13.994438+0000","last_became_peered":"2023-05-10T04:19:13.994438+0000","last_unstale":"2023-05-10T04:19:15.203604+0000","last_undegraded":"2023-05-10T04:19:15.203604+0000","last_fullsized":"2023-05-10T04:19:15.203604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:46.248734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203225+0000","last_change":"2023-05-10T04:19:09.487877+0000","last_active":"2023-05-10T04:19:15.203225+0000","last_peered":"2023-05-10T04:19:15.203225+0000","last_clean":"2023-05-10T04:19:15.203225+0000","last_became_active":"2023-05-10T04:19:09.487604+0000","last_became_peered":"2023-05-10T04:19:09.487604+0000","last_unstale":"2023-05-10T04:19:15.203225+0000","last_undegraded":"2023-05-10T04:19:15.203225+0000","last_fullsized":"2023-05-10T04:19:15.203225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:53:17.665016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578524+0000","last_change":"2023-05-10T04:19:09.980726+0000","last_active":"2023-05-10T04:19:14.578524+0000","last_peered":"2023-05-10T04:19:14.578524+0000","last_clean":"2023-05-10T04:19:14.578524+0000","last_became_active":"2023-05-10T04:19:09.980180+0000","last_became_peered":"2023-05-10T04:19:09.980180+0000","last_unstale":"2023-05-10T04:19:14.578524+0000","last_undegraded":"2023-05-10T04:19:14.578524+0000","last_fullsized":"2023-05-10T04:19:14.578524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:00.301504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203398+0000","last_change":"2023-05-10T04:19:14.003780+0000","last_active":"2023-05-10T04:19:15.203398+0000","last_peered":"2023-05-10T04:19:15.203398+0000","last_clean":"2023-05-10T04:19:15.203398+0000","last_became_active":"2023-05-10T04:19:14.003409+0000","last_became_peered":"2023-05-10T04:19:14.003409+0000","last_unstale":"2023-05-10T04:19:15.203398+0000","last_undegraded":"2023-05-10T04:19:15.203398+0000","last_fullsized":"2023-05-10T04:19:15.203398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:50:12.629644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469034+0000","last_change":"2023-05-10T04:19:09.483762+0000","last_active":"2023-05-10T04:19:14.469034+0000","last_peered":"2023-05-10T04:19:14.469034+0000","last_clean":"2023-05-10T04:19:14.469034+0000","last_became_active":"2023-05-10T04:19:09.483508+0000","last_became_peered":"2023-05-10T04:19:09.483508+0000","last_unstale":"2023-05-10T04:19:14.469034+0000","last_undegraded":"2023-05-10T04:19:14.469034+0000","last_fullsized":"2023-05-10T04:19:14.469034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:01.327876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201995+0000","last_change":"2023-05-10T04:19:09.978563+0000","last_active":"2023-05-10T04:19:15.201995+0000","last_peered":"2023-05-10T04:19:15.201995+0000","last_clean":"2023-05-10T04:19:15.201995+0000","last_became_active":"2023-05-10T04:19:09.978238+0000","last_became_peered":"2023-05-10T04:19:09.978238+0000","last_unstale":"2023-05-10T04:19:15.201995+0000","last_undegraded":"2023-05-10T04:19:15.201995+0000","last_fullsized":"2023-05-10T04:19:15.201995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:20:11.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468304+0000","last_change":"2023-05-10T04:19:13.991533+0000","last_active":"2023-05-10T04:19:14.468304+0000","last_peered":"2023-05-10T04:19:14.468304+0000","last_clean":"2023-05-10T04:19:14.468304+0000","last_became_active":"2023-05-10T04:19:13.990999+0000","last_became_peered":"2023-05-10T04:19:13.990999+0000","last_unstale":"2023-05-10T04:19:14.468304+0000","last_undegraded":"2023-05-10T04:19:14.468304+0000","last_fullsized":"2023-05-10T04:19:14.468304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:05.585266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202273+0000","last_change":"2023-05-10T04:19:09.485526+0000","last_active":"2023-05-10T04:19:15.202273+0000","last_peered":"2023-05-10T04:19:15.202273+0000","last_clean":"2023-05-10T04:19:15.202273+0000","last_became_active":"2023-05-10T04:19:09.485273+0000","last_became_peered":"2023-05-10T04:19:09.485273+0000","last_unstale":"2023-05-10T04:19:15.202273+0000","last_undegraded":"2023-05-10T04:19:15.202273+0000","last_fullsized":"2023-05-10T04:19:15.202273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:41.760079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203432+0000","last_change":"2023-05-10T04:19:09.985453+0000","last_active":"2023-05-10T04:19:15.203432+0000","last_peered":"2023-05-10T04:19:15.203432+0000","last_clean":"2023-05-10T04:19:15.203432+0000","last_became_active":"2023-05-10T04:19:09.985167+0000","last_became_peered":"2023-05-10T04:19:09.985167+0000","last_unstale":"2023-05-10T04:19:15.203432+0000","last_undegraded":"2023-05-10T04:19:15.203432+0000","last_fullsized":"2023-05-10T04:19:15.203432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:22.333611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577827+0000","last_change":"2023-05-10T04:19:14.004309+0000","last_active":"2023-05-10T04:19:14.577827+0000","last_peered":"2023-05-10T04:19:14.577827+0000","last_clean":"2023-05-10T04:19:14.577827+0000","last_became_active":"2023-05-10T04:19:14.003928+0000","last_became_peered":"2023-05-10T04:19:14.003928+0000","last_unstale":"2023-05-10T04:19:14.577827+0000","last_undegraded":"2023-05-10T04:19:14.577827+0000","last_fullsized":"2023-05-10T04:19:14.577827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:24:10.810295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202378+0000","last_change":"2023-05-10T04:19:09.482542+0000","last_active":"2023-05-10T04:19:15.202378+0000","last_peered":"2023-05-10T04:19:15.202378+0000","last_clean":"2023-05-10T04:19:15.202378+0000","last_became_active":"2023-05-10T04:19:09.482173+0000","last_became_peered":"2023-05-10T04:19:09.482173+0000","last_unstale":"2023-05-10T04:19:15.202378+0000","last_undegraded":"2023-05-10T04:19:15.202378+0000","last_fullsized":"2023-05-10T04:19:15.202378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:55:03.870485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202375+0000","last_change":"2023-05-10T04:19:09.957801+0000","last_active":"2023-05-10T04:19:15.202375+0000","last_peered":"2023-05-10T04:19:15.202375+0000","last_clean":"2023-05-10T04:19:15.202375+0000","last_became_active":"2023-05-10T04:19:09.957469+0000","last_became_peered":"2023-05-10T04:19:09.957469+0000","last_unstale":"2023-05-10T04:19:15.202375+0000","last_undegraded":"2023-05-10T04:19:15.202375+0000","last_fullsized":"2023-05-10T04:19:15.202375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:26:39.953202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469741+0000","last_change":"2023-05-10T04:19:13.991736+0000","last_active":"2023-05-10T04:19:14.469741+0000","last_peered":"2023-05-10T04:19:14.469741+0000","last_clean":"2023-05-10T04:19:14.469741+0000","last_became_active":"2023-05-10T04:19:13.991194+0000","last_became_peered":"2023-05-10T04:19:13.991194+0000","last_unstale":"2023-05-10T04:19:14.469741+0000","last_undegraded":"2023-05-10T04:19:14.469741+0000","last_fullsized":"2023-05-10T04:19:14.469741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:50:12.629644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468850+0000","last_change":"2023-05-10T04:19:09.483818+0000","last_active":"2023-05-10T04:19:14.468850+0000","last_peered":"2023-05-10T04:19:14.468850+0000","last_clean":"2023-05-10T04:19:14.468850+0000","last_became_active":"2023-05-10T04:19:09.483516+0000","last_became_peered":"2023-05-10T04:19:09.483516+0000","last_unstale":"2023-05-10T04:19:14.468850+0000","last_undegraded":"2023-05-10T04:19:14.468850+0000","last_fullsized":"2023-05-10T04:19:14.468850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:39:56.952219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577909+0000","last_change":"2023-05-10T04:19:09.979521+0000","last_active":"2023-05-10T04:19:14.577909+0000","last_peered":"2023-05-10T04:19:14.577909+0000","last_clean":"2023-05-10T04:19:14.577909+0000","last_became_active":"2023-05-10T04:19:09.979271+0000","last_became_peered":"2023-05-10T04:19:09.979271+0000","last_unstale":"2023-05-10T04:19:14.577909+0000","last_undegraded":"2023-05-10T04:19:14.577909+0000","last_fullsized":"2023-05-10T04:19:14.577909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:05:43.697518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628055+0000","last_change":"2023-05-10T04:19:13.998610+0000","last_active":"2023-05-10T04:19:14.628055+0000","last_peered":"2023-05-10T04:19:14.628055+0000","last_clean":"2023-05-10T04:19:14.628055+0000","last_became_active":"2023-05-10T04:19:13.996908+0000","last_became_peered":"2023-05-10T04:19:13.996908+0000","last_unstale":"2023-05-10T04:19:14.628055+0000","last_undegraded":"2023-05-10T04:19:14.628055+0000","last_fullsized":"2023-05-10T04:19:14.628055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:00:47.831221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628332+0000","last_change":"2023-05-10T04:19:09.482944+0000","last_active":"2023-05-10T04:19:14.628332+0000","last_peered":"2023-05-10T04:19:14.628332+0000","last_clean":"2023-05-10T04:19:14.628332+0000","last_became_active":"2023-05-10T04:19:09.482584+0000","last_became_peered":"2023-05-10T04:19:09.482584+0000","last_unstale":"2023-05-10T04:19:14.628332+0000","last_undegraded":"2023-05-10T04:19:14.628332+0000","last_fullsized":"2023-05-10T04:19:14.628332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:22:54.728492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468803+0000","last_change":"2023-05-10T04:19:09.971873+0000","last_active":"2023-05-10T04:19:14.468803+0000","last_peered":"2023-05-10T04:19:14.468803+0000","last_clean":"2023-05-10T04:19:14.468803+0000","last_became_active":"2023-05-10T04:19:09.971597+0000","last_became_peered":"2023-05-10T04:19:09.971597+0000","last_unstale":"2023-05-10T04:19:14.468803+0000","last_undegraded":"2023-05-10T04:19:14.468803+0000","last_fullsized":"2023-05-10T04:19:14.468803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:26:39.953202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577980+0000","last_change":"2023-05-10T04:19:14.004765+0000","last_active":"2023-05-10T04:19:14.577980+0000","last_peered":"2023-05-10T04:19:14.577980+0000","last_clean":"2023-05-10T04:19:14.577980+0000","last_became_active":"2023-05-10T04:19:14.004329+0000","last_became_peered":"2023-05-10T04:19:14.004329+0000","last_unstale":"2023-05-10T04:19:14.577980+0000","last_undegraded":"2023-05-10T04:19:14.577980+0000","last_fullsized":"2023-05-10T04:19:14.577980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:01:56.052239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202125+0000","last_change":"2023-05-10T04:19:09.477530+0000","last_active":"2023-05-10T04:19:15.202125+0000","last_peered":"2023-05-10T04:19:15.202125+0000","last_clean":"2023-05-10T04:19:15.202125+0000","last_became_active":"2023-05-10T04:19:09.477212+0000","last_became_peered":"2023-05-10T04:19:09.477212+0000","last_unstale":"2023-05-10T04:19:15.202125+0000","last_undegraded":"2023-05-10T04:19:15.202125+0000","last_fullsized":"2023-05-10T04:19:15.202125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:43.682176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203043+0000","last_change":"2023-05-10T04:19:09.979824+0000","last_active":"2023-05-10T04:19:15.203043+0000","last_peered":"2023-05-10T04:19:15.203043+0000","last_clean":"2023-05-10T04:19:15.203043+0000","last_became_active":"2023-05-10T04:19:09.979050+0000","last_became_peered":"2023-05-10T04:19:09.979050+0000","last_unstale":"2023-05-10T04:19:15.203043+0000","last_undegraded":"2023-05-10T04:19:15.203043+0000","last_fullsized":"2023-05-10T04:19:15.203043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:38:42.232230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203438+0000","last_change":"2023-05-10T04:19:14.002975+0000","last_active":"2023-05-10T04:19:15.203438+0000","last_peered":"2023-05-10T04:19:15.203438+0000","last_clean":"2023-05-10T04:19:15.203438+0000","last_became_active":"2023-05-10T04:19:14.002560+0000","last_became_peered":"2023-05-10T04:19:14.002560+0000","last_unstale":"2023-05-10T04:19:15.203438+0000","last_undegraded":"2023-05-10T04:19:15.203438+0000","last_fullsized":"2023-05-10T04:19:15.203438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:23:30.609594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201619+0000","last_change":"2023-05-10T04:19:09.474972+0000","last_active":"2023-05-10T04:19:15.201619+0000","last_peered":"2023-05-10T04:19:15.201619+0000","last_clean":"2023-05-10T04:19:15.201619+0000","last_became_active":"2023-05-10T04:19:09.474099+0000","last_became_peered":"2023-05-10T04:19:09.474099+0000","last_unstale":"2023-05-10T04:19:15.201619+0000","last_undegraded":"2023-05-10T04:19:15.201619+0000","last_fullsized":"2023-05-10T04:19:15.201619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:54:08.193033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202858+0000","last_change":"2023-05-10T04:19:09.957614+0000","last_active":"2023-05-10T04:19:15.202858+0000","last_peered":"2023-05-10T04:19:15.202858+0000","last_clean":"2023-05-10T04:19:15.202858+0000","last_became_active":"2023-05-10T04:19:09.957357+0000","last_became_peered":"2023-05-10T04:19:09.957357+0000","last_unstale":"2023-05-10T04:19:15.202858+0000","last_undegraded":"2023-05-10T04:19:15.202858+0000","last_fullsized":"2023-05-10T04:19:15.202858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:58:35.622573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202916+0000","last_change":"2023-05-10T04:19:13.993397+0000","last_active":"2023-05-10T04:19:15.202916+0000","last_peered":"2023-05-10T04:19:15.202916+0000","last_clean":"2023-05-10T04:19:15.202916+0000","last_became_active":"2023-05-10T04:19:13.992829+0000","last_became_peered":"2023-05-10T04:19:13.992829+0000","last_unstale":"2023-05-10T04:19:15.202916+0000","last_undegraded":"2023-05-10T04:19:15.202916+0000","last_fullsized":"2023-05-10T04:19:15.202916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:20:16.772499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469100+0000","last_change":"2023-05-10T04:19:09.473096+0000","last_active":"2023-05-10T04:19:14.469100+0000","last_peered":"2023-05-10T04:19:14.469100+0000","last_clean":"2023-05-10T04:19:14.469100+0000","last_became_active":"2023-05-10T04:19:09.472782+0000","last_became_peered":"2023-05-10T04:19:09.472782+0000","last_unstale":"2023-05-10T04:19:14.469100+0000","last_undegraded":"2023-05-10T04:19:14.469100+0000","last_fullsized":"2023-05-10T04:19:14.469100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:55:45.107377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628277+0000","last_change":"2023-05-10T04:19:09.976127+0000","last_active":"2023-05-10T04:19:14.628277+0000","last_peered":"2023-05-10T04:19:14.628277+0000","last_clean":"2023-05-10T04:19:14.628277+0000","last_became_active":"2023-05-10T04:19:09.975290+0000","last_became_peered":"2023-05-10T04:19:09.975290+0000","last_unstale":"2023-05-10T04:19:14.628277+0000","last_undegraded":"2023-05-10T04:19:14.628277+0000","last_fullsized":"2023-05-10T04:19:14.628277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:16.352843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468740+0000","last_change":"2023-05-10T04:19:13.993845+0000","last_active":"2023-05-10T04:19:14.468740+0000","last_peered":"2023-05-10T04:19:14.468740+0000","last_clean":"2023-05-10T04:19:14.468740+0000","last_became_active":"2023-05-10T04:19:13.993409+0000","last_became_peered":"2023-05-10T04:19:13.993409+0000","last_unstale":"2023-05-10T04:19:14.468740+0000","last_undegraded":"2023-05-10T04:19:14.468740+0000","last_fullsized":"2023-05-10T04:19:14.468740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:43:57.821791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578256+0000","last_change":"2023-05-10T04:19:04.607342+0000","last_active":"2023-05-10T04:19:14.578256+0000","last_peered":"2023-05-10T04:19:14.578256+0000","last_clean":"2023-05-10T04:19:14.578256+0000","last_became_active":"2023-05-10T04:19:04.606956+0000","last_became_peered":"2023-05-10T04:19:04.606956+0000","last_unstale":"2023-05-10T04:19:14.578256+0000","last_undegraded":"2023-05-10T04:19:14.578256+0000","last_fullsized":"2023-05-10T04:19:14.578256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:51.656021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203073+0000","last_change":"2023-05-10T04:19:09.480586+0000","last_active":"2023-05-10T04:19:15.203073+0000","last_peered":"2023-05-10T04:19:15.203073+0000","last_clean":"2023-05-10T04:19:15.203073+0000","last_became_active":"2023-05-10T04:19:09.480088+0000","last_became_peered":"2023-05-10T04:19:09.480088+0000","last_unstale":"2023-05-10T04:19:15.203073+0000","last_undegraded":"2023-05-10T04:19:15.203073+0000","last_fullsized":"2023-05-10T04:19:15.203073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:07:58.355490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469903+0000","last_change":"2023-05-10T04:19:09.961077+0000","last_active":"2023-05-10T04:19:14.469903+0000","last_peered":"2023-05-10T04:19:14.469903+0000","last_clean":"2023-05-10T04:19:14.469903+0000","last_became_active":"2023-05-10T04:19:09.960790+0000","last_became_peered":"2023-05-10T04:19:09.960790+0000","last_unstale":"2023-05-10T04:19:14.469903+0000","last_undegraded":"2023-05-10T04:19:14.469903+0000","last_fullsized":"2023-05-10T04:19:14.469903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:23:27.108834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628434+0000","last_change":"2023-05-10T04:19:13.996996+0000","last_active":"2023-05-10T04:19:14.628434+0000","last_peered":"2023-05-10T04:19:14.628434+0000","last_clean":"2023-05-10T04:19:14.628434+0000","last_became_active":"2023-05-10T04:19:13.996598+0000","last_became_peered":"2023-05-10T04:19:13.996598+0000","last_unstale":"2023-05-10T04:19:14.628434+0000","last_undegraded":"2023-05-10T04:19:14.628434+0000","last_fullsized":"2023-05-10T04:19:14.628434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:28.777158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204389+0000","last_change":"2023-05-10T04:19:04.607370+0000","last_active":"2023-05-10T04:19:15.204389+0000","last_peered":"2023-05-10T04:19:15.204389+0000","last_clean":"2023-05-10T04:19:15.204389+0000","last_became_active":"2023-05-10T04:19:04.606959+0000","last_became_peered":"2023-05-10T04:19:04.606959+0000","last_unstale":"2023-05-10T04:19:15.204389+0000","last_undegraded":"2023-05-10T04:19:15.204389+0000","last_fullsized":"2023-05-10T04:19:15.204389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:46:45.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468586+0000","last_change":"2023-05-10T04:19:09.485273+0000","last_active":"2023-05-10T04:19:14.468586+0000","last_peered":"2023-05-10T04:19:14.468586+0000","last_clean":"2023-05-10T04:19:14.468586+0000","last_became_active":"2023-05-10T04:19:09.484339+0000","last_became_peered":"2023-05-10T04:19:09.484339+0000","last_unstale":"2023-05-10T04:19:14.468586+0000","last_undegraded":"2023-05-10T04:19:14.468586+0000","last_fullsized":"2023-05-10T04:19:14.468586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:22:54.728492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468949+0000","last_change":"2023-05-10T04:19:09.972782+0000","last_active":"2023-05-10T04:19:14.468949+0000","last_peered":"2023-05-10T04:19:14.468949+0000","last_clean":"2023-05-10T04:19:14.468949+0000","last_became_active":"2023-05-10T04:19:09.972529+0000","last_became_peered":"2023-05-10T04:19:09.972529+0000","last_unstale":"2023-05-10T04:19:14.468949+0000","last_undegraded":"2023-05-10T04:19:14.468949+0000","last_fullsized":"2023-05-10T04:19:14.468949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:58:35.622573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628526+0000","last_change":"2023-05-10T04:19:13.998192+0000","last_active":"2023-05-10T04:19:14.628526+0000","last_peered":"2023-05-10T04:19:14.628526+0000","last_clean":"2023-05-10T04:19:14.628526+0000","last_became_active":"2023-05-10T04:19:13.997769+0000","last_became_peered":"2023-05-10T04:19:13.997769+0000","last_unstale":"2023-05-10T04:19:14.628526+0000","last_undegraded":"2023-05-10T04:19:14.628526+0000","last_fullsized":"2023-05-10T04:19:14.628526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:46.263150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627832+0000","last_change":"2023-05-10T04:19:04.443832+0000","last_active":"2023-05-10T04:19:14.627832+0000","last_peered":"2023-05-10T04:19:14.627832+0000","last_clean":"2023-05-10T04:19:14.627832+0000","last_became_active":"2023-05-10T04:19:04.443487+0000","last_became_peered":"2023-05-10T04:19:04.443487+0000","last_unstale":"2023-05-10T04:19:14.627832+0000","last_undegraded":"2023-05-10T04:19:14.627832+0000","last_fullsized":"2023-05-10T04:19:14.627832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:15:00.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577489+0000","last_change":"2023-05-10T04:19:09.485735+0000","last_active":"2023-05-10T04:19:14.577489+0000","last_peered":"2023-05-10T04:19:14.577489+0000","last_clean":"2023-05-10T04:19:14.577489+0000","last_became_active":"2023-05-10T04:19:09.485425+0000","last_became_peered":"2023-05-10T04:19:09.485425+0000","last_unstale":"2023-05-10T04:19:14.577489+0000","last_undegraded":"2023-05-10T04:19:14.577489+0000","last_fullsized":"2023-05-10T04:19:14.577489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:07.819601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469043+0000","last_change":"2023-05-10T04:19:09.977673+0000","last_active":"2023-05-10T04:19:14.469043+0000","last_peered":"2023-05-10T04:19:14.469043+0000","last_clean":"2023-05-10T04:19:14.469043+0000","last_became_active":"2023-05-10T04:19:09.977396+0000","last_became_peered":"2023-05-10T04:19:09.977396+0000","last_unstale":"2023-05-10T04:19:14.469043+0000","last_undegraded":"2023-05-10T04:19:14.469043+0000","last_fullsized":"2023-05-10T04:19:14.469043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:19.596953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468711+0000","last_change":"2023-05-10T04:19:13.997725+0000","last_active":"2023-05-10T04:19:14.468711+0000","last_peered":"2023-05-10T04:19:14.468711+0000","last_clean":"2023-05-10T04:19:14.468711+0000","last_became_active":"2023-05-10T04:19:13.997358+0000","last_became_peered":"2023-05-10T04:19:13.997358+0000","last_unstale":"2023-05-10T04:19:14.468711+0000","last_undegraded":"2023-05-10T04:19:14.468711+0000","last_fullsized":"2023-05-10T04:19:14.468711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:28.777158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202014+0000","last_change":"2023-05-10T04:19:04.443331+0000","last_active":"2023-05-10T04:19:15.202014+0000","last_peered":"2023-05-10T04:19:15.202014+0000","last_clean":"2023-05-10T04:19:15.202014+0000","last_became_active":"2023-05-10T04:19:04.443060+0000","last_became_peered":"2023-05-10T04:19:04.443060+0000","last_unstale":"2023-05-10T04:19:15.202014+0000","last_undegraded":"2023-05-10T04:19:15.202014+0000","last_fullsized":"2023-05-10T04:19:15.202014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:57:20.264880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203569+0000","last_change":"2023-05-10T04:18:57.192195+0000","last_active":"2023-05-10T04:19:15.203569+0000","last_peered":"2023-05-10T04:19:15.203569+0000","last_clean":"2023-05-10T04:19:15.203569+0000","last_became_active":"2023-05-10T04:18:57.191298+0000","last_became_peered":"2023-05-10T04:18:57.191298+0000","last_unstale":"2023-05-10T04:19:15.203569+0000","last_undegraded":"2023-05-10T04:19:15.203569+0000","last_fullsized":"2023-05-10T04:19:15.203569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_clean_scrub_stamp":"2023-05-10T04:18:56.172967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:05:30.415630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469650+0000","last_change":"2023-05-10T04:19:09.473780+0000","last_active":"2023-05-10T04:19:14.469650+0000","last_peered":"2023-05-10T04:19:14.469650+0000","last_clean":"2023-05-10T04:19:14.469650+0000","last_became_active":"2023-05-10T04:19:09.473417+0000","last_became_peered":"2023-05-10T04:19:09.473417+0000","last_unstale":"2023-05-10T04:19:14.469650+0000","last_undegraded":"2023-05-10T04:19:14.469650+0000","last_fullsized":"2023-05-10T04:19:14.469650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:35:58.690053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202817+0000","last_change":"2023-05-10T04:19:09.980022+0000","last_active":"2023-05-10T04:19:15.202817+0000","last_peered":"2023-05-10T04:19:15.202817+0000","last_clean":"2023-05-10T04:19:15.202817+0000","last_became_active":"2023-05-10T04:19:09.979557+0000","last_became_peered":"2023-05-10T04:19:09.979557+0000","last_unstale":"2023-05-10T04:19:15.202817+0000","last_undegraded":"2023-05-10T04:19:15.202817+0000","last_fullsized":"2023-05-10T04:19:15.202817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:27:31.317037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202554+0000","last_change":"2023-05-10T04:19:13.990077+0000","last_active":"2023-05-10T04:19:15.202554+0000","last_peered":"2023-05-10T04:19:15.202554+0000","last_clean":"2023-05-10T04:19:15.202554+0000","last_became_active":"2023-05-10T04:19:13.989665+0000","last_became_peered":"2023-05-10T04:19:13.989665+0000","last_unstale":"2023-05-10T04:19:15.202554+0000","last_undegraded":"2023-05-10T04:19:15.202554+0000","last_fullsized":"2023-05-10T04:19:15.202554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:56:23.432293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201872+0000","last_change":"2023-05-10T04:19:04.443785+0000","last_active":"2023-05-10T04:19:15.201872+0000","last_peered":"2023-05-10T04:19:15.201872+0000","last_clean":"2023-05-10T04:19:15.201872+0000","last_became_active":"2023-05-10T04:19:04.443499+0000","last_became_peered":"2023-05-10T04:19:04.443499+0000","last_unstale":"2023-05-10T04:19:15.201872+0000","last_undegraded":"2023-05-10T04:19:15.201872+0000","last_fullsized":"2023-05-10T04:19:15.201872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:36:06.817648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468318+0000","last_change":"2023-05-10T04:19:09.480112+0000","last_active":"2023-05-10T04:19:14.468318+0000","last_peered":"2023-05-10T04:19:14.468318+0000","last_clean":"2023-05-10T04:19:14.468318+0000","last_became_active":"2023-05-10T04:19:09.479809+0000","last_became_peered":"2023-05-10T04:19:09.479809+0000","last_unstale":"2023-05-10T04:19:14.468318+0000","last_undegraded":"2023-05-10T04:19:14.468318+0000","last_fullsized":"2023-05-10T04:19:14.468318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:01.327876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578367+0000","last_change":"2023-05-10T04:19:09.982844+0000","last_active":"2023-05-10T04:19:14.578367+0000","last_peered":"2023-05-10T04:19:14.578367+0000","last_clean":"2023-05-10T04:19:14.578367+0000","last_became_active":"2023-05-10T04:19:09.982169+0000","last_became_peered":"2023-05-10T04:19:09.982169+0000","last_unstale":"2023-05-10T04:19:14.578367+0000","last_undegraded":"2023-05-10T04:19:14.578367+0000","last_fullsized":"2023-05-10T04:19:14.578367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:15:37.641989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468590+0000","last_change":"2023-05-10T04:19:13.996191+0000","last_active":"2023-05-10T04:19:14.468590+0000","last_peered":"2023-05-10T04:19:14.468590+0000","last_clean":"2023-05-10T04:19:14.468590+0000","last_became_active":"2023-05-10T04:19:13.995821+0000","last_became_peered":"2023-05-10T04:19:13.995821+0000","last_unstale":"2023-05-10T04:19:14.468590+0000","last_undegraded":"2023-05-10T04:19:14.468590+0000","last_fullsized":"2023-05-10T04:19:14.468590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:19.853603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202501+0000","last_change":"2023-05-10T04:19:04.442968+0000","last_active":"2023-05-10T04:19:15.202501+0000","last_peered":"2023-05-10T04:19:15.202501+0000","last_clean":"2023-05-10T04:19:15.202501+0000","last_became_active":"2023-05-10T04:19:04.442633+0000","last_became_peered":"2023-05-10T04:19:04.442633+0000","last_unstale":"2023-05-10T04:19:15.202501+0000","last_undegraded":"2023-05-10T04:19:15.202501+0000","last_fullsized":"2023-05-10T04:19:15.202501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:25:07.501670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469097+0000","last_change":"2023-05-10T04:19:09.484103+0000","last_active":"2023-05-10T04:19:14.469097+0000","last_peered":"2023-05-10T04:19:14.469097+0000","last_clean":"2023-05-10T04:19:14.469097+0000","last_became_active":"2023-05-10T04:19:09.483770+0000","last_became_peered":"2023-05-10T04:19:09.483770+0000","last_unstale":"2023-05-10T04:19:14.469097+0000","last_undegraded":"2023-05-10T04:19:14.469097+0000","last_fullsized":"2023-05-10T04:19:14.469097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:53:17.665016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469128+0000","last_change":"2023-05-10T04:19:09.971611+0000","last_active":"2023-05-10T04:19:14.469128+0000","last_peered":"2023-05-10T04:19:14.469128+0000","last_clean":"2023-05-10T04:19:14.469128+0000","last_became_active":"2023-05-10T04:19:09.971338+0000","last_became_peered":"2023-05-10T04:19:09.971338+0000","last_unstale":"2023-05-10T04:19:14.469128+0000","last_undegraded":"2023-05-10T04:19:14.469128+0000","last_fullsized":"2023-05-10T04:19:14.469128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:54:23.670496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202060+0000","last_change":"2023-05-10T04:19:13.990413+0000","last_active":"2023-05-10T04:19:15.202060+0000","last_peered":"2023-05-10T04:19:15.202060+0000","last_clean":"2023-05-10T04:19:15.202060+0000","last_became_active":"2023-05-10T04:19:13.988555+0000","last_became_peered":"2023-05-10T04:19:13.988555+0000","last_unstale":"2023-05-10T04:19:15.202060+0000","last_undegraded":"2023-05-10T04:19:15.202060+0000","last_fullsized":"2023-05-10T04:19:15.202060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:44:59.851980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470404+0000","last_change":"2023-05-10T04:19:09.480141+0000","last_active":"2023-05-10T04:19:14.470404+0000","last_peered":"2023-05-10T04:19:14.470404+0000","last_clean":"2023-05-10T04:19:14.470404+0000","last_became_active":"2023-05-10T04:19:09.479868+0000","last_became_peered":"2023-05-10T04:19:09.479868+0000","last_unstale":"2023-05-10T04:19:14.470404+0000","last_undegraded":"2023-05-10T04:19:14.470404+0000","last_fullsized":"2023-05-10T04:19:14.470404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:40:32.714684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470401+0000","last_change":"2023-05-10T04:19:04.440282+0000","last_active":"2023-05-10T04:19:14.470401+0000","last_peered":"2023-05-10T04:19:14.470401+0000","last_clean":"2023-05-10T04:19:14.470401+0000","last_became_active":"2023-05-10T04:19:04.439945+0000","last_became_peered":"2023-05-10T04:19:04.439945+0000","last_unstale":"2023-05-10T04:19:14.470401+0000","last_undegraded":"2023-05-10T04:19:14.470401+0000","last_fullsized":"2023-05-10T04:19:14.470401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:08:26.159897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468913+0000","last_change":"2023-05-10T04:19:09.983026+0000","last_active":"2023-05-10T04:19:14.468913+0000","last_peered":"2023-05-10T04:19:14.468913+0000","last_clean":"2023-05-10T04:19:14.468913+0000","last_became_active":"2023-05-10T04:19:09.982665+0000","last_became_peered":"2023-05-10T04:19:09.982665+0000","last_unstale":"2023-05-10T04:19:14.468913+0000","last_undegraded":"2023-05-10T04:19:14.468913+0000","last_fullsized":"2023-05-10T04:19:14.468913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:36:35.332796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469350+0000","last_change":"2023-05-10T04:19:14.006885+0000","last_active":"2023-05-10T04:19:14.469350+0000","last_peered":"2023-05-10T04:19:14.469350+0000","last_clean":"2023-05-10T04:19:14.469350+0000","last_became_active":"2023-05-10T04:19:14.006506+0000","last_became_peered":"2023-05-10T04:19:14.006506+0000","last_unstale":"2023-05-10T04:19:14.469350+0000","last_undegraded":"2023-05-10T04:19:14.469350+0000","last_fullsized":"2023-05-10T04:19:14.469350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:31:03.826068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202770+0000","last_change":"2023-05-10T04:19:04.444610+0000","last_active":"2023-05-10T04:19:15.202770+0000","last_peered":"2023-05-10T04:19:15.202770+0000","last_clean":"2023-05-10T04:19:15.202770+0000","last_became_active":"2023-05-10T04:19:04.444273+0000","last_became_peered":"2023-05-10T04:19:04.444273+0000","last_unstale":"2023-05-10T04:19:15.202770+0000","last_undegraded":"2023-05-10T04:19:15.202770+0000","last_fullsized":"2023-05-10T04:19:15.202770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:16:40.114985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470258+0000","last_change":"2023-05-10T04:19:09.477274+0000","last_active":"2023-05-10T04:19:14.470258+0000","last_peered":"2023-05-10T04:19:14.470258+0000","last_clean":"2023-05-10T04:19:14.470258+0000","last_became_active":"2023-05-10T04:19:09.476956+0000","last_became_peered":"2023-05-10T04:19:09.476956+0000","last_unstale":"2023-05-10T04:19:14.470258+0000","last_undegraded":"2023-05-10T04:19:14.470258+0000","last_fullsized":"2023-05-10T04:19:14.470258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:59.737968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202341+0000","last_change":"2023-05-10T04:19:09.959284+0000","last_active":"2023-05-10T04:19:15.202341+0000","last_peered":"2023-05-10T04:19:15.202341+0000","last_clean":"2023-05-10T04:19:15.202341+0000","last_became_active":"2023-05-10T04:19:09.959030+0000","last_became_peered":"2023-05-10T04:19:09.959030+0000","last_unstale":"2023-05-10T04:19:15.202341+0000","last_undegraded":"2023-05-10T04:19:15.202341+0000","last_fullsized":"2023-05-10T04:19:15.202341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:04:32.114370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469919+0000","last_change":"2023-05-10T04:19:13.995438+0000","last_active":"2023-05-10T04:19:14.469919+0000","last_peered":"2023-05-10T04:19:14.469919+0000","last_clean":"2023-05-10T04:19:14.469919+0000","last_became_active":"2023-05-10T04:19:13.994966+0000","last_became_peered":"2023-05-10T04:19:13.994966+0000","last_unstale":"2023-05-10T04:19:14.469919+0000","last_undegraded":"2023-05-10T04:19:14.469919+0000","last_fullsized":"2023-05-10T04:19:14.469919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:05:44.625042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468987+0000","last_change":"2023-05-10T04:19:09.485131+0000","last_active":"2023-05-10T04:19:14.468987+0000","last_peered":"2023-05-10T04:19:14.468987+0000","last_clean":"2023-05-10T04:19:14.468987+0000","last_became_active":"2023-05-10T04:19:09.484754+0000","last_became_peered":"2023-05-10T04:19:09.484754+0000","last_unstale":"2023-05-10T04:19:14.468987+0000","last_undegraded":"2023-05-10T04:19:14.468987+0000","last_fullsized":"2023-05-10T04:19:14.468987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:30:21.704079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469574+0000","last_change":"2023-05-10T04:19:09.970210+0000","last_active":"2023-05-10T04:19:14.469574+0000","last_peered":"2023-05-10T04:19:14.469574+0000","last_clean":"2023-05-10T04:19:14.469574+0000","last_became_active":"2023-05-10T04:19:09.969916+0000","last_became_peered":"2023-05-10T04:19:09.969916+0000","last_unstale":"2023-05-10T04:19:14.469574+0000","last_undegraded":"2023-05-10T04:19:14.469574+0000","last_fullsized":"2023-05-10T04:19:14.469574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:08:49.572839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203900+0000","last_change":"2023-05-10T04:19:14.000125+0000","last_active":"2023-05-10T04:19:15.203900+0000","last_peered":"2023-05-10T04:19:15.203900+0000","last_clean":"2023-05-10T04:19:15.203900+0000","last_became_active":"2023-05-10T04:19:13.998988+0000","last_became_peered":"2023-05-10T04:19:13.998988+0000","last_unstale":"2023-05-10T04:19:15.203900+0000","last_undegraded":"2023-05-10T04:19:15.203900+0000","last_fullsized":"2023-05-10T04:19:15.203900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:39:35.802978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204178+0000","last_change":"2023-05-10T04:19:09.488600+0000","last_active":"2023-05-10T04:19:15.204178+0000","last_peered":"2023-05-10T04:19:15.204178+0000","last_clean":"2023-05-10T04:19:15.204178+0000","last_became_active":"2023-05-10T04:19:09.488320+0000","last_became_peered":"2023-05-10T04:19:09.488320+0000","last_unstale":"2023-05-10T04:19:15.204178+0000","last_undegraded":"2023-05-10T04:19:15.204178+0000","last_fullsized":"2023-05-10T04:19:15.204178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:14:10.406433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202715+0000","last_change":"2023-05-10T04:19:09.986548+0000","last_active":"2023-05-10T04:19:15.202715+0000","last_peered":"2023-05-10T04:19:15.202715+0000","last_clean":"2023-05-10T04:19:15.202715+0000","last_became_active":"2023-05-10T04:19:09.986228+0000","last_became_peered":"2023-05-10T04:19:09.986228+0000","last_unstale":"2023-05-10T04:19:15.202715+0000","last_undegraded":"2023-05-10T04:19:15.202715+0000","last_fullsized":"2023-05-10T04:19:15.202715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:03.210099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202625+0000","last_change":"2023-05-10T04:19:13.997285+0000","last_active":"2023-05-10T04:19:15.202625+0000","last_peered":"2023-05-10T04:19:15.202625+0000","last_clean":"2023-05-10T04:19:15.202625+0000","last_became_active":"2023-05-10T04:19:13.996851+0000","last_became_peered":"2023-05-10T04:19:13.996851+0000","last_unstale":"2023-05-10T04:19:15.202625+0000","last_undegraded":"2023-05-10T04:19:15.202625+0000","last_fullsized":"2023-05-10T04:19:15.202625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:05.585266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202534+0000","last_change":"2023-05-10T04:19:09.485989+0000","last_active":"2023-05-10T04:19:15.202534+0000","last_peered":"2023-05-10T04:19:15.202534+0000","last_clean":"2023-05-10T04:19:15.202534+0000","last_became_active":"2023-05-10T04:19:09.485739+0000","last_became_peered":"2023-05-10T04:19:09.485739+0000","last_unstale":"2023-05-10T04:19:15.202534+0000","last_undegraded":"2023-05-10T04:19:15.202534+0000","last_fullsized":"2023-05-10T04:19:15.202534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:34.153625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203031+0000","last_change":"2023-05-10T04:19:09.966736+0000","last_active":"2023-05-10T04:19:15.203031+0000","last_peered":"2023-05-10T04:19:15.203031+0000","last_clean":"2023-05-10T04:19:15.203031+0000","last_became_active":"2023-05-10T04:19:09.966474+0000","last_became_peered":"2023-05-10T04:19:09.966474+0000","last_unstale":"2023-05-10T04:19:15.203031+0000","last_undegraded":"2023-05-10T04:19:15.203031+0000","last_fullsized":"2023-05-10T04:19:15.203031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:19.596953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203129+0000","last_change":"2023-05-10T04:19:13.993407+0000","last_active":"2023-05-10T04:19:15.203129+0000","last_peered":"2023-05-10T04:19:15.203129+0000","last_clean":"2023-05-10T04:19:15.203129+0000","last_became_active":"2023-05-10T04:19:13.992979+0000","last_became_peered":"2023-05-10T04:19:13.992979+0000","last_unstale":"2023-05-10T04:19:15.203129+0000","last_undegraded":"2023-05-10T04:19:15.203129+0000","last_fullsized":"2023-05-10T04:19:15.203129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:23.097714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578128+0000","last_change":"2023-05-10T04:19:09.482747+0000","last_active":"2023-05-10T04:19:14.578128+0000","last_peered":"2023-05-10T04:19:14.578128+0000","last_clean":"2023-05-10T04:19:14.578128+0000","last_became_active":"2023-05-10T04:19:09.482405+0000","last_became_peered":"2023-05-10T04:19:09.482405+0000","last_unstale":"2023-05-10T04:19:14.578128+0000","last_undegraded":"2023-05-10T04:19:14.578128+0000","last_fullsized":"2023-05-10T04:19:14.578128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:14:10.406433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628203+0000","last_change":"2023-05-10T04:19:09.976125+0000","last_active":"2023-05-10T04:19:14.628203+0000","last_peered":"2023-05-10T04:19:14.628203+0000","last_clean":"2023-05-10T04:19:14.628203+0000","last_became_active":"2023-05-10T04:19:09.975822+0000","last_became_peered":"2023-05-10T04:19:09.975822+0000","last_unstale":"2023-05-10T04:19:14.628203+0000","last_undegraded":"2023-05-10T04:19:14.628203+0000","last_fullsized":"2023-05-10T04:19:14.628203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:16.831438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469659+0000","last_change":"2023-05-10T04:19:13.995689+0000","last_active":"2023-05-10T04:19:14.469659+0000","last_peered":"2023-05-10T04:19:14.469659+0000","last_clean":"2023-05-10T04:19:14.469659+0000","last_became_active":"2023-05-10T04:19:13.995260+0000","last_became_peered":"2023-05-10T04:19:13.995260+0000","last_unstale":"2023-05-10T04:19:14.469659+0000","last_undegraded":"2023-05-10T04:19:14.469659+0000","last_fullsized":"2023-05-10T04:19:14.469659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:23:01.528439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578389+0000","last_change":"2023-05-10T04:19:09.483097+0000","last_active":"2023-05-10T04:19:14.578389+0000","last_peered":"2023-05-10T04:19:14.578389+0000","last_clean":"2023-05-10T04:19:14.578389+0000","last_became_active":"2023-05-10T04:19:09.482753+0000","last_became_peered":"2023-05-10T04:19:09.482753+0000","last_unstale":"2023-05-10T04:19:14.578389+0000","last_undegraded":"2023-05-10T04:19:14.578389+0000","last_fullsized":"2023-05-10T04:19:14.578389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:47:36.189819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201669+0000","last_change":"2023-05-10T04:19:09.965711+0000","last_active":"2023-05-10T04:19:15.201669+0000","last_peered":"2023-05-10T04:19:15.201669+0000","last_clean":"2023-05-10T04:19:15.201669+0000","last_became_active":"2023-05-10T04:19:09.965427+0000","last_became_peered":"2023-05-10T04:19:09.965427+0000","last_unstale":"2023-05-10T04:19:15.201669+0000","last_undegraded":"2023-05-10T04:19:15.201669+0000","last_fullsized":"2023-05-10T04:19:15.201669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:25.276398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203303+0000","last_change":"2023-05-10T04:19:09.977970+0000","last_active":"2023-05-10T04:19:15.203303+0000","last_peered":"2023-05-10T04:19:15.203303+0000","last_clean":"2023-05-10T04:19:15.203303+0000","last_became_active":"2023-05-10T04:19:09.977559+0000","last_became_peered":"2023-05-10T04:19:09.977559+0000","last_unstale":"2023-05-10T04:19:15.203303+0000","last_undegraded":"2023-05-10T04:19:15.203303+0000","last_fullsized":"2023-05-10T04:19:15.203303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:54:23.670496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468413+0000","last_change":"2023-05-10T04:19:09.985063+0000","last_active":"2023-05-10T04:19:14.468413+0000","last_peered":"2023-05-10T04:19:14.468413+0000","last_clean":"2023-05-10T04:19:14.468413+0000","last_became_active":"2023-05-10T04:19:09.984788+0000","last_became_peered":"2023-05-10T04:19:09.984788+0000","last_unstale":"2023-05-10T04:19:14.468413+0000","last_undegraded":"2023-05-10T04:19:14.468413+0000","last_fullsized":"2023-05-10T04:19:14.468413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:13.062393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468430+0000","last_change":"2023-05-10T04:19:09.969178+0000","last_active":"2023-05-10T04:19:14.468430+0000","last_peered":"2023-05-10T04:19:14.468430+0000","last_clean":"2023-05-10T04:19:14.468430+0000","last_became_active":"2023-05-10T04:19:09.968882+0000","last_became_peered":"2023-05-10T04:19:09.968882+0000","last_unstale":"2023-05-10T04:19:14.468430+0000","last_undegraded":"2023-05-10T04:19:14.468430+0000","last_fullsized":"2023-05-10T04:19:14.468430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:55.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577956+0000","last_change":"2023-05-10T04:19:09.978972+0000","last_active":"2023-05-10T04:19:14.577956+0000","last_peered":"2023-05-10T04:19:14.577956+0000","last_clean":"2023-05-10T04:19:14.577956+0000","last_became_active":"2023-05-10T04:19:09.978677+0000","last_became_peered":"2023-05-10T04:19:09.978677+0000","last_unstale":"2023-05-10T04:19:14.577956+0000","last_undegraded":"2023-05-10T04:19:14.577956+0000","last_fullsized":"2023-05-10T04:19:14.577956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:04.032181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578091+0000","last_change":"2023-05-10T04:19:09.982469+0000","last_active":"2023-05-10T04:19:14.578091+0000","last_peered":"2023-05-10T04:19:14.578091+0000","last_clean":"2023-05-10T04:19:14.578091+0000","last_became_active":"2023-05-10T04:19:09.982174+0000","last_became_peered":"2023-05-10T04:19:09.982174+0000","last_unstale":"2023-05-10T04:19:14.578091+0000","last_undegraded":"2023-05-10T04:19:14.578091+0000","last_fullsized":"2023-05-10T04:19:14.578091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:55:21.820447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":16,"seq":68719476745,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]}]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":909312,"data_stored":715160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":124264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":127912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8260,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363580,"statfs":{"total":96636764160,"available":96628305920,"internally_reserved":0,"allocated":323584,"data_stored":128016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":124208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T04:19:33.286 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T04:19:33.286 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-10T04:19:33.287 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-10T04:19:33.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-10T04:19:33.288 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-10T04:19:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.502+0000 7efe2c7ff700 1 Processor -- start 2023-05-10T04:19:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.502+0000 7efe2c7ff700 1 -- start start 2023-05-10T04:19:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.503+0000 7efe2c7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 0x7efe241608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.503+0000 7efe2c7ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe240d1100 0x7efe240d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.503+0000 7efe2c7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe240d0020 con 0x7efe240b87a0 2023-05-10T04:19:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.503+0000 7efe2c7ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240d02d0 con 0x7efe240d1100 2023-05-10T04:19:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.503+0000 7efe2c7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe240d0cb0 con 0x7efe240cfbf0 2023-05-10T04:19:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe2ad9c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe240d1100 0x7efe240d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe2ad9c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe240d1100 0x7efe240d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47990/0 (socket says 172.21.15.132:47990) 2023-05-10T04:19:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe2ad9c700 1 -- 172.21.15.132:0/1885470379 learned_addr learned my addr 172.21.15.132:0/1885470379 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe29d9a700 1 --2- 172.21.15.132:0/1885470379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 0x7efe241608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe2ad9c700 1 -- 172.21.15.132:0/1885470379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 msgr2=0x7efe241608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:33.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe2ad9c700 1 --2- 172.21.15.132:0/1885470379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 0x7efe241608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe2ad9c700 1 -- 172.21.15.132:0/1885470379 >> v1:172.21.15.154:6789/0 conn(0x7efe240b87a0 legacy=0x7efe241601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe2ad9c700 1 -- 172.21.15.132:0/1885470379 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240cdc60 con 0x7efe240d1100 2023-05-10T04:19:33.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.504+0000 7efe2ad9c700 1 --2- 172.21.15.132:0/1885470379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe240d1580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009e50 tx=0x7efe1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7210901df28abfeb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe29599700 1 -- 172.21.15.132:0/1885470379 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00e070 con 0x7efe240d1100 2023-05-10T04:19:33.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe29599700 1 -- 172.21.15.132:0/1885470379 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c00b910 con 0x7efe240d1100 2023-05-10T04:19:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe29599700 1 -- 172.21.15.132:0/1885470379 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00bcc0 con 0x7efe240d1100 2023-05-10T04:19:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1885470379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 msgr2=0x7efe240d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1885470379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe240d1580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009e50 tx=0x7efe1c00b330 comp rx=0 tx=0).stop 2023-05-10T04:19:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1885470379 shutdown_connections 2023-05-10T04:19:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1885470379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe240d1580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1885470379 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 0x7efe241608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1885470379 >> 172.21.15.132:0/1885470379 conn(0x7efe24071b10 msgr2=0x7efe24071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1885470379 shutdown_connections 2023-05-10T04:19:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.505+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1885470379 wait complete. 2023-05-10T04:19:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.507+0000 7efe2c7ff700 1 Processor -- start 2023-05-10T04:19:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.507+0000 7efe2c7ff700 1 -- start start 2023-05-10T04:19:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2c7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe240b87a0 0x7efe240c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2c7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 0x7efe240c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2c7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe24144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2c7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24144ea0 con 0x7efe240d1100 2023-05-10T04:19:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2c7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe240c7080 con 0x7efe240b87a0 2023-05-10T04:19:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2c7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe240c7360 con 0x7efe240cfbf0 2023-05-10T04:19:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2ad9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe24144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2ad9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe24144960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:47994/0 (socket says 172.21.15.132:47994) 2023-05-10T04:19:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2ad9c700 1 -- 172.21.15.132:0/1459976383 learned_addr learned my addr 172.21.15.132:0/1459976383 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe29d9a700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 0x7efe240c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.508+0000 7efe2a59b700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe240b87a0 0x7efe240c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe2ad9c700 1 -- 172.21.15.132:0/1459976383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 msgr2=0x7efe240c8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe2ad9c700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 0x7efe240c8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe2ad9c700 1 -- 172.21.15.132:0/1459976383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe240b87a0 msgr2=0x7efe240c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe2ad9c700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe240b87a0 0x7efe240c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe2ad9c700 1 -- 172.21.15.132:0/1459976383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c009b30 con 0x7efe240d1100 2023-05-10T04:19:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe2ad9c700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe24144960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efe24072760 tx=0x7efe1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe1affd700 1 -- 172.21.15.132:0/1459976383 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c004960 con 0x7efe240d1100 2023-05-10T04:19:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe1affd700 1 -- 172.21.15.132:0/1459976383 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c0099b0 con 0x7efe240d1100 2023-05-10T04:19:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe240cd980 con 0x7efe240d1100 2023-05-10T04:19:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe1affd700 1 -- 172.21.15.132:0/1459976383 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c01c680 con 0x7efe240d1100 2023-05-10T04:19:33.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.509+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe240cd6a0 con 0x7efe240d1100 2023-05-10T04:19:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.510+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe24160e30 con 0x7efe240d1100 2023-05-10T04:19:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.511+0000 7efe1affd700 1 -- 172.21.15.132:0/1459976383 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efe1c01c7e0 con 0x7efe240d1100 2023-05-10T04:19:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.512+0000 7efe1affd700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efe0806ace0 0x7efe0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.512+0000 7efe1affd700 1 -- 172.21.15.132:0/1459976383 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efe1c08b540 con 0x7efe240d1100 2023-05-10T04:19:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.512+0000 7efe2a59b700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efe0806ace0 0x7efe0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.513+0000 7efe2a59b700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efe0806ace0 0x7efe0806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe20000f60 tx=0x7efe20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.516+0000 7efe1affd700 1 -- 172.21.15.132:0/1459976383 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efe1c0562f0 con 0x7efe240d1100 2023-05-10T04:19:33.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.768+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7efe24074430 con 0x7efe240d1100 2023-05-10T04:19:33.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.772+0000 7efe1affd700 1 -- 172.21.15.132:0/1459976383 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170849 (secure 0 0 0) 0x7efe1c059910 con 0x7efe240d1100 2023-05-10T04:19:33.776 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:33.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efe0806ace0 msgr2=0x7efe0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efe0806ace0 0x7efe0806d190 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe20000f60 tx=0x7efe20009040 comp rx=0 tx=0).stop 2023-05-10T04:19:33.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 msgr2=0x7efe24144960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe24144960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7efe24072760 tx=0x7efe1c004ad0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 shutdown_connections 2023-05-10T04:19:33.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efe0806ace0 0x7efe0806d190 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe240d1100 0x7efe24144960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efe240b87a0 0x7efe240c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 --2- 172.21.15.132:0/1459976383 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efe240cfbf0 0x7efe240c8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 >> 172.21.15.132:0/1459976383 conn(0x7efe24071b10 msgr2=0x7efe240b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:33.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 shutdown_connections 2023-05-10T04:19:33.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.775+0000 7efe2c7ff700 1 -- 172.21.15.132:0/1459976383 wait complete. 2023-05-10T04:19:33.795 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":5,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1621031024},{"type":"v1","addr":"172.21.15.132:6833","nonce":1621031024}]},"active_addr":"172.21.15.132:6833/1621031024","active_change":"2023-05-10T04:18:49.303087+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4105,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3293916482}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":2943670819}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":2013120483}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":2389449674}]}]} 2023-05-10T04:19:33.799 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-10T04:19:33.799 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-10T04:19:33.800 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:33.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.980+0000 7ffad0fff700 1 Processor -- start 2023-05-10T04:19:33.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.980+0000 7ffad0fff700 1 -- start start 2023-05-10T04:19:33.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffad0fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffacc15c590 0x7ffacc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffad0fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffacc0cff50 0x7ffacc0d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffad0fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffacc0cd520 con 0x7ffacc0cf010 2023-05-10T04:19:33.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffad0fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc0d2640 con 0x7ffacc0cff50 2023-05-10T04:19:33.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffad0fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffacc1610d0 con 0x7ffacc15c590 2023-05-10T04:19:33.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffaca59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffacc15c590 0x7ffacc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffacad9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffacc0cff50 0x7ffacc0d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffaca59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ffacc15c590 0x7ffacc160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:44900/0 (socket says 172.21.15.132:44900) 2023-05-10T04:19:33.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffaca59c700 1 -- 172.21.15.132:0/1436644572 learned_addr learned my addr 172.21.15.132:0/1436644572 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:33.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffaca59c700 1 -- 172.21.15.132:0/1436644572 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0cff50 msgr2=0x7ffacc0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:33.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffaca59c700 1 --2- 172.21.15.132:0/1436644572 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0cff50 0x7ffacc0d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.982+0000 7ffaca59c700 1 -- 172.21.15.132:0/1436644572 >> v1:172.21.15.154:6789/0 conn(0x7ffacc0cf010 legacy=0x7ffacc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.983+0000 7ffaca59c700 1 -- 172.21.15.132:0/1436644572 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0b23c0 con 0x7ffacc15c590 2023-05-10T04:19:33.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.983+0000 7ffacad9d700 1 --2- 172.21.15.132:0/1436644572 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0cff50 0x7ffacc0d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:33.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.983+0000 7ffaca59c700 1 --2- 172.21.15.132:0/1436644572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc15c590 0x7ffacc160b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0d0a50 tx=0x7ffabc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac14af6053bbd119 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.983+0000 7ffac959a700 1 -- 172.21.15.132:0/1436644572 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc011830 con 0x7ffacc15c590 2023-05-10T04:19:33.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.983+0000 7ffac959a700 1 -- 172.21.15.132:0/1436644572 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc011990 con 0x7ffacc15c590 2023-05-10T04:19:33.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.983+0000 7ffac959a700 1 -- 172.21.15.132:0/1436644572 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc011d20 con 0x7ffacc15c590 2023-05-10T04:19:33.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.984+0000 7ffad0fff700 1 -- 172.21.15.132:0/1436644572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc15c590 msgr2=0x7ffacc160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.984+0000 7ffad0fff700 1 --2- 172.21.15.132:0/1436644572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc15c590 0x7ffacc160b90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0d0a50 tx=0x7ffabc009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.984+0000 7ffad0fff700 1 -- 172.21.15.132:0/1436644572 shutdown_connections 2023-05-10T04:19:33.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.984+0000 7ffad0fff700 1 --2- 172.21.15.132:0/1436644572 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc15c590 0x7ffacc160b90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.984+0000 7ffad0fff700 1 --2- 172.21.15.132:0/1436644572 >> v2:172.21.15.132:3300/0 conn(0x7ffacc0cff50 0x7ffacc0d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.984+0000 7ffad0fff700 1 -- 172.21.15.132:0/1436644572 >> 172.21.15.132:0/1436644572 conn(0x7ffacc071b10 msgr2=0x7ffacc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:33.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.984+0000 7ffad0fff700 1 -- 172.21.15.132:0/1436644572 shutdown_connections 2023-05-10T04:19:33.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.984+0000 7ffad0fff700 1 -- 172.21.15.132:0/1436644572 wait complete. 2023-05-10T04:19:33.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.986+0000 7ffad0fff700 1 Processor -- start 2023-05-10T04:19:33.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.986+0000 7ffad0fff700 1 -- start start 2023-05-10T04:19:33.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffad0fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0cf010 0x7ffacc0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffad0fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0cff50 0x7ffacc0b8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffad0fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffacc15c590 0x7ffacc0cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffad0fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0b8e70 con 0x7ffacc0cf010 2023-05-10T04:19:33.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffad0fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1e7ae0 con 0x7ffacc0cff50 2023-05-10T04:19:33.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffad0fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc0c6b30 con 0x7ffacc15c590 2023-05-10T04:19:33.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffaca59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0cf010 0x7ffacc0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffaca59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0cf010 0x7ffacc0b7100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48008/0 (socket says 172.21.15.132:48008) 2023-05-10T04:19:33.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffaca59c700 1 -- 172.21.15.132:0/321590816 learned_addr learned my addr 172.21.15.132:0/321590816 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:33.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffac9d9b700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0cff50 0x7ffacc0b8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffacad9d700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffacc15c590 0x7ffacc0cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffaca59c700 1 -- 172.21.15.132:0/321590816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffacc15c590 msgr2=0x7ffacc0cbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffaca59c700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffacc15c590 0x7ffacc0cbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffaca59c700 1 -- 172.21.15.132:0/321590816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0cff50 msgr2=0x7ffacc0b8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:33.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffaca59c700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0cff50 0x7ffacc0b8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:33.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.987+0000 7ffaca59c700 1 -- 172.21.15.132:0/321590816 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4009a70 con 0x7ffacc0cf010 2023-05-10T04:19:33.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.988+0000 7ffaca59c700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0cf010 0x7ffacc0b7100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffabc000c00 tx=0x7ffabc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.988+0000 7ffabaffd700 1 -- 172.21.15.132:0/321590816 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0042c0 con 0x7ffacc0cf010 2023-05-10T04:19:33.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.988+0000 7ffabaffd700 1 -- 172.21.15.132:0/321590816 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc01f070 con 0x7ffacc0cf010 2023-05-10T04:19:33.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.988+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc009550 con 0x7ffacc0cf010 2023-05-10T04:19:33.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.988+0000 7ffabaffd700 1 -- 172.21.15.132:0/321590816 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0036a0 con 0x7ffacc0cf010 2023-05-10T04:19:33.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.988+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc0cd770 con 0x7ffacc0cf010 2023-05-10T04:19:33.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.989+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffacc0cf560 con 0x7ffacc0cf010 2023-05-10T04:19:33.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.990+0000 7ffabaffd700 1 -- 172.21.15.132:0/321590816 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffabc021030 con 0x7ffacc0cf010 2023-05-10T04:19:33.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.991+0000 7ffabaffd700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffaac06ace0 0x7ffaac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:33.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.991+0000 7ffabaffd700 1 -- 172.21.15.132:0/321590816 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffabc08aa50 con 0x7ffacc0cf010 2023-05-10T04:19:33.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.991+0000 7ffac9d9b700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffaac06ace0 0x7ffaac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:33.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.992+0000 7ffac9d9b700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffaac06ace0 0x7ffaac06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b6370 tx=0x7ffac0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:33.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:33.995+0000 7ffabaffd700 1 -- 172.21.15.132:0/321590816 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ffabc055920 con 0x7ffacc0cf010 2023-05-10T04:19:34.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.192+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffacc15c960 con 0x7ffacc0cf010 2023-05-10T04:19:34.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.193+0000 7ffabaffd700 1 -- 172.21.15.132:0/321590816 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7ffabc058f40 con 0x7ffacc0cf010 2023-05-10T04:19:34.196 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:34.196 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:34.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffaac06ace0 msgr2=0x7ffaac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffaac06ace0 0x7ffaac06d190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b6370 tx=0x7ffac0009040 comp rx=0 tx=0).stop 2023-05-10T04:19:34.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0cf010 msgr2=0x7ffacc0b7100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0cf010 0x7ffacc0b7100 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffabc000c00 tx=0x7ffabc004750 comp rx=0 tx=0).stop 2023-05-10T04:19:34.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 shutdown_connections 2023-05-10T04:19:34.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffaac06ace0 0x7ffaac06d190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffacc15c590 0x7ffacc0cbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffacc0cf010 0x7ffacc0b7100 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 --2- 172.21.15.132:0/321590816 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffacc0cff50 0x7ffacc0b8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.195+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 >> 172.21.15.132:0/321590816 conn(0x7ffacc071b10 msgr2=0x7ffacc0b4650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:34.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.196+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 shutdown_connections 2023-05-10T04:19:34.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.196+0000 7ffad0fff700 1 -- 172.21.15.132:0/321590816 wait complete. 2023-05-10T04:19:34.216 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-10T04:19:34.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:34.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.397+0000 7f0da9fff700 1 Processor -- start 2023-05-10T04:19:34.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.397+0000 7f0da9fff700 1 -- start start 2023-05-10T04:19:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da9fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0da415a5a0 0x7f0da406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da9fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0da406a920 0x7f0da4070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da9fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da40cb280 con 0x7f0da4071030 2023-05-10T04:19:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da9fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da406adc0 con 0x7f0da406a920 2023-05-10T04:19:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da9fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da415a970 con 0x7f0da415a5a0 2023-05-10T04:19:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da2ffd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0da406a920 0x7f0da4070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da2ffd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0da406a920 0x7f0da4070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48020/0 (socket says 172.21.15.132:48020) 2023-05-10T04:19:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da2ffd700 1 -- 172.21.15.132:0/139730814 learned_addr learned my addr 172.21.15.132:0/139730814 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.398+0000 7f0da3fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0da4071030 0x7f0da415dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50750/0 (socket says 172.21.15.132:50750) 2023-05-10T04:19:34.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da37fe700 1 --2- 172.21.15.132:0/139730814 >> v2:172.21.15.154:3300/0 conn(0x7f0da415a5a0 0x7f0da406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da2ffd700 1 -- 172.21.15.132:0/139730814 >> v2:172.21.15.154:3300/0 conn(0x7f0da415a5a0 msgr2=0x7f0da406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da2ffd700 1 --2- 172.21.15.132:0/139730814 >> v2:172.21.15.154:3300/0 conn(0x7f0da415a5a0 0x7f0da406a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da2ffd700 1 -- 172.21.15.132:0/139730814 >> v1:172.21.15.132:6789/0 conn(0x7f0da4071030 legacy=0x7f0da415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da2ffd700 1 -- 172.21.15.132:0/139730814 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da4071470 con 0x7f0da406a920 2023-05-10T04:19:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da37fe700 1 --2- 172.21.15.132:0/139730814 >> v2:172.21.15.154:3300/0 conn(0x7f0da415a5a0 0x7f0da406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da2ffd700 1 --2- 172.21.15.132:0/139730814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da406a920 0x7f0da4070af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0da4067990 tx=0x7f0d98009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9470d98fa7f5b5c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da27fc700 1 -- 172.21.15.132:0/139730814 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d98005e30 con 0x7f0da406a920 2023-05-10T04:19:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da27fc700 1 -- 172.21.15.132:0/139730814 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d98004030 con 0x7f0da406a920 2023-05-10T04:19:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.399+0000 7f0da27fc700 1 -- 172.21.15.132:0/139730814 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d980043e0 con 0x7f0da406a920 2023-05-10T04:19:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.400+0000 7f0da9fff700 1 -- 172.21.15.132:0/139730814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da406a920 msgr2=0x7f0da4070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.400+0000 7f0da9fff700 1 --2- 172.21.15.132:0/139730814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da406a920 0x7f0da4070af0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0da4067990 tx=0x7f0d98009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.400+0000 7f0da9fff700 1 -- 172.21.15.132:0/139730814 shutdown_connections 2023-05-10T04:19:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.400+0000 7f0da9fff700 1 --2- 172.21.15.132:0/139730814 >> v2:172.21.15.154:3300/0 conn(0x7f0da415a5a0 0x7f0da406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.400+0000 7f0da9fff700 1 --2- 172.21.15.132:0/139730814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da406a920 0x7f0da4070af0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.400+0000 7f0da9fff700 1 -- 172.21.15.132:0/139730814 >> 172.21.15.132:0/139730814 conn(0x7f0da40cf720 msgr2=0x7f0da40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.400+0000 7f0da9fff700 1 -- 172.21.15.132:0/139730814 shutdown_connections 2023-05-10T04:19:34.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.400+0000 7f0da9fff700 1 -- 172.21.15.132:0/139730814 wait complete. 2023-05-10T04:19:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.402+0000 7f0da9fff700 1 Processor -- start 2023-05-10T04:19:34.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.402+0000 7f0da9fff700 1 -- start start 2023-05-10T04:19:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da9fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da406a920 0x7f0da40ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da9fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0da4071030 0x7f0da415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da9fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da415a5a0 0x7f0da4155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da9fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40ad280 con 0x7f0da415a5a0 2023-05-10T04:19:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da9fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40ac1e0 con 0x7f0da406a920 2023-05-10T04:19:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da9fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40ac4c0 con 0x7f0da4071030 2023-05-10T04:19:34.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da3fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da415a5a0 0x7f0da4155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da3fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da415a5a0 0x7f0da4155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48022/0 (socket says 172.21.15.132:48022) 2023-05-10T04:19:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da3fff700 1 -- 172.21.15.132:0/2249535479 learned_addr learned my addr 172.21.15.132:0/2249535479 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da2ffd700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0da4071030 0x7f0da415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da37fe700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da406a920 0x7f0da40ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da3fff700 1 -- 172.21.15.132:0/2249535479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0da4071030 msgr2=0x7f0da415bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da3fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0da4071030 0x7f0da415bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da3fff700 1 -- 172.21.15.132:0/2249535479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da406a920 msgr2=0x7f0da40ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da3fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da406a920 0x7f0da40ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.403+0000 7f0da3fff700 1 -- 172.21.15.132:0/2249535479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d98009500 con 0x7f0da415a5a0 2023-05-10T04:19:34.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.404+0000 7f0da3fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da415a5a0 0x7f0da4155a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00cbd0 tx=0x7f0d9c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:34.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.404+0000 7f0d8bfff700 1 -- 172.21.15.132:0/2249535479 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c00abb0 con 0x7f0da415a5a0 2023-05-10T04:19:34.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.404+0000 7f0d8bfff700 1 -- 172.21.15.132:0/2249535479 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9c00ad10 con 0x7f0da415a5a0 2023-05-10T04:19:34.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.404+0000 7f0d8bfff700 1 -- 172.21.15.132:0/2249535479 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9c007270 con 0x7f0da415a5a0 2023-05-10T04:19:34.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.404+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0da40719e0 con 0x7f0da415a5a0 2023-05-10T04:19:34.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.404+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da4071700 con 0x7f0da415a5a0 2023-05-10T04:19:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.405+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da406c6c0 con 0x7f0da415a5a0 2023-05-10T04:19:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.406+0000 7f0d8bfff700 1 -- 172.21.15.132:0/2249535479 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d9c0073d0 con 0x7f0da415a5a0 2023-05-10T04:19:34.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.407+0000 7f0d8bfff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d9006ad10 0x7f0d9006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.407+0000 7f0d8bfff700 1 -- 172.21.15.132:0/2249535479 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d9c089370 con 0x7f0da415a5a0 2023-05-10T04:19:34.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.408+0000 7f0da37fe700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d9006ad10 0x7f0d9006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.408+0000 7f0da37fe700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d9006ad10 0x7f0d9006d1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d94006fd0 tx=0x7f0d94008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:34.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.412+0000 7f0d8bfff700 1 -- 172.21.15.132:0/2249535479 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0d9c0541c0 con 0x7f0da415a5a0 2023-05-10T04:19:34.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.613+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0da40cb280 con 0x7f0da415a5a0 2023-05-10T04:19:34.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.614+0000 7f0d8bfff700 1 -- 172.21.15.132:0/2249535479 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f0da40cb280 con 0x7f0da415a5a0 2023-05-10T04:19:34.617 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:34.618 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:34.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d9006ad10 msgr2=0x7f0d9006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d9006ad10 0x7f0d9006d1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0d94006fd0 tx=0x7f0d94008040 comp rx=0 tx=0).stop 2023-05-10T04:19:34.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da415a5a0 msgr2=0x7f0da4155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da415a5a0 0x7f0da4155a70 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0d9c00cbd0 tx=0x7f0d9c00cf90 comp rx=0 tx=0).stop 2023-05-10T04:19:34.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 shutdown_connections 2023-05-10T04:19:34.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d9006ad10 0x7f0d9006d1c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0da415a5a0 0x7f0da4155a70 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0da406a920 0x7f0da40ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 --2- 172.21.15.132:0/2249535479 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0da4071030 0x7f0da415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 >> 172.21.15.132:0/2249535479 conn(0x7f0da40cf720 msgr2=0x7f0da40b2290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:34.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 shutdown_connections 2023-05-10T04:19:34.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.617+0000 7f0da9fff700 1 -- 172.21.15.132:0/2249535479 wait complete. 2023-05-10T04:19:34.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-10T04:19:34.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-10T04:19:34.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-10T04:19:34.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-10T04:19:34.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-10T04:19:34.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-10T04:19:34.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-10T04:19:34.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-10T04:19:34.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.963+0000 7f0fbb9ff700 1 Processor -- start 2023-05-10T04:19:34.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.964+0000 7f0fbb9ff700 1 -- start start 2023-05-10T04:19:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.966+0000 7f0fbb9ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0fb40cacf0 0x7f0fb40add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.966+0000 7f0fbb9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb406a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.966+0000 7f0fbb9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb4158d10 con 0x7f0fb415cdb0 2023-05-10T04:19:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.966+0000 7f0fbb9ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb40c97d0 con 0x7f0fb40cacf0 2023-05-10T04:19:34.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.966+0000 7f0fbb9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40cd5b0 con 0x7f0fb406a3e0 2023-05-10T04:19:34.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.966+0000 7f467b1ff700 1 Processor -- start 2023-05-10T04:19:34.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.967+0000 7f0fb9f9c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.967+0000 7f0fb8f9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f0fb415cdb0 0x7f0fb40c90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:44192/0 (socket says 172.21.15.132:44192) 2023-05-10T04:19:34.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.967+0000 7f0fb8f9a700 1 -- 172.21.15.132:0/228043155 learned_addr learned my addr 172.21.15.132:0/228043155 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:34.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.967+0000 7f467b1ff700 1 -- start start 2023-05-10T04:19:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.967+0000 7f0fb979b700 1 --2- 172.21.15.132:0/228043155 >> v2:172.21.15.132:3300/0 conn(0x7f0fb40cacf0 0x7f0fb40add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.968+0000 7f0fb9f9c700 1 -- 172.21.15.132:0/228043155 >> v2:172.21.15.132:3300/0 conn(0x7f0fb40cacf0 msgr2=0x7f0fb40add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.968+0000 7f0fb9f9c700 1 --2- 172.21.15.132:0/228043155 >> v2:172.21.15.132:3300/0 conn(0x7f0fb40cacf0 0x7f0fb40add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.968+0000 7f0fb9f9c700 1 -- 172.21.15.132:0/228043155 >> v1:172.21.15.154:6789/0 conn(0x7f0fb415cdb0 legacy=0x7f0fb40c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.968+0000 7f0fb9f9c700 1 -- 172.21.15.132:0/228043155 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb406ad80 con 0x7f0fb406a3e0 2023-05-10T04:19:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.969+0000 7f0fb9f9c700 1 --2- 172.21.15.132:0/228043155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb406a840 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00c2e0 tx=0x7f0fac00c5f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f384f208ec4c5d87 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.969+0000 7f467b1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4674160d20 0x7f467406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.969+0000 7f467b1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46740c20d0 0x7f46740adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.969+0000 7f467b1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46740cd1f0 con 0x7f46740ad690 2023-05-10T04:19:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.969+0000 7f467b1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46741610f0 con 0x7f46740c20d0 2023-05-10T04:19:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.969+0000 7f467b1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46740cc670 con 0x7f4674160d20 2023-05-10T04:19:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f467979c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46740c20d0 0x7f46740adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f467979c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f46740c20d0 0x7f46740adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:44924/0 (socket says 172.21.15.132:44924) 2023-05-10T04:19:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f467979c700 1 -- 172.21.15.132:0/385900138 learned_addr learned my addr 172.21.15.132:0/385900138 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:34.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f4678f9b700 1 --2- 172.21.15.132:0/385900138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4674160d20 0x7f467406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f0fabfff700 1 -- 172.21.15.132:0/228043155 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00f070 con 0x7f0fb406a3e0 2023-05-10T04:19:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f0fabfff700 1 -- 172.21.15.132:0/228043155 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fac00a0d0 con 0x7f0fb406a3e0 2023-05-10T04:19:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f0fabfff700 1 -- 172.21.15.132:0/228043155 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fac00a460 con 0x7f0fb406a3e0 2023-05-10T04:19:34.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f467979c700 1 -- 172.21.15.132:0/385900138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4674160d20 msgr2=0x7f467406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f467979c700 1 --2- 172.21.15.132:0/385900138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4674160d20 0x7f467406cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f467979c700 1 -- 172.21.15.132:0/385900138 >> v1:172.21.15.132:6789/0 conn(0x7f46740ad690 legacy=0x7f46740c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.970+0000 7f467979c700 1 -- 172.21.15.132:0/385900138 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46740cc950 con 0x7f46740c20d0 2023-05-10T04:19:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f467979c700 1 --2- 172.21.15.132:0/385900138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740c20d0 0x7f46740adb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f466c009e50 tx=0x7f466c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b647abdb5e70fc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:34.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/228043155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 msgr2=0x7f0fb406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f0fbb9ff700 1 --2- 172.21.15.132:0/228043155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb406a840 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00c2e0 tx=0x7f0fac00c5f0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f46737fe700 1 -- 172.21.15.132:0/385900138 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c00e070 con 0x7f46740c20d0 2023-05-10T04:19:34.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f46737fe700 1 -- 172.21.15.132:0/385900138 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c003a20 con 0x7f46740c20d0 2023-05-10T04:19:34.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f46737fe700 1 -- 172.21.15.132:0/385900138 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c003dd0 con 0x7f46740c20d0 2023-05-10T04:19:34.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/228043155 shutdown_connections 2023-05-10T04:19:34.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f0fbb9ff700 1 --2- 172.21.15.132:0/228043155 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb406a840 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.971+0000 7f0fbb9ff700 1 --2- 172.21.15.132:0/228043155 >> v2:172.21.15.132:3300/0 conn(0x7f0fb40cacf0 0x7f0fb40add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.972+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/228043155 >> 172.21.15.132:0/228043155 conn(0x7f0fb40cf6e0 msgr2=0x7f0fb40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:34.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.972+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/228043155 shutdown_connections 2023-05-10T04:19:34.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.972+0000 7f4db7dff700 1 Processor -- start 2023-05-10T04:19:34.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.972+0000 7f467b1ff700 1 -- 172.21.15.132:0/385900138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740c20d0 msgr2=0x7f46740adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.972+0000 7f467b1ff700 1 --2- 172.21.15.132:0/385900138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740c20d0 0x7f46740adb30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f466c009e50 tx=0x7f466c00b330 comp rx=0 tx=0).stop 2023-05-10T04:19:34.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.972+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/228043155 wait complete. 2023-05-10T04:19:34.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.973+0000 7f467b1ff700 1 -- 172.21.15.132:0/385900138 shutdown_connections 2023-05-10T04:19:34.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.973+0000 7f467b1ff700 1 --2- 172.21.15.132:0/385900138 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f46740c20d0 0x7f46740adb30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.973+0000 7f467b1ff700 1 --2- 172.21.15.132:0/385900138 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4674160d20 0x7f467406cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.973+0000 7f467b1ff700 1 -- 172.21.15.132:0/385900138 >> 172.21.15.132:0/385900138 conn(0x7f46740cf720 msgr2=0x7f46740cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:34.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.972+0000 7f4db7dff700 1 -- start start 2023-05-10T04:19:34.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.975+0000 7f0fbb9ff700 1 Processor -- start 2023-05-10T04:19:34.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.974+0000 7f4db7dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4db0158aa0 0x7f4db00add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.975+0000 7f4db7dff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db00ccff0 con 0x7f4db015cdb0 2023-05-10T04:19:34.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.975+0000 7f4db7dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db00cd2d0 con 0x7f4db00cbc20 2023-05-10T04:19:34.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.975+0000 7f4db7dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00c97d0 con 0x7f4db0158aa0 2023-05-10T04:19:34.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.975+0000 7f4db539a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f4db00cbc20 0x7f4db00cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:44196/0 (socket says 172.21.15.132:44196) 2023-05-10T04:19:34.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.975+0000 7f4db539a700 1 -- 172.21.15.132:0/1775626690 learned_addr learned my addr 172.21.15.132:0/1775626690 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:34.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.975+0000 7f0fbb9ff700 1 -- start start 2023-05-10T04:19:34.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.974+0000 7f467b1ff700 1 -- 172.21.15.132:0/385900138 shutdown_connections 2023-05-10T04:19:34.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 664669870 0 0) 0x7f4db00ccff0 con 0x7f4db015cdb0 2023-05-10T04:19:34.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d9c0035b0 con 0x7f4db015cdb0 2023-05-10T04:19:34.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2888579035 0 0) 0x7f4db00cd2d0 con 0x7f4db00cbc20 2023-05-10T04:19:34.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4db00ccff0 con 0x7f4db00cbc20 2023-05-10T04:19:34.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1716030583 0 0) 0x7f4db00ccff0 con 0x7f4db00cbc20 2023-05-10T04:19:34.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4db0158aa0 msgr2=0x7f4db00add70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-10T04:19:34.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4db0158aa0 0x7f4db00add70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 >> v1:172.21.15.132:6789/0 conn(0x7f4db015cdb0 legacy=0x7f4db00c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db006cc40 con 0x7f4db00cbc20 2023-05-10T04:19:34.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f0fbb9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb4156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f0fbb9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb40cacf0 0x7f0fb40b41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f0fbb9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb415cdb0 0x7f0fb40c4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f0fbb9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4156850 con 0x7f0fb40cacf0 2023-05-10T04:19:34.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f0fbb9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c3a90 con 0x7f0fb415cdb0 2023-05-10T04:19:34.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f0fbb9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb40c3d70 con 0x7f0fb406a3e0 2023-05-10T04:19:34.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f0fb979b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb4156310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f4dac001670 con 0x7f4db00cbc20 2023-05-10T04:19:34.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 >> v1:172.21.15.154:6789/0 conn(0x7f4db00cbc20 legacy=0x7f4db00cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d9c004c20 0x7f4d9c004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d9c0037f0 0x7f4d9c003c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 0x7f4d9c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80015b0 con 0x7f4d9c0037f0 2023-05-10T04:19:34.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00c97d0 con 0x7f4d9c0041f0 2023-05-10T04:19:34.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.977+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9c00c110 con 0x7f4d9c004c20 2023-05-10T04:19:34.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.978+0000 7f0fb979b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb4156310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58570/0 (socket says 172.21.15.132:58570) 2023-05-10T04:19:34.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.978+0000 7f0fb979b700 1 -- 172.21.15.132:0/2307503327 learned_addr learned my addr 172.21.15.132:0/2307503327 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:34.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.978+0000 7f0fb8f9a700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb40cacf0 0x7f0fb40b41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.978+0000 7f0fb9f9c700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb415cdb0 0x7f0fb40c4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.976+0000 7f467b1ff700 1 -- 172.21.15.132:0/385900138 wait complete. 2023-05-10T04:19:34.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.978+0000 7f4db639c700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 0x7f4d9c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f467b1ff700 1 Processor -- start 2023-05-10T04:19:34.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f4db5b9b700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d9c004c20 0x7f4d9c004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f0fb979b700 1 -- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb415cdb0 msgr2=0x7f0fb40c4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f0fb979b700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0fb415cdb0 0x7f0fb40c4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f0fb979b700 1 -- 172.21.15.132:0/2307503327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb40cacf0 msgr2=0x7f0fb40b41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f0fb979b700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb40cacf0 0x7f0fb40b41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f0fb979b700 1 -- 172.21.15.132:0/2307503327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fac00c050 con 0x7f0fb406a3e0 2023-05-10T04:19:34.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f4db639c700 1 -- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d9c004c20 msgr2=0x7f4d9c004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:34.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f4db639c700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d9c004c20 0x7f4d9c004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f4db639c700 1 -- 172.21.15.132:0/1775626690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d9c0037f0 msgr2=0x7f4d9c003c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:34.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f4db639c700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d9c0037f0 0x7f4d9c003c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.979+0000 7f4db639c700 1 -- 172.21.15.132:0/1775626690 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db00ccff0 con 0x7f4d9c0041f0 2023-05-10T04:19:34.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.980+0000 7f0fb979b700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb4156310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400e9b0 tx=0x7f0fa400ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:34.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.980+0000 7f467b1ff700 1 -- start start 2023-05-10T04:19:34.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.980+0000 7f99af1ff700 1 Processor -- start 2023-05-10T04:19:34.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.981+0000 7f467b1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46740ad690 0x7f46741f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.981+0000 7f467b1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740c20d0 0x7f467415ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.981+0000 7f467b1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674160d20 0x7f467415f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.981+0000 7f467b1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f467415f690 con 0x7f46740ad690 2023-05-10T04:19:34.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.981+0000 7f467b1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46740c3390 con 0x7f4674160d20 2023-05-10T04:19:34.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.981+0000 7f467b1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46740c3670 con 0x7f46740c20d0 2023-05-10T04:19:34.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.980+0000 7f99af1ff700 1 -- start start 2023-05-10T04:19:34.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.980+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa4009710 con 0x7f0fb406a3e0 2023-05-10T04:19:34.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.980+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa400c850 con 0x7f0fb406a3e0 2023-05-10T04:19:34.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.980+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa400cbc0 con 0x7f0fb406a3e0 2023-05-10T04:19:34.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.981+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb40cd2d0 con 0x7f0fb406a3e0 2023-05-10T04:19:34.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.982+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb40ccff0 con 0x7f0fb406a3e0 2023-05-10T04:19:34.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.982+0000 7f4673fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740c20d0 0x7f467415ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.982+0000 7f4673fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740c20d0 0x7f467415ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58594/0 (socket says 172.21.15.132:58594) 2023-05-10T04:19:34.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.982+0000 7f4673fff700 1 -- 172.21.15.132:0/3285914717 learned_addr learned my addr 172.21.15.132:0/3285914717 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:34.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.982+0000 7f4db639c700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 0x7f4d9c00ba10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4da800c510 tx=0x7f4d9c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=950ae27aa70c8b55 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:34.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.982+0000 7f467979c700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674160d20 0x7f467415f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:34.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.982+0000 7f99af1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99a8160d20 0x7f99a806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f99af1ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99a80c20d0 0x7f99a80adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:34.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f99af1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a80cd1f0 con 0x7f99a80ad690 2023-05-10T04:19:34.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f99af1ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a81610f0 con 0x7f99a80c20d0 2023-05-10T04:19:34.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f99af1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a80cc670 con 0x7f99a8160d20 2023-05-10T04:19:34.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f467979c700 1 -- 172.21.15.132:0/3285914717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740c20d0 msgr2=0x7f467415ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f467979c700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f46740c20d0 0x7f467415ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f467979c700 1 -- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46740ad690 msgr2=0x7f46741f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:34.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f467979c700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46740ad690 0x7f46741f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:34.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f467979c700 1 -- 172.21.15.132:0/3285914717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f466c009b30 con 0x7f4674160d20 2023-05-10T04:19:34.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.983+0000 7f99a7fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f99a80ad690 0x7f99a80c19c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50760/0 (socket says 172.21.15.132:50760) 2023-05-10T04:19:34.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f99a7fff700 1 -- 172.21.15.132:0/601843924 learned_addr learned my addr 172.21.15.132:0/601843924 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:34.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f99acf9b700 1 --2- 172.21.15.132:0/601843924 >> v2:172.21.15.154:3300/0 conn(0x7f99a8160d20 0x7f99a806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f99ad79c700 1 --2- 172.21.15.132:0/601843924 >> v2:172.21.15.132:3300/0 conn(0x7f99a80c20d0 0x7f99a80adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8006da0 con 0x7f4d9c0041f0 2023-05-10T04:19:35.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da800ce10 con 0x7f4d9c0041f0 2023-05-10T04:19:35.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f4db4b99700 1 -- 172.21.15.132:0/1775626690 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8003c40 con 0x7f4d9c0041f0 2023-05-10T04:19:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f99a77fe700 1 -- 172.21.15.132:0/601843924 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 988520947 0 0) 0x7f99a80cd1f0 con 0x7f99a80ad690 2023-05-10T04:19:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f99a77fe700 1 -- 172.21.15.132:0/601843924 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99980035b0 con 0x7f99a80ad690 2023-05-10T04:19:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f99acf9b700 1 -- 172.21.15.132:0/601843924 >> v2:172.21.15.132:3300/0 conn(0x7f99a80c20d0 msgr2=0x7f99a80adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f99acf9b700 1 --2- 172.21.15.132:0/601843924 >> v2:172.21.15.132:3300/0 conn(0x7f99a80c20d0 0x7f99a80adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f99acf9b700 1 -- 172.21.15.132:0/601843924 >> v1:172.21.15.132:6789/0 conn(0x7f99a80ad690 legacy=0x7f99a80c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f99acf9b700 1 -- 172.21.15.132:0/601843924 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a80cc950 con 0x7f99a8160d20 2023-05-10T04:19:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f4db7dff700 1 -- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 msgr2=0x7f4d9c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f4db7dff700 1 --2- 172.21.15.132:0/1775626690 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 0x7f4d9c00ba10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4da800c510 tx=0x7f4d9c005880 comp rx=0 tx=0).stop 2023-05-10T04:19:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f4db639c700 1 -- 172.21.15.132:0/1775626690 reap_dead start 2023-05-10T04:19:35.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.984+0000 7f467979c700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674160d20 0x7f467415f150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f466c014000 tx=0x7f466c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f4db7dff700 1 -- 172.21.15.132:0/1775626690 shutdown_connections 2023-05-10T04:19:35.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f4db7dff700 1 -- 172.21.15.132:0/1775626690 >> 172.21.15.132:0/1775626690 conn(0x7f4db00cf6e0 msgr2=0x7f4db00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f99acf9b700 1 --2- 172.21.15.132:0/601843924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a8160d20 0x7f99a806cb90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f99a80705a0 tx=0x7f999c009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eac70579b57efbe server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c004440 con 0x7f4674160d20 2023-05-10T04:19:35.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466c0045c0 con 0x7f4674160d20 2023-05-10T04:19:35.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466c004970 con 0x7f4674160d20 2023-05-10T04:19:35.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46740ccf10 con 0x7f4674160d20 2023-05-10T04:19:35.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46740ccc30 con 0x7f4674160d20 2023-05-10T04:19:35.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.985+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0fa400cd20 con 0x7f0fb406a3e0 2023-05-10T04:19:35.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.986+0000 7f4db7dff700 1 -- 172.21.15.132:0/1775626690 shutdown_connections 2023-05-10T04:19:35.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.986+0000 7f4db7dff700 1 -- 172.21.15.132:0/1775626690 wait complete. 2023-05-10T04:19:35.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.987+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0fb406cc40 con 0x7f0fb406a3e0 2023-05-10T04:19:35.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.987+0000 7f0fa9ffb700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f9806adb0 0x7f0f9806d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.987+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0fa4089790 con 0x7f0fb406a3e0 2023-05-10T04:19:35.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.987+0000 7f0fa9ffb700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:6808/1978475521,v1:172.21.15.154:6809/1978475521] conn(0x7f0f98074a00 0x7f0f98076e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.987+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 --> [v2:172.21.15.154:6808/1978475521,v1:172.21.15.154:6809/1978475521] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0f98077500 con 0x7f0f98074a00 2023-05-10T04:19:35.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.988+0000 7f99a77fe700 1 -- 172.21.15.132:0/601843924 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c011830 con 0x7f99a8160d20 2023-05-10T04:19:35.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.988+0000 7f99a77fe700 1 -- 172.21.15.132:0/601843924 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f999c011990 con 0x7f99a8160d20 2023-05-10T04:19:35.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.988+0000 7f99a77fe700 1 -- 172.21.15.132:0/601843924 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f999c011d00 con 0x7f99a8160d20 2023-05-10T04:19:35.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.988+0000 7f0fb8f9a700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f9806adb0 0x7f0f9806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.989+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4650000fc0 con 0x7f4674160d20 2023-05-10T04:19:35.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.989+0000 7f4db7dff700 1 Processor -- start 2023-05-10T04:19:35.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.989+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fa40545c0 con 0x7f0fb406a3e0 2023-05-10T04:19:35.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.989+0000 7f0fb8f9a700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f9806adb0 0x7f0f9806d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0fb41e74a0 tx=0x7f0fb0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.990+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f466c012430 con 0x7f4674160d20 2023-05-10T04:19:35.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.990+0000 7f4db7dff700 1 -- start start 2023-05-10T04:19:35.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.990+0000 7f99af1ff700 1 -- 172.21.15.132:0/601843924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a8160d20 msgr2=0x7f99a806cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.990+0000 7f99af1ff700 1 --2- 172.21.15.132:0/601843924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a8160d20 0x7f99a806cb90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f99a80705a0 tx=0x7f999c009b20 comp rx=0 tx=0).stop 2023-05-10T04:19:35.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.990+0000 7f0fb9f9c700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:6808/1978475521,v1:172.21.15.154:6809/1978475521] conn(0x7f0f98074a00 0x7f0f98076e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f99af1ff700 1 -- 172.21.15.132:0/601843924 shutdown_connections 2023-05-10T04:19:35.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f99af1ff700 1 --2- 172.21.15.132:0/601843924 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a8160d20 0x7f99a806cb90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f99af1ff700 1 --2- 172.21.15.132:0/601843924 >> v2:172.21.15.132:3300/0 conn(0x7f99a80c20d0 0x7f99a80adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f99af1ff700 1 -- 172.21.15.132:0/601843924 >> 172.21.15.132:0/601843924 conn(0x7f99a80cf720 msgr2=0x7f99a80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f99af1ff700 1 -- 172.21.15.132:0/601843924 shutdown_connections 2023-05-10T04:19:35.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f4db7dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 0x7f4db00c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f4db7dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db014dea0 0x7f4db014fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f4db7dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4db00af490 0x7f4db0159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f4db7dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db014e3d0 con 0x7f4db014dea0 2023-05-10T04:19:35.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f4db7dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db014e6b0 con 0x7f4d9c0041f0 2023-05-10T04:19:35.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.991+0000 7f4db7dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db014e990 con 0x7f4db00af490 2023-05-10T04:19:35.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.992+0000 7f4db5b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 0x7f4db00c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.992+0000 7f4db5b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 0x7f4db00c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:44976/0 (socket says 172.21.15.132:44976) 2023-05-10T04:19:35.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.992+0000 7f4db5b9b700 1 -- 172.21.15.132:0/3472644009 learned_addr learned my addr 172.21.15.132:0/3472644009 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.992+0000 7f4db639c700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4db00af490 0x7f4db0159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.992+0000 7f99af1ff700 1 -- 172.21.15.132:0/601843924 wait complete. 2023-05-10T04:19:35.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f4db539a700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db014dea0 0x7f4db014fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.992+0000 7f46717fa700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f465806ad00 0x7f465806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f466c08a9d0 con 0x7f4674160d20 2023-05-10T04:19:35.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f46717fa700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6817/765017957,v1:172.21.15.132:6819/765017957] conn(0x7f46580749d0 0x7f4658076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 --> [v2:172.21.15.132:6817/765017957,v1:172.21.15.132:6819/765017957] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46580774d0 con 0x7f46580749d0 2023-05-10T04:19:35.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f466c08f2a0 con 0x7f4674160d20 2023-05-10T04:19:35.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.992+0000 7f0fb9f9c700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:6808/1978475521,v1:172.21.15.154:6809/1978475521] conn(0x7f0f98074a00 0x7f0f98076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 <== osd.5 v2:172.21.15.154:6808/1978475521 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f0f98077500 con 0x7f0f98074a00 2023-05-10T04:19:35.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f4db639c700 1 -- 172.21.15.132:0/3472644009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 msgr2=0x7f4db00c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f4db639c700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d9c0041f0 0x7f4db00c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f4db639c700 1 -- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db014dea0 msgr2=0x7f4db014fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f4db639c700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4db014dea0 0x7f4db014fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.993+0000 7f4db639c700 1 -- 172.21.15.132:0/3472644009 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db015d250 con 0x7f4db00af490 2023-05-10T04:19:35.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.994+0000 7f4673fff700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6817/765017957,v1:172.21.15.132:6819/765017957] conn(0x7f46580749d0 0x7f4658076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.994+0000 7f99af1ff700 1 Processor -- start 2023-05-10T04:19:35.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.995+0000 7f99af1ff700 1 -- start start 2023-05-10T04:19:35.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.995+0000 7f4673fff700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6817/765017957,v1:172.21.15.132:6819/765017957] conn(0x7f46580749d0 0x7f4658076e00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.995+0000 7f4678f9b700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f465806ad00 0x7f465806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.996+0000 7f99af1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80ad690 0x7f99a815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.996+0000 7f99af1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a80c20d0 0x7f99a81f9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.996+0000 7f99af1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8160d20 0x7f99a81f9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.996+0000 7f99af1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80c2b60 con 0x7f99a80c20d0 2023-05-10T04:19:35.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.996+0000 7f99af1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80b10a0 con 0x7f99a80ad690 2023-05-10T04:19:35.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.996+0000 7f99af1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a80b1380 con 0x7f99a8160d20 2023-05-10T04:19:35.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.997+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 <== osd.0 v2:172.21.15.132:6817/765017957 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f46580774d0 con 0x7f46580749d0 2023-05-10T04:19:35.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.997+0000 7f99a7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a80c20d0 0x7f99a81f9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.997+0000 7f99a7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a80c20d0 0x7f99a81f9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48092/0 (socket says 172.21.15.132:48092) 2023-05-10T04:19:35.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.997+0000 7f99a7fff700 1 -- 172.21.15.132:0/2801811602 learned_addr learned my addr 172.21.15.132:0/2801811602 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.997+0000 7f4678f9b700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f465806ad00 0x7f465806d1b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4664006b20 tx=0x7f4664006ab0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.997+0000 7f99acf9b700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80ad690 0x7f99a815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.997+0000 7f540a3ff700 1 Processor -- start 2023-05-10T04:19:35.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.998+0000 7f99a7fff700 1 -- 172.21.15.132:0/2801811602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8160d20 msgr2=0x7f99a81f9fd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-10T04:19:35.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.998+0000 7f99a7fff700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99a8160d20 0x7f99a81f9fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.998+0000 7f99a7fff700 1 -- 172.21.15.132:0/2801811602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80ad690 msgr2=0x7f99a815e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.998+0000 7f99a7fff700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99a80ad690 0x7f99a815e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.998+0000 7f99a7fff700 1 -- 172.21.15.132:0/2801811602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f999c0094a0 con 0x7f99a80c20d0 2023-05-10T04:19:35.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.998+0000 7f4db639c700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4db00af490 0x7f4db0159330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4da8014000 tx=0x7f4da8001ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.998+0000 7f99a7fff700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a80c20d0 0x7f99a81f9a90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f999400c450 tx=0x7f999400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994005d70 con 0x7f99a80c20d0 2023-05-10T04:19:35.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99940070d0 con 0x7f99a80c20d0 2023-05-10T04:19:35.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994007440 con 0x7f99a80c20d0 2023-05-10T04:19:35.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a80ccf10 con 0x7f99a80c20d0 2023-05-10T04:19:35.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f4da67fc700 1 -- 172.21.15.132:0/3472644009 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8007de0 con 0x7f4db00af490 2023-05-10T04:19:35.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f4da67fc700 1 -- 172.21.15.132:0/3472644009 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da8003e30 con 0x7f4db00af490 2023-05-10T04:19:35.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f4da67fc700 1 -- 172.21.15.132:0/3472644009 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8005310 con 0x7f4db00af490 2023-05-10T04:19:35.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.000+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db006cf20 con 0x7f4db00af490 2023-05-10T04:19:35.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.000+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db00add70 con 0x7f4db00af490 2023-05-10T04:19:35.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a80ccc30 con 0x7f99a80c20d0 2023-05-10T04:19:35.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.998+0000 7f540a3ff700 1 -- start start 2023-05-10T04:19:35.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:34.999+0000 7f540a3ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5404160d20 0x7f540406cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.000+0000 7f540a3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54040c20d0 0x7f54040adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.000+0000 7f540a3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54040cd1f0 con 0x7f54040ad690 2023-05-10T04:19:35.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.000+0000 7f540a3ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54041610f0 con 0x7f5404160d20 2023-05-10T04:19:35.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.000+0000 7f540a3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54040cc670 con 0x7f54040c20d0 2023-05-10T04:19:35.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.001+0000 7f5403fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5404160d20 0x7f540406cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.002+0000 7f5403fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5404160d20 0x7f540406cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48102/0 (socket says 172.21.15.132:48102) 2023-05-10T04:19:35.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.002+0000 7f5403fff700 1 -- 172.21.15.132:0/1875601319 learned_addr learned my addr 172.21.15.132:0/1875601319 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.002+0000 7f5403fff700 1 -- 172.21.15.132:0/1875601319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54040c20d0 msgr2=0x7f54040adb10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-10T04:19:35.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.002+0000 7f5403fff700 1 --2- 172.21.15.132:0/1875601319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54040c20d0 0x7f54040adb10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.002+0000 7f5403fff700 1 -- 172.21.15.132:0/1875601319 >> v1:172.21.15.154:6789/0 conn(0x7f54040ad690 legacy=0x7f54040c19c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-10T04:19:35.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.002+0000 7f5403fff700 1 -- 172.21.15.132:0/1875601319 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54040cc950 con 0x7f5404160d20 2023-05-10T04:19:35.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.003+0000 7f5403fff700 1 --2- 172.21.15.132:0/1875601319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5404160d20 0x7f540406cb90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f53f40098f0 tx=0x7f53f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd085af5eafa02cb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.004+0000 7f5402ffd700 1 -- 172.21.15.132:0/1875601319 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4004230 con 0x7f5404160d20 2023-05-10T04:19:35.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.004+0000 7f5402ffd700 1 -- 172.21.15.132:0/1875601319 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4004390 con 0x7f5404160d20 2023-05-10T04:19:35.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.004+0000 7f5402ffd700 1 -- 172.21.15.132:0/1875601319 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f40036a0 con 0x7f5404160d20 2023-05-10T04:19:35.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.001+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9988000fc0 con 0x7f99a80c20d0 2023-05-10T04:19:35.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.005+0000 7f540a3ff700 1 -- 172.21.15.132:0/1875601319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5404160d20 msgr2=0x7f540406cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.005+0000 7f540a3ff700 1 --2- 172.21.15.132:0/1875601319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5404160d20 0x7f540406cb90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f53f40098f0 tx=0x7f53f4009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:35.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.003+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99940075a0 con 0x7f99a80c20d0 2023-05-10T04:19:35.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.005+0000 7f99a57fa700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f998c06ad30 0x7f998c06d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.003+0000 7f4da67fc700 1 -- 172.21.15.132:0/3472644009 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4da8005470 con 0x7f4db00af490 2023-05-10T04:19:35.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.005+0000 7f4da67fc700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4d9406adb0 0x7f4d9406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.005+0000 7f4da67fc700 1 -- 172.21.15.132:0/3472644009 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4da808b140 con 0x7f4db00af490 2023-05-10T04:19:35.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f4db7dff700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6800/3174697195,v1:172.21.15.132:6801/3174697195] conn(0x7f4d980015e0 0x7f4d98003a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 --> [v2:172.21.15.132:6800/3174697195,v1:172.21.15.132:6801/3174697195] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4d98006bc0 con 0x7f4d980015e0 2023-05-10T04:19:35.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.004+0000 7f42c8fff700 1 Processor -- start 2023-05-10T04:19:35.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.005+0000 7f42c8fff700 1 -- start start 2023-05-10T04:19:35.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9994088b10 con 0x7f99a80c20d0 2023-05-10T04:19:35.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f99a57fa700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6802/3798938145,v1:172.21.15.132:6804/3798938145] conn(0x7f998c074980 0x7f998c076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 --> [v2:172.21.15.132:6802/3798938145,v1:172.21.15.132:6804/3798938145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f998c077480 con 0x7f998c074980 2023-05-10T04:19:35.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9994053a20 con 0x7f99a80c20d0 2023-05-10T04:19:35.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f540a3ff700 1 -- 172.21.15.132:0/1875601319 shutdown_connections 2023-05-10T04:19:35.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f540a3ff700 1 --2- 172.21.15.132:0/1875601319 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54040c20d0 0x7f54040adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f540a3ff700 1 --2- 172.21.15.132:0/1875601319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5404160d20 0x7f540406cb90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f540a3ff700 1 -- 172.21.15.132:0/1875601319 >> 172.21.15.132:0/1875601319 conn(0x7f54040cf720 msgr2=0x7f54040cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.007+0000 7f4db539a700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6800/3174697195,v1:172.21.15.132:6801/3174697195] conn(0x7f4d980015e0 0x7f4d98003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.007+0000 7f99ad79c700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6802/3798938145,v1:172.21.15.132:6804/3798938145] conn(0x7f998c074980 0x7f998c076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f42c8fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42c4160fd0 0x7f42c406a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.006+0000 7f42c8fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c406c6c0 0x7f42c4070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.007+0000 7f42c8fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c4070af0 con 0x7f42c40ad930 2023-05-10T04:19:35.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.007+0000 7f42c8fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c4161530 con 0x7f42c4160fd0 2023-05-10T04:19:35.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.007+0000 7f42c8fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c4161810 con 0x7f42c406c6c0 2023-05-10T04:19:35.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.007+0000 7f42bbfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42c4160fd0 0x7f42c406a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f4db539a700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6800/3174697195,v1:172.21.15.132:6801/3174697195] conn(0x7f4d980015e0 0x7f4d98003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f4db5b9b700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4d9406adb0 0x7f4d9406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f99acf9b700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f998c06ad30 0x7f998c06d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f99ad79c700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6802/3798938145,v1:172.21.15.132:6804/3798938145] conn(0x7f998c074980 0x7f998c076db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.007+0000 7f42bbfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f42c4160fd0 0x7f42c406a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48104/0 (socket says 172.21.15.132:48104) 2023-05-10T04:19:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.007+0000 7f42bbfff700 1 -- 172.21.15.132:0/3722017487 learned_addr learned my addr 172.21.15.132:0/3722017487 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f42c2d9d700 1 --2- 172.21.15.132:0/3722017487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c406c6c0 0x7f42c4070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f42bbfff700 1 -- 172.21.15.132:0/3722017487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c406c6c0 msgr2=0x7f42c4070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f42bbfff700 1 --2- 172.21.15.132:0/3722017487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c406c6c0 0x7f42c4070ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f42bbfff700 1 -- 172.21.15.132:0/3722017487 >> v1:172.21.15.132:6789/0 conn(0x7f42c40ad930 legacy=0x7f42c40add00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-10T04:19:35.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f42bbfff700 1 -- 172.21.15.132:0/3722017487 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c4161af0 con 0x7f42c4160fd0 2023-05-10T04:19:35.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7f42bbfff700 1 --2- 172.21.15.132:0/3722017487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c4160fd0 0x7f42c406a7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42b40098f0 tx=0x7f42b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5a739ca550dd46 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.009+0000 7f42c1d9b700 1 -- 172.21.15.132:0/3722017487 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4004230 con 0x7f42c4160fd0 2023-05-10T04:19:35.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.009+0000 7f42c1d9b700 1 -- 172.21.15.132:0/3722017487 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b4004390 con 0x7f42c4160fd0 2023-05-10T04:19:35.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.009+0000 7f42c1d9b700 1 -- 172.21.15.132:0/3722017487 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b40036a0 con 0x7f42c4160fd0 2023-05-10T04:19:35.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.009+0000 7f4db5b9b700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4d9406adb0 0x7f4d9406d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009aa0 tx=0x7f4da0006f70 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7faf41dff700 1 Processor -- start 2023-05-10T04:19:35.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.008+0000 7faf41dff700 1 -- start start 2023-05-10T04:19:35.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.009+0000 7f99acf9b700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f998c06ad30 0x7f998c06d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f99a80c1560 tx=0x7f999c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.009+0000 7f540a3ff700 1 -- 172.21.15.132:0/1875601319 shutdown_connections 2023-05-10T04:19:35.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.010+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 <== osd.2 v2:172.21.15.132:6802/3798938145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f998c077480 con 0x7f998c074980 2023-05-10T04:19:35.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.010+0000 7f42c8fff700 1 -- 172.21.15.132:0/3722017487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c4160fd0 msgr2=0x7f42c406a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.010+0000 7f42c8fff700 1 --2- 172.21.15.132:0/3722017487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c4160fd0 0x7f42c406a7a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42b40098f0 tx=0x7f42b4009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:35.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.010+0000 7f42c8fff700 1 -- 172.21.15.132:0/3722017487 shutdown_connections 2023-05-10T04:19:35.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.010+0000 7f42c8fff700 1 --2- 172.21.15.132:0/3722017487 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c406c6c0 0x7f42c4070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.010+0000 7f42c8fff700 1 --2- 172.21.15.132:0/3722017487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c4160fd0 0x7f42c406a7a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.010+0000 7f42c8fff700 1 -- 172.21.15.132:0/3722017487 >> 172.21.15.132:0/3722017487 conn(0x7f42c40cf6e0 msgr2=0x7f42c40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.009+0000 7f540a3ff700 1 -- 172.21.15.132:0/1875601319 wait complete. 2023-05-10T04:19:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.011+0000 7f42c8fff700 1 -- 172.21.15.132:0/3722017487 shutdown_connections 2023-05-10T04:19:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf41dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c0ad930 0x7faf3c0add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf41dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf3c160fd0 0x7faf3c06a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf41dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faf3c06c6c0 0x7faf3c070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf41dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c070af0 con 0x7faf3c160fd0 2023-05-10T04:19:35.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf41dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf3c0ae240 con 0x7faf3c06c6c0 2023-05-10T04:19:35.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf41dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c161530 con 0x7faf3c0ad930 2023-05-10T04:19:35.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf3b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c0ad930 0x7faf3c0add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf3b7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c0ad930 0x7faf3c0add00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58646/0 (socket says 172.21.15.132:58646) 2023-05-10T04:19:35.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7faf3b7fe700 1 -- 172.21.15.132:0/2982279785 learned_addr learned my addr 172.21.15.132:0/2982279785 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.011+0000 7f42c8fff700 1 -- 172.21.15.132:0/3722017487 wait complete. 2023-05-10T04:19:35.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7f540a3ff700 1 Processor -- start 2023-05-10T04:19:35.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.012+0000 7f540a3ff700 1 -- start start 2023-05-10T04:19:35.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.013+0000 7f540a3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54040ad690 0x7f54040b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.013+0000 7f540a3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54040c20d0 0x7f540414d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.013+0000 7f540a3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5404160d20 0x7f54040c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.013+0000 7f540a3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54040b07b0 con 0x7f54040ad690 2023-05-10T04:19:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.013+0000 7f540a3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540414d690 con 0x7f5404160d20 2023-05-10T04:19:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.013+0000 7f540a3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540414d930 con 0x7f54040c20d0 2023-05-10T04:19:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.013+0000 7f54037fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54040c20d0 0x7f540414d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5404160d20 0x7f54040c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5404160d20 0x7f54040c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:44996/0 (socket says 172.21.15.132:44996) 2023-05-10T04:19:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 -- 172.21.15.132:0/2998684061 learned_addr learned my addr 172.21.15.132:0/2998684061 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f5403fff700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54040ad690 0x7f54040b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f42c8fff700 1 Processor -- start 2023-05-10T04:19:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 -- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54040c20d0 msgr2=0x7f540414d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f54040c20d0 0x7f540414d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 -- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54040ad690 msgr2=0x7f54040b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54040ad690 0x7f54040b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 -- 172.21.15.132:0/2998684061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f4009550 con 0x7f5404160d20 2023-05-10T04:19:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f5403fff700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54040ad690 0x7f54040b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:35.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f540899c700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5404160d20 0x7f54040c4690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b9c0 tx=0x7f53fc00bcd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.014+0000 7f42c8fff700 1 -- start start 2023-05-10T04:19:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.015+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00c930 con 0x7f5404160d20 2023-05-10T04:19:35.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.015+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53fc00ca90 con 0x7f5404160d20 2023-05-10T04:19:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.015+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53fc00ce40 con 0x7f5404160d20 2023-05-10T04:19:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.015+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54040ccf10 con 0x7f5404160d20 2023-05-10T04:19:35.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.015+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54040ccc30 con 0x7f5404160d20 2023-05-10T04:19:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.015+0000 7f42c8fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c406c6c0 0x7f42c415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c8fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c40ad930 0x7f42c41f65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c8fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42c4160fd0 0x7f42c40bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c8fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41f75d0 con 0x7f42c406c6c0 2023-05-10T04:19:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c8fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41f7010 con 0x7f42c4160fd0 2023-05-10T04:19:35.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c8fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41f72f0 con 0x7f42c40ad930 2023-05-10T04:19:35.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42c4160fd0 0x7f42c40bfd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c2d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42c4160fd0 0x7f42c40bfd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:45000/0 (socket says 172.21.15.132:45000) 2023-05-10T04:19:35.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c2d9d700 1 -- 172.21.15.132:0/38022320 learned_addr learned my addr 172.21.15.132:0/38022320 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42c259c700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c406c6c0 0x7f42c415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f42bbfff700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c40ad930 0x7f42c41f65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.016+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f540406d0d0 con 0x7f5404160d20 2023-05-10T04:19:35.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.017+0000 7f42c2d9d700 1 -- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c40ad930 msgr2=0x7f42c41f65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.017+0000 7f42c2d9d700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f42c40ad930 0x7f42c41f65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.017+0000 7f42c2d9d700 1 -- 172.21.15.132:0/38022320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c406c6c0 msgr2=0x7f42c415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.017+0000 7f42c2d9d700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42c406c6c0 0x7f42c415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.017+0000 7f42c2d9d700 1 -- 172.21.15.132:0/38022320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b4009550 con 0x7f42c4160fd0 2023-05-10T04:19:35.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.017+0000 7f4da67fc700 1 -- 172.21.15.132:0/3472644009 <== osd.1 v2:172.21.15.132:6800/3174697195 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4d98006bc0 con 0x7f4d980015e0 2023-05-10T04:19:35.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.017+0000 7f42c2d9d700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42c4160fd0 0x7f42c40bfd00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42bc007e60 tx=0x7f42bc00e3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.017+0000 7faf33fff700 1 --2- 172.21.15.132:0/2982279785 >> v2:172.21.15.132:3300/0 conn(0x7faf3c160fd0 0x7faf3c06a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc00ede0 con 0x7f42c4160fd0 2023-05-10T04:19:35.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc014420 con 0x7f42c4160fd0 2023-05-10T04:19:35.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0147d0 con 0x7f42c4160fd0 2023-05-10T04:19:35.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c406ace0 con 0x7f42c4160fd0 2023-05-10T04:19:35.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7faf33fff700 1 -- 172.21.15.132:0/2982279785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c0ad930 msgr2=0x7faf3c0add00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7faf33fff700 1 --2- 172.21.15.132:0/2982279785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c0ad930 0x7faf3c0add00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7faf33fff700 1 -- 172.21.15.132:0/2982279785 >> v2:172.21.15.154:3300/0 conn(0x7faf3c06c6c0 msgr2=0x7faf3c070ff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-10T04:19:35.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7faf33fff700 1 --2- 172.21.15.132:0/2982279785 >> v2:172.21.15.154:3300/0 conn(0x7faf3c06c6c0 0x7faf3c070ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.018+0000 7faf33fff700 1 -- 172.21.15.132:0/2982279785 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf3c161810 con 0x7faf3c160fd0 2023-05-10T04:19:35.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.019+0000 7faf33fff700 1 --2- 172.21.15.132:0/2982279785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf3c160fd0 0x7faf3c06a7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0678f0 tx=0x7faf2c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c1e5d2a4aa8f05 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.019+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c4161dd0 con 0x7f42c4160fd0 2023-05-10T04:19:35.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.020+0000 7faf3affd700 1 -- 172.21.15.132:0/2982279785 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011830 con 0x7faf3c160fd0 2023-05-10T04:19:35.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.020+0000 7faf3affd700 1 -- 172.21.15.132:0/2982279785 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2c011990 con 0x7faf3c160fd0 2023-05-10T04:19:35.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.020+0000 7faf3affd700 1 -- 172.21.15.132:0/2982279785 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2c011d20 con 0x7faf3c160fd0 2023-05-10T04:19:35.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.020+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f53fc006d50 con 0x7f5404160d20 2023-05-10T04:19:35.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.021+0000 7faf41dff700 1 -- 172.21.15.132:0/2982279785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf3c160fd0 msgr2=0x7faf3c06a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.021+0000 7faf41dff700 1 --2- 172.21.15.132:0/2982279785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf3c160fd0 0x7faf3c06a7a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0678f0 tx=0x7faf2c009b20 comp rx=0 tx=0).stop 2023-05-10T04:19:35.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.020+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42c40cd150 con 0x7f42c4160fd0 2023-05-10T04:19:35.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.021+0000 7f5400ff9700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f53f006ace0 0x7f53f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.021+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f53fc089a20 con 0x7f5404160d20 2023-05-10T04:19:35.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.021+0000 7f5400ff9700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:6800/2066983237,v1:172.21.15.154:6801/2066983237] conn(0x7f53f00749b0 0x7f53f0076de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.021+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 --> [v2:172.21.15.154:6800/2066983237,v1:172.21.15.154:6801/2066983237] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53f00774b0 con 0x7f53f00749b0 2023-05-10T04:19:35.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.021+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53fc089dd0 con 0x7f5404160d20 2023-05-10T04:19:35.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.022+0000 7faf41dff700 1 -- 172.21.15.132:0/2982279785 shutdown_connections 2023-05-10T04:19:35.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.022+0000 7faf41dff700 1 --2- 172.21.15.132:0/2982279785 >> v2:172.21.15.154:3300/0 conn(0x7faf3c06c6c0 0x7faf3c070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.022+0000 7faf41dff700 1 --2- 172.21.15.132:0/2982279785 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c0ad930 0x7faf3c0add00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.022+0000 7faf41dff700 1 --2- 172.21.15.132:0/2982279785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf3c160fd0 0x7faf3c06a7a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.022+0000 7faf41dff700 1 -- 172.21.15.132:0/2982279785 >> 172.21.15.132:0/2982279785 conn(0x7faf3c0cf6e0 msgr2=0x7faf3c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.022+0000 7f54037fe700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:6800/2066983237,v1:172.21.15.154:6801/2066983237] conn(0x7f53f00749b0 0x7f53f0076de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.022+0000 7f5403fff700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f53f006ace0 0x7f53f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.023+0000 7f54037fe700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:6800/2066983237,v1:172.21.15.154:6801/2066983237] conn(0x7f53f00749b0 0x7f53f0076de0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.023+0000 7f5403fff700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f53f006ace0 0x7f53f006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009c40 tx=0x7f53f4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.023+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f42bc014930 con 0x7f42c4160fd0 2023-05-10T04:19:35.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.024+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 --> [v2:172.21.15.154:6808/1978475521,v1:172.21.15.154:6809/1978475521] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0fb4074430 con 0x7f0f98074a00 2023-05-10T04:19:35.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.024+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 <== osd.6 v2:172.21.15.154:6800/2066983237 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f53f00774b0 con 0x7f53f00749b0 2023-05-10T04:19:35.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.024+0000 7f42baffd700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f42b006af10 0x7f42b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.024+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f42bc08a5d0 con 0x7f42c4160fd0 2023-05-10T04:19:35.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.025+0000 7f42baffd700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:6824/3626185395,v1:172.21.15.154:6825/3626185395] conn(0x7f42b0074be0 0x7f42b0077010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.025+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 --> [v2:172.21.15.154:6824/3626185395,v1:172.21.15.154:6825/3626185395] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42b00776e0 con 0x7f42b0074be0 2023-05-10T04:19:35.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.025+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42bc08a980 con 0x7f42c4160fd0 2023-05-10T04:19:35.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.025+0000 7f42c259c700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f42b006af10 0x7f42b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.027+0000 7f42c259c700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f42b006af10 0x7f42b006d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f42c40b4850 tx=0x7f42ac009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.028+0000 7f42bbfff700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:6824/3626185395,v1:172.21.15.154:6825/3626185395] conn(0x7f42b0074be0 0x7f42b0077010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.028+0000 7f1da85ff700 1 Processor -- start 2023-05-10T04:19:35.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.028+0000 7f1da85ff700 1 -- start start 2023-05-10T04:19:35.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.029+0000 7faf41dff700 1 -- 172.21.15.132:0/2982279785 shutdown_connections 2023-05-10T04:19:35.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f0fa9ffb700 1 -- 172.21.15.132:0/2307503327 <== osd.5 v2:172.21.15.154:6808/1978475521 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0fb4074430 con 0x7f0f98074a00 2023-05-10T04:19:35.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f1da85ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da006a3e0 0x7f1da006a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f1da85ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1da00cc6b0 0x7f1da0070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f1da85ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da0160b70 con 0x7f1da00ccb20 2023-05-10T04:19:35.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f1da85ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da006d6d0 con 0x7f1da00cc6b0 2023-05-10T04:19:35.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f1da85ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da006acf0 con 0x7f1da006a3e0 2023-05-10T04:19:35.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:6808/1978475521,v1:172.21.15.154:6809/1978475521] conn(0x7f0f98074a00 msgr2=0x7f0f98076e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f0fbb9ff700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:6808/1978475521,v1:172.21.15.154:6809/1978475521] conn(0x7f0f98074a00 0x7f0f98076e30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.030+0000 7f1da639b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da006a3e0 0x7f1da006a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da639b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da006a3e0 0x7f1da006a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58676/0 (socket says 172.21.15.132:58676) 2023-05-10T04:19:35.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da639b700 1 -- 172.21.15.132:0/2551128177 learned_addr learned my addr 172.21.15.132:0/2551128177 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da5b9a700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1da00cc6b0 0x7f1da0070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f9806adb0 msgr2=0x7f0f9806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f0fbb9ff700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f9806adb0 0x7f0f9806d260 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0fb41e74a0 tx=0x7f0fb0009040 comp rx=0 tx=0).stop 2023-05-10T04:19:35.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 msgr2=0x7f0fb4156310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f0fbb9ff700 1 --2- 172.21.15.132:0/2307503327 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0fb406a3e0 0x7f0fb4156310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400e9b0 tx=0x7f0fa400ecc0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f0fb9f9c700 1 -- 172.21.15.132:0/2307503327 reap_dead start 2023-05-10T04:19:35.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da639b700 1 -- 172.21.15.132:0/2551128177 >> v2:172.21.15.154:3300/0 conn(0x7f1da00cc6b0 msgr2=0x7f1da0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da639b700 1 --2- 172.21.15.132:0/2551128177 >> v2:172.21.15.154:3300/0 conn(0x7f1da00cc6b0 0x7f1da0070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da639b700 1 -- 172.21.15.132:0/2551128177 >> v1:172.21.15.154:6789/0 conn(0x7f1da00ccb20 legacy=0x7f1da0071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da639b700 1 -- 172.21.15.132:0/2551128177 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da006e5e0 con 0x7f1da006a3e0 2023-05-10T04:19:35.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da5399700 1 -- 172.21.15.132:0/2551128177 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078775792 0 0) 0x7f1da0160b70 con 0x7f1da00ccb20 2023-05-10T04:19:35.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 shutdown_connections 2023-05-10T04:19:35.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.032+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 >> 172.21.15.132:0/2307503327 conn(0x7f0fb40cf6e0 msgr2=0x7f0fb406de30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.031+0000 7f1da639b700 1 --2- 172.21.15.132:0/2551128177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da006a3e0 0x7f1da006a7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1d900098f0 tx=0x7f1d90009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8221cf8beafcb1d9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.032+0000 7f1da5399700 1 -- 172.21.15.132:0/2551128177 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90011830 con 0x7f1da006a3e0 2023-05-10T04:19:35.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.032+0000 7f1da5399700 1 -- 172.21.15.132:0/2551128177 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90011990 con 0x7f1da006a3e0 2023-05-10T04:19:35.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.032+0000 7f1da5399700 1 -- 172.21.15.132:0/2551128177 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90011d20 con 0x7f1da006a3e0 2023-05-10T04:19:35.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.032+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 shutdown_connections 2023-05-10T04:19:35.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.032+0000 7f0fbb9ff700 1 -- 172.21.15.132:0/2307503327 wait complete. 2023-05-10T04:19:35.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.032+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 --> [v2:172.21.15.132:6817/765017957,v1:172.21.15.132:6819/765017957] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4650002d40 con 0x7f46580749d0 2023-05-10T04:19:35.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7faf41dff700 1 -- 172.21.15.132:0/2982279785 wait complete. 2023-05-10T04:19:35.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.032+0000 7f42bbfff700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:6824/3626185395,v1:172.21.15.154:6825/3626185395] conn(0x7f42b0074be0 0x7f42b0077010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7f1da85ff700 1 -- 172.21.15.132:0/2551128177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da006a3e0 msgr2=0x7f1da006a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7f1da85ff700 1 --2- 172.21.15.132:0/2551128177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da006a3e0 0x7f1da006a7b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1d900098f0 tx=0x7f1d90009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:35.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7f1da85ff700 1 -- 172.21.15.132:0/2551128177 shutdown_connections 2023-05-10T04:19:35.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7f1da85ff700 1 --2- 172.21.15.132:0/2551128177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da006a3e0 0x7f1da006a7b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7f1da85ff700 1 --2- 172.21.15.132:0/2551128177 >> v2:172.21.15.154:3300/0 conn(0x7f1da00cc6b0 0x7f1da0070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7f1da85ff700 1 -- 172.21.15.132:0/2551128177 >> 172.21.15.132:0/2551128177 conn(0x7f1da00cf6e0 msgr2=0x7f1da00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7f1da85ff700 1 -- 172.21.15.132:0/2551128177 shutdown_connections 2023-05-10T04:19:35.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.033+0000 7f1da85ff700 1 -- 172.21.15.132:0/2551128177 wait complete. 2023-05-10T04:19:35.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.034+0000 7f46717fa700 1 -- 172.21.15.132:0/3285914717 <== osd.0 v2:172.21.15.132:6817/765017957 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4650002d40 con 0x7f46580749d0 2023-05-10T04:19:35.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.035+0000 7f1da85ff700 1 Processor -- start 2023-05-10T04:19:35.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.036+0000 7faf41dff700 1 Processor -- start 2023-05-10T04:19:35.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.036+0000 7f1da85ff700 1 -- start start 2023-05-10T04:19:35.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.037+0000 7f1da85ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da006a3e0 0x7f1da015fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da85ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da00cc6b0 0x7f1da01f9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da85ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da00ccb20 0x7f1da00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da85ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01fa5f0 con 0x7f1da00cc6b0 2023-05-10T04:19:35.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da85ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01fa8d0 con 0x7f1da006a3e0 2023-05-10T04:19:35.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da85ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da01fabb0 con 0x7f1da00ccb20 2023-05-10T04:19:35.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da639b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da006a3e0 0x7f1da015fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da5b9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da00cc6b0 0x7f1da01f9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da5b9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da00cc6b0 0x7f1da01f9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48142/0 (socket says 172.21.15.132:48142) 2023-05-10T04:19:35.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7f1da5b9a700 1 -- 172.21.15.132:0/1260271261 learned_addr learned my addr 172.21.15.132:0/1260271261 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7f1da6b9c700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da00ccb20 0x7f1da00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7f1da639b700 1 -- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da00ccb20 msgr2=0x7f1da00c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7f1da639b700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1da00ccb20 0x7f1da00c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7f1da639b700 1 -- 172.21.15.132:0/1260271261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da00cc6b0 msgr2=0x7f1da01f9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7f1da639b700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da00cc6b0 0x7f1da01f9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7f1da639b700 1 -- 172.21.15.132:0/1260271261 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d90009550 con 0x7f1da006a3e0 2023-05-10T04:19:35.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.037+0000 7faf41dff700 1 -- start start 2023-05-10T04:19:35.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7faf41dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf3c06c6c0 0x7faf3c1595d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7faf41dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf3c160fd0 0x7faf3c15a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7faf41dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c15add0 0x7faf3c147a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.038+0000 7faf41dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c156540 con 0x7faf3c160fd0 2023-05-10T04:19:35.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7faf41dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15b400 con 0x7faf3c06c6c0 2023-05-10T04:19:35.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7faf41dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf3c15b6e0 con 0x7faf3c15add0 2023-05-10T04:19:35.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7f1da639b700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da006a3e0 0x7f1da015fba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d90016000 tx=0x7f1d90004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.039+0000 7faf3b7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf3c06c6c0 0x7faf3c1595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.040+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c15add0 0x7faf3c147a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.040+0000 7faf3bfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c15add0 0x7faf3c147a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58696/0 (socket says 172.21.15.132:58696) 2023-05-10T04:19:35.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.040+0000 7faf3bfff700 1 -- 172.21.15.132:0/3133391325 learned_addr learned my addr 172.21.15.132:0/3133391325 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.041+0000 7faf3b7fe700 1 -- 172.21.15.132:0/3133391325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c15add0 msgr2=0x7faf3c147a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.041+0000 7faf3b7fe700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faf3c15add0 0x7faf3c147a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.041+0000 7faf3b7fe700 1 -- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf3c160fd0 msgr2=0x7faf3c15a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.041+0000 7faf3b7fe700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf3c160fd0 0x7faf3c15a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.041+0000 7faf3b7fe700 1 -- 172.21.15.132:0/3133391325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf2c0094a0 con 0x7faf3c06c6c0 2023-05-10T04:19:35.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6817/765017957,v1:172.21.15.132:6819/765017957] conn(0x7f46580749d0 msgr2=0x7f4658076e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7f467b1ff700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6817/765017957,v1:172.21.15.132:6819/765017957] conn(0x7f46580749d0 0x7f4658076e00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7faf3b7fe700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf3c06c6c0 0x7faf3c1595d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0b1650 tx=0x7faf2400eb70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.037+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 <== osd.4 v2:172.21.15.154:6824/3626185395 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f42b00776e0 con 0x7f42b0074be0 2023-05-10T04:19:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f465806ad00 msgr2=0x7f465806d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7f467b1ff700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f465806ad00 0x7f465806d1b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4664006b20 tx=0x7f4664006ab0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674160d20 msgr2=0x7f467415f150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7f467b1ff700 1 --2- 172.21.15.132:0/3285914717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4674160d20 0x7f467415f150 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f466c014000 tx=0x7f466c004ad0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.043+0000 7f467979c700 1 -- 172.21.15.132:0/3285914717 reap_dead start 2023-05-10T04:19:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24013680 con 0x7faf3c06c6c0 2023-05-10T04:19:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf240137e0 con 0x7faf3c06c6c0 2023-05-10T04:19:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf24013b50 con 0x7faf3c06c6c0 2023-05-10T04:19:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf3c161dd0 con 0x7faf3c06c6c0 2023-05-10T04:19:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.042+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf3c161af0 con 0x7faf3c06c6c0 2023-05-10T04:19:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.044+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faf20000fc0 con 0x7faf3c06c6c0 2023-05-10T04:19:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.044+0000 7f1d96ffd700 1 -- 172.21.15.132:0/1260271261 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90004510 con 0x7f1da006a3e0 2023-05-10T04:19:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.044+0000 7f1d96ffd700 1 -- 172.21.15.132:0/1260271261 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9001e070 con 0x7f1da006a3e0 2023-05-10T04:19:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.044+0000 7f1d96ffd700 1 -- 172.21.15.132:0/1260271261 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d900038e0 con 0x7f1da006a3e0 2023-05-10T04:19:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.044+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da0160240 con 0x7f1da006a3e0 2023-05-10T04:19:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.044+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da00cd0e0 con 0x7f1da006a3e0 2023-05-10T04:19:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.045+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 --> [v2:172.21.15.132:6802/3798938145,v1:172.21.15.132:6804/3798938145] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9988002d40 con 0x7f998c074980 2023-05-10T04:19:35.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.046+0000 7f99a57fa700 1 -- 172.21.15.132:0/2801811602 <== osd.2 v2:172.21.15.132:6802/3798938145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9988002d40 con 0x7f998c074980 2023-05-10T04:19:35.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.046+0000 7f1d96ffd700 1 -- 172.21.15.132:0/1260271261 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1d90003a40 con 0x7f1da006a3e0 2023-05-10T04:19:35.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faf24013cb0 con 0x7faf3c06c6c0 2023-05-10T04:19:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 shutdown_connections 2023-05-10T04:19:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 >> 172.21.15.132:0/3285914717 conn(0x7f46740cf720 msgr2=0x7f4674163a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6802/3798938145,v1:172.21.15.132:6804/3798938145] conn(0x7f998c074980 msgr2=0x7f998c076db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f99af1ff700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6802/3798938145,v1:172.21.15.132:6804/3798938145] conn(0x7f998c074980 0x7f998c076db0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f998c06ad30 msgr2=0x7f998c06d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f99af1ff700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f998c06ad30 0x7f998c06d1e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f99a80c1560 tx=0x7f999c01c040 comp rx=0 tx=0).stop 2023-05-10T04:19:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a80c20d0 msgr2=0x7f99a81f9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f99af1ff700 1 --2- 172.21.15.132:0/2801811602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a80c20d0 0x7f99a81f9a90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f999400c450 tx=0x7f999400c810 comp rx=0 tx=0).stop 2023-05-10T04:19:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7f99ad79c700 1 -- 172.21.15.132:0/2801811602 reap_dead start 2023-05-10T04:19:35.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7f1d96ffd700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1d8406ace0 0x7f1d8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7f1d96ffd700 1 -- 172.21.15.132:0/1260271261 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1d9008a580 con 0x7f1da006a3e0 2023-05-10T04:19:35.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7faf38ff9700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faf1c06ade0 0x7faf1c06d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7faf24089b20 con 0x7faf3c06c6c0 2023-05-10T04:19:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7faf38ff9700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6816/2431298337,v1:172.21.15.132:6818/2431298337] conn(0x7faf1c074ab0 0x7faf1c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 --> [v2:172.21.15.132:6816/2431298337,v1:172.21.15.132:6818/2431298337] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faf1c0775b0 con 0x7faf1c074ab0 2023-05-10T04:19:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf24089ed0 con 0x7faf3c06c6c0 2023-05-10T04:19:35.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.048+0000 7f1da5b9a700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1d8406ace0 0x7f1d8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.049+0000 7faf33fff700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faf1c06ade0 0x7faf1c06d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.049+0000 7faf3bfff700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6816/2431298337,v1:172.21.15.132:6818/2431298337] conn(0x7faf1c074ab0 0x7faf1c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.050+0000 7faf3bfff700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6816/2431298337,v1:172.21.15.132:6818/2431298337] conn(0x7faf1c074ab0 0x7faf1c076ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.050+0000 7f1da5b9a700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1d8406ace0 0x7f1d8406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1da00cae40 tx=0x7f1d9c00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.050+0000 7faf33fff700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faf1c06ade0 0x7faf1c06d290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0b1580 tx=0x7faf2c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.047+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 --> [v2:172.21.15.132:6800/3174697195,v1:172.21.15.132:6801/3174697195] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4d98005ca0 con 0x7f4d980015e0 2023-05-10T04:19:35.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.049+0000 7f4da67fc700 1 -- 172.21.15.132:0/3472644009 <== osd.1 v2:172.21.15.132:6800/3174697195 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4d98005ca0 con 0x7f4d980015e0 2023-05-10T04:19:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6800/3174697195,v1:172.21.15.132:6801/3174697195] conn(0x7f4d980015e0 msgr2=0x7f4d98003a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f4db7dff700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6800/3174697195,v1:172.21.15.132:6801/3174697195] conn(0x7f4d980015e0 0x7f4d98003a90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 shutdown_connections 2023-05-10T04:19:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 >> 172.21.15.132:0/2801811602 conn(0x7f99a80cf720 msgr2=0x7f99a80b3ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 shutdown_connections 2023-05-10T04:19:35.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f99af1ff700 1 -- 172.21.15.132:0/2801811602 wait complete. 2023-05-10T04:19:35.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 <== osd.3 v2:172.21.15.132:6816/2431298337 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7faf1c0775b0 con 0x7faf1c074ab0 2023-05-10T04:19:35.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4d9406adb0 msgr2=0x7f4d9406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f4db7dff700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4d9406adb0 0x7f4d9406d260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4da0009aa0 tx=0x7f4da0006f70 comp rx=0 tx=0).stop 2023-05-10T04:19:35.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4db00af490 msgr2=0x7f4db0159330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f4db7dff700 1 --2- 172.21.15.132:0/3472644009 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4db00af490 0x7f4db0159330 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4da8014000 tx=0x7f4da8001ad0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.051+0000 7f4db639c700 1 -- 172.21.15.132:0/3472644009 reap_dead start 2023-05-10T04:19:35.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.052+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 shutdown_connections 2023-05-10T04:19:35.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.052+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 >> 172.21.15.132:0/3472644009 conn(0x7f4db00cf6e0 msgr2=0x7f4db00c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.052+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 shutdown_connections 2023-05-10T04:19:35.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.052+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 shutdown_connections 2023-05-10T04:19:35.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.052+0000 7f4db7dff700 1 -- 172.21.15.132:0/3472644009 wait complete. 2023-05-10T04:19:35.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.052+0000 7f467b1ff700 1 -- 172.21.15.132:0/3285914717 wait complete. 2023-05-10T04:19:35.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.053+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 --> [v2:172.21.15.154:6800/2066983237,v1:172.21.15.154:6801/2066983237] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5404074430 con 0x7f53f00749b0 2023-05-10T04:19:35.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.054+0000 7f1da85ff700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:6816/745916634,v1:172.21.15.154:6817/745916634] conn(0x7f1da01f7040 0x7f1da01f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.054+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 --> [v2:172.21.15.154:6816/745916634,v1:172.21.15.154:6817/745916634] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1da006b140 con 0x7f1da01f7040 2023-05-10T04:19:35.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.055+0000 7f1da6b9c700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:6816/745916634,v1:172.21.15.154:6817/745916634] conn(0x7f1da01f7040 0x7f1da01f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.055+0000 7f1da6b9c700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:6816/745916634,v1:172.21.15.154:6817/745916634] conn(0x7f1da01f7040 0x7f1da01f7410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.056+0000 7f5400ff9700 1 -- 172.21.15.132:0/2998684061 <== osd.6 v2:172.21.15.154:6800/2066983237 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5404074430 con 0x7f53f00749b0 2023-05-10T04:19:35.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.056+0000 7f1d96ffd700 1 -- 172.21.15.132:0/1260271261 <== osd.7 v2:172.21.15.154:6816/745916634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1da006b140 con 0x7f1da01f7040 2023-05-10T04:19:35.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.058+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:6800/2066983237,v1:172.21.15.154:6801/2066983237] conn(0x7f53f00749b0 msgr2=0x7f53f0076de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.058+0000 7f540a3ff700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:6800/2066983237,v1:172.21.15.154:6801/2066983237] conn(0x7f53f00749b0 0x7f53f0076de0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.058+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f53f006ace0 msgr2=0x7f53f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.058+0000 7f540a3ff700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f53f006ace0 0x7f53f006d190 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009c40 tx=0x7f53f4008030 comp rx=0 tx=0).stop 2023-05-10T04:19:35.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.058+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5404160d20 msgr2=0x7f54040c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.058+0000 7f540a3ff700 1 --2- 172.21.15.132:0/2998684061 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5404160d20 0x7f54040c4690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f53fc00b9c0 tx=0x7f53fc00bcd0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.101 INFO:teuthology.orchestra.run.smithi132.stdout:55834574859 2023-05-10T04:19:35.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-10T04:19:35.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.062+0000 7f540899c700 1 -- 172.21.15.132:0/2998684061 reap_dead start 2023-05-10T04:19:35.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.062+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 shutdown_connections 2023-05-10T04:19:35.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.062+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 >> 172.21.15.132:0/2998684061 conn(0x7f54040cf720 msgr2=0x7f540406d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.068+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 shutdown_connections 2023-05-10T04:19:35.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.068+0000 7f540a3ff700 1 -- 172.21.15.132:0/2998684061 wait complete. 2023-05-10T04:19:35.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.072+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 --> [v2:172.21.15.154:6824/3626185395,v1:172.21.15.154:6825/3626185395] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42c40bf360 con 0x7f42b0074be0 2023-05-10T04:19:35.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.073+0000 7f42baffd700 1 -- 172.21.15.132:0/38022320 <== osd.4 v2:172.21.15.154:6824/3626185395 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f42c40bf360 con 0x7f42b0074be0 2023-05-10T04:19:35.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.075+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:6824/3626185395,v1:172.21.15.154:6825/3626185395] conn(0x7f42b0074be0 msgr2=0x7f42b0077010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.075+0000 7f42c8fff700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:6824/3626185395,v1:172.21.15.154:6825/3626185395] conn(0x7f42b0074be0 0x7f42b0077010 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.075+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f42b006af10 msgr2=0x7f42b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.075+0000 7f42c8fff700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f42b006af10 0x7f42b006d3c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f42c40b4850 tx=0x7f42ac009190 comp rx=0 tx=0).stop 2023-05-10T04:19:35.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.075+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42c4160fd0 msgr2=0x7f42c40bfd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.075+0000 7f42c8fff700 1 --2- 172.21.15.132:0/38022320 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f42c4160fd0 0x7f42c40bfd00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f42bc007e60 tx=0x7f42bc00e3c0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.076+0000 7f42c2d9d700 1 -- 172.21.15.132:0/38022320 reap_dead start 2023-05-10T04:19:35.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.076+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 shutdown_connections 2023-05-10T04:19:35.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.076+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 >> 172.21.15.132:0/38022320 conn(0x7f42c40cf6e0 msgr2=0x7f42c415eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.076+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 --> [v2:172.21.15.132:6816/2431298337,v1:172.21.15.132:6818/2431298337] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faf20002d40 con 0x7faf1c074ab0 2023-05-10T04:19:35.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.077+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 shutdown_connections 2023-05-10T04:19:35.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.077+0000 7f42c8fff700 1 -- 172.21.15.132:0/38022320 wait complete. 2023-05-10T04:19:35.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.081+0000 7faf38ff9700 1 -- 172.21.15.132:0/3133391325 <== osd.3 v2:172.21.15.132:6816/2431298337 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faf20002d40 con 0x7faf1c074ab0 2023-05-10T04:19:35.107 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2023-05-10T04:19:35.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-10T04:19:35.109 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2023-05-10T04:19:35.109 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-10T04:19:35.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6816/2431298337,v1:172.21.15.132:6818/2431298337] conn(0x7faf1c074ab0 msgr2=0x7faf1c076ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6816/2431298337,v1:172.21.15.132:6818/2431298337] conn(0x7faf1c074ab0 0x7faf1c076ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faf1c06ade0 msgr2=0x7faf1c06d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faf1c06ade0 0x7faf1c06d290 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0b1580 tx=0x7faf2c010000 comp rx=0 tx=0).stop 2023-05-10T04:19:35.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf3c06c6c0 msgr2=0x7faf3c1595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 --2- 172.21.15.132:0/3133391325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faf3c06c6c0 0x7faf3c1595d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faf3c0b1650 tx=0x7faf2400eb70 comp rx=0 tx=0).stop 2023-05-10T04:19:35.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf3bfff700 1 -- 172.21.15.132:0/3133391325 reap_dead start 2023-05-10T04:19:35.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 shutdown_connections 2023-05-10T04:19:35.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 >> 172.21.15.132:0/3133391325 conn(0x7faf3c0cf6e0 msgr2=0x7faf3c0b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.083+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 shutdown_connections 2023-05-10T04:19:35.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.084+0000 7faf41dff700 1 -- 172.21.15.132:0/3133391325 wait complete. 2023-05-10T04:19:35.112 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2023-05-10T04:19:35.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-10T04:19:35.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.085+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 --> [v2:172.21.15.154:6816/745916634,v1:172.21.15.154:6817/745916634] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1da0074430 con 0x7f1da01f7040 2023-05-10T04:19:35.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.091+0000 7f1d96ffd700 1 -- 172.21.15.132:0/1260271261 <== osd.7 v2:172.21.15.154:6816/745916634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1da0074430 con 0x7f1da01f7040 2023-05-10T04:19:35.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.091+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:6816/745916634,v1:172.21.15.154:6817/745916634] conn(0x7f1da01f7040 msgr2=0x7f1da01f7410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.091+0000 7f1da85ff700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:6816/745916634,v1:172.21.15.154:6817/745916634] conn(0x7f1da01f7040 0x7f1da01f7410 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.091+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1d8406ace0 msgr2=0x7f1d8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.091+0000 7f1da85ff700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1d8406ace0 0x7f1d8406d190 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1da00cae40 tx=0x7f1d9c00b040 comp rx=0 tx=0).stop 2023-05-10T04:19:35.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.091+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da006a3e0 msgr2=0x7f1da015fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.091+0000 7f1da85ff700 1 --2- 172.21.15.132:0/1260271261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1da006a3e0 0x7f1da015fba0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1d90016000 tx=0x7f1d90004750 comp rx=0 tx=0).stop 2023-05-10T04:19:35.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.092+0000 7f1da6b9c700 1 -- 172.21.15.132:0/1260271261 reap_dead start 2023-05-10T04:19:35.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.092+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 shutdown_connections 2023-05-10T04:19:35.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.092+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 >> 172.21.15.132:0/1260271261 conn(0x7f1da00cf6e0 msgr2=0x7f1da0070af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.092+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 shutdown_connections 2023-05-10T04:19:35.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.092+0000 7f1da85ff700 1 -- 172.21.15.132:0/1260271261 wait complete. 2023-05-10T04:19:35.116 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2023-05-10T04:19:35.117 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-10T04:19:35.117 INFO:teuthology.orchestra.run.smithi132.stdout:68719476747 2023-05-10T04:19:35.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-10T04:19:35.118 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2023-05-10T04:19:35.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-10T04:19:35.120 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2023-05-10T04:19:35.120 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-10T04:19:35.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.474+0000 7fdeee3ff700 1 Processor -- start 2023-05-10T04:19:35.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.474+0000 7fdeee3ff700 1 -- start start 2023-05-10T04:19:35.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.476+0000 7fdeee3ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdee80ad930 0x7fdee80add00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.476+0000 7fdeee3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8160fd0 0x7fdee806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.476+0000 7fdeee3ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee8070af0 con 0x7fdee806c6c0 2023-05-10T04:19:35.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.476+0000 7fdeee3ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee80ae240 con 0x7fdee80ad930 2023-05-10T04:19:35.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.476+0000 7fdeee3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee8161530 con 0x7fdee8160fd0 2023-05-10T04:19:35.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.479+0000 7fdeec99c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdee806c6c0 0x7fdee8070ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50762/0 (socket says 172.21.15.132:50762) 2023-05-10T04:19:35.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.479+0000 7fdeec99c700 1 -- 172.21.15.132:0/829943991 learned_addr learned my addr 172.21.15.132:0/829943991 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:35.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.480+0000 7fdee7fff700 1 --2- 172.21.15.132:0/829943991 >> v2:172.21.15.132:3300/0 conn(0x7fdee80ad930 0x7fdee80add00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.480+0000 7fdee7fff700 1 -- 172.21.15.132:0/829943991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8160fd0 msgr2=0x7fdee806a7a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-10T04:19:35.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.480+0000 7fdee7fff700 1 --2- 172.21.15.132:0/829943991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8160fd0 0x7fdee806a7a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.480+0000 7fdee7fff700 1 -- 172.21.15.132:0/829943991 >> v1:172.21.15.132:6789/0 conn(0x7fdee806c6c0 legacy=0x7fdee8070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.480+0000 7fdee7fff700 1 -- 172.21.15.132:0/829943991 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee8161810 con 0x7fdee80ad930 2023-05-10T04:19:35.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.481+0000 7fdee7fff700 1 --2- 172.21.15.132:0/829943991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee80ad930 0x7fdee80add00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fded8009840 tx=0x7fded8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a356d421a5a92aeb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.486+0000 7fdee6ffd700 1 -- 172.21.15.132:0/829943991 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8004230 con 0x7fdee80ad930 2023-05-10T04:19:35.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.486+0000 7fdee6ffd700 1 -- 172.21.15.132:0/829943991 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8004390 con 0x7fdee80ad930 2023-05-10T04:19:35.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.486+0000 7fdee6ffd700 1 -- 172.21.15.132:0/829943991 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80036a0 con 0x7fdee80ad930 2023-05-10T04:19:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.487+0000 7fdeee3ff700 1 -- 172.21.15.132:0/829943991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee80ad930 msgr2=0x7fdee80add00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.487+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/829943991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee80ad930 0x7fdee80add00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fded8009840 tx=0x7fded8009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.487+0000 7fdeee3ff700 1 -- 172.21.15.132:0/829943991 shutdown_connections 2023-05-10T04:19:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.487+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/829943991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee80ad930 0x7fdee80add00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.487+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/829943991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee8160fd0 0x7fdee806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.487+0000 7fdeee3ff700 1 -- 172.21.15.132:0/829943991 >> 172.21.15.132:0/829943991 conn(0x7fdee80cf6e0 msgr2=0x7fdee80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.488+0000 7fdeee3ff700 1 -- 172.21.15.132:0/829943991 shutdown_connections 2023-05-10T04:19:35.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.488+0000 7fdeee3ff700 1 -- 172.21.15.132:0/829943991 wait complete. 2023-05-10T04:19:35.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.492+0000 7fa75a3ff700 1 Processor -- start 2023-05-10T04:19:35.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.492+0000 7fa75a3ff700 1 -- start start 2023-05-10T04:19:35.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.494+0000 7fa75a3ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7540ad690 0x7fa7540adb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.494+0000 7fa75a3ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540cd1f0 con 0x7fa7540c19c0 2023-05-10T04:19:35.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.494+0000 7fa75a3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7540cc670 con 0x7fa754160d20 2023-05-10T04:19:35.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.494+0000 7fa75a3ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7541610f0 con 0x7fa7540ad690 2023-05-10T04:19:35.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.494+0000 7fa753fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa754160d20 0x7fa75406cb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:44212/0 (socket says 172.21.15.132:44212) 2023-05-10T04:19:35.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.494+0000 7fa753fff700 1 -- 172.21.15.132:0/262804897 learned_addr learned my addr 172.21.15.132:0/262804897 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:35.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.490+0000 7fdeee3ff700 1 Processor -- start 2023-05-10T04:19:35.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.490+0000 7fdeee3ff700 1 -- start start 2023-05-10T04:19:35.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.492+0000 7fdeee3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806c6c0 0x7fdee80c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.492+0000 7fdeee3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee80ad930 0x7fdee80b0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.492+0000 7fdeee3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8160fd0 0x7fdee80b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.492+0000 7fdeee3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80c2e70 con 0x7fdee8160fd0 2023-05-10T04:19:35.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.492+0000 7fdeee3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80c2260 con 0x7fdee806c6c0 2023-05-10T04:19:35.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.492+0000 7fdeee3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80c2540 con 0x7fdee80ad930 2023-05-10T04:19:35.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.493+0000 7fdee77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee80ad930 0x7fdee80b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.493+0000 7fdee77fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee80ad930 0x7fdee80b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58714/0 (socket says 172.21.15.132:58714) 2023-05-10T04:19:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.493+0000 7fdee77fe700 1 -- 172.21.15.132:0/359346045 learned_addr learned my addr 172.21.15.132:0/359346045 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.493+0000 7fdee7fff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806c6c0 0x7fdee80c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.493+0000 7fdeec99c700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8160fd0 0x7fdee80b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.496+0000 7fdee77fe700 1 -- 172.21.15.132:0/359346045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806c6c0 msgr2=0x7fdee80c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.496+0000 7fdee77fe700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806c6c0 0x7fdee80c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.496+0000 7fdee77fe700 1 -- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8160fd0 msgr2=0x7fdee80b0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.496+0000 7fdee77fe700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8160fd0 0x7fdee80b0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.496+0000 7fdee77fe700 1 -- 172.21.15.132:0/359346045 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded80094a0 con 0x7fdee80ad930 2023-05-10T04:19:35.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.496+0000 7f3a70bff700 1 Processor -- start 2023-05-10T04:19:35.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.497+0000 7fa7537fe700 1 --2- 172.21.15.132:0/262804897 >> v2:172.21.15.132:3300/0 conn(0x7fa7540ad690 0x7fa7540adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.498+0000 7fa7537fe700 1 -- 172.21.15.132:0/262804897 >> v1:172.21.15.154:6789/0 conn(0x7fa754160d20 legacy=0x7fa75406cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.498+0000 7fa7537fe700 1 -- 172.21.15.132:0/262804897 >> v1:172.21.15.132:6789/0 conn(0x7fa7540c19c0 legacy=0x7fa7540c1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.498+0000 7fa7537fe700 1 -- 172.21.15.132:0/262804897 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540cc950 con 0x7fa7540ad690 2023-05-10T04:19:35.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.497+0000 7f79f87ff700 1 Processor -- start 2023-05-10T04:19:35.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.497+0000 7f79f87ff700 1 -- start start 2023-05-10T04:19:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.496+0000 7f3a70bff700 1 -- start start 2023-05-10T04:19:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.498+0000 7f3a70bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c160d20 0x7f3a6c06cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.498+0000 7f3a70bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a6c0ad690 0x7f3a6c0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.498+0000 7f3a70bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a6c0cd1f0 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.498+0000 7f3a70bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a6c1610f0 con 0x7f3a6c0ad690 2023-05-10T04:19:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.498+0000 7f3a70bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0cc670 con 0x7f3a6c160d20 2023-05-10T04:19:35.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.496+0000 7fdeec99c700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8160fd0 0x7fdee80b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:35.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.497+0000 7fdee77fe700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee80ad930 0x7fdee80b0550 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdedc02d480 tx=0x7fdedc02d790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.499+0000 7fa7537fe700 1 --2- 172.21.15.132:0/262804897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540ad690 0x7fa7540adb10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa744009820 tx=0x7fa744009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546a1b2ab294389e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.499+0000 7f79f87ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79f00cbc20 0x7f79f00add70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.499+0000 7f79f87ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f015cdb0 0x7f79f00cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.499+0000 7f79f87ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f79f00c90c0 0x7f79f006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.499+0000 7f79f87ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f0158c80 con 0x7f79f00cbc20 2023-05-10T04:19:35.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.499+0000 7f79f87ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79f00cd5b0 con 0x7f79f00c90c0 2023-05-10T04:19:35.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.499+0000 7f79f87ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00cb230 con 0x7f79f015cdb0 2023-05-10T04:19:35.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f79f5d9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f015cdb0 0x7f79f00cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f79f5d9a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f015cdb0 0x7f79f00cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58722/0 (socket says 172.21.15.132:58722) 2023-05-10T04:19:35.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f79f5d9a700 1 -- 172.21.15.132:0/1704039329 learned_addr learned my addr 172.21.15.132:0/1704039329 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7fdee4ff9700 1 -- 172.21.15.132:0/359346045 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc02de90 con 0x7fdee80ad930 2023-05-10T04:19:35.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7fdee4ff9700 1 -- 172.21.15.132:0/359346045 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc033640 con 0x7fdee80ad930 2023-05-10T04:19:35.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7fdee4ff9700 1 -- 172.21.15.132:0/359346045 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc0339f0 con 0x7fdee80ad930 2023-05-10T04:19:35.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee8161dd0 con 0x7fdee80ad930 2023-05-10T04:19:35.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f79f6d9c700 1 --2- 172.21.15.132:0/1704039329 >> v2:172.21.15.154:3300/0 conn(0x7f79f00c90c0 0x7f79f006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f79f659b700 1 --2- 172.21.15.132:0/1704039329 >> v2:172.21.15.132:3300/0 conn(0x7f79f00cbc20 0x7f79f00add70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f79f6d9c700 1 -- 172.21.15.132:0/1704039329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f015cdb0 msgr2=0x7f79f00cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f79f6d9c700 1 --2- 172.21.15.132:0/1704039329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f015cdb0 0x7f79f00cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f79f6d9c700 1 -- 172.21.15.132:0/1704039329 >> v2:172.21.15.132:3300/0 conn(0x7f79f00cbc20 msgr2=0x7f79f00add70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f79f6d9c700 1 --2- 172.21.15.132:0/1704039329 >> v2:172.21.15.132:3300/0 conn(0x7f79f00cbc20 0x7f79f00add70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f79f6d9c700 1 -- 172.21.15.132:0/1704039329 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79f00ccff0 con 0x7f79f00c90c0 2023-05-10T04:19:35.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f79f659b700 1 --2- 172.21.15.132:0/1704039329 >> v2:172.21.15.132:3300/0 conn(0x7f79f00cbc20 0x7f79f00add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:35.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a6a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c160d20 0x7f3a6c06cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a6a59c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c160d20 0x7f3a6c06cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58720/0 (socket says 172.21.15.132:58720) 2023-05-10T04:19:35.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a6a59c700 1 -- 172.21.15.132:0/4009900119 learned_addr learned my addr 172.21.15.132:0/4009900119 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a69d9b700 1 --2- 172.21.15.132:0/4009900119 >> v2:172.21.15.154:3300/0 conn(0x7f3a6c0ad690 0x7f3a6c0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a6a59c700 1 -- 172.21.15.132:0/4009900119 >> v2:172.21.15.154:3300/0 conn(0x7f3a6c0ad690 msgr2=0x7f3a6c0adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a6a59c700 1 --2- 172.21.15.132:0/4009900119 >> v2:172.21.15.154:3300/0 conn(0x7f3a6c0ad690 0x7f3a6c0adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a6a59c700 1 -- 172.21.15.132:0/4009900119 >> v1:172.21.15.132:6789/0 conn(0x7f3a6c0c19c0 legacy=0x7f3a6c0c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a6a59c700 1 -- 172.21.15.132:0/4009900119 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a6c0cc950 con 0x7f3a6c160d20 2023-05-10T04:19:35.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7f3a69d9b700 1 --2- 172.21.15.132:0/4009900119 >> v2:172.21.15.154:3300/0 conn(0x7f3a6c0ad690 0x7f3a6c0adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:35.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f3a6a59c700 1 --2- 172.21.15.132:0/4009900119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c160d20 0x7f3a6c06cb90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0098f0 tx=0x7f3a5c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=614b303699697f4c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.500+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee8161af0 con 0x7fdee80ad930 2023-05-10T04:19:35.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f79f6d9c700 1 --2- 172.21.15.132:0/1704039329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f006a3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f79f00cc6d0 tx=0x7f79e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a158c4991069357 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f3a6959a700 1 -- 172.21.15.132:0/4009900119 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00b8a0 con 0x7f3a6c160d20 2023-05-10T04:19:35.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f3a6959a700 1 -- 172.21.15.132:0/4009900119 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c00ba00 con 0x7f3a6c160d20 2023-05-10T04:19:35.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.501+0000 7f3a6959a700 1 -- 172.21.15.132:0/4009900119 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5c00bd90 con 0x7f3a6c160d20 2023-05-10T04:19:35.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.502+0000 7fa24a9ff700 1 Processor -- start 2023-05-10T04:19:35.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.502+0000 7fa24a9ff700 1 -- start start 2023-05-10T04:19:35.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.502+0000 7fa752ffd700 1 -- 172.21.15.132:0/262804897 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744005e30 con 0x7fa7540ad690 2023-05-10T04:19:35.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.502+0000 7fa752ffd700 1 -- 172.21.15.132:0/262804897 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744006030 con 0x7fa7540ad690 2023-05-10T04:19:35.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.502+0000 7fa752ffd700 1 -- 172.21.15.132:0/262804897 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440063c0 con 0x7fa7540ad690 2023-05-10T04:19:35.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7fa75a3ff700 1 -- 172.21.15.132:0/262804897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540ad690 msgr2=0x7fa7540adb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7fa75a3ff700 1 --2- 172.21.15.132:0/262804897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540ad690 0x7fa7540adb10 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa744009820 tx=0x7fa744009b30 comp rx=0 tx=0).stop 2023-05-10T04:19:35.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f79f5599700 1 -- 172.21.15.132:0/1704039329 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e800e070 con 0x7f79f00c90c0 2023-05-10T04:19:35.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f79f5599700 1 -- 172.21.15.132:0/1704039329 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e800bb20 con 0x7f79f00c90c0 2023-05-10T04:19:35.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f79f5599700 1 -- 172.21.15.132:0/1704039329 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e8012430 con 0x7f79f00c90c0 2023-05-10T04:19:35.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f3a70bff700 1 -- 172.21.15.132:0/4009900119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c160d20 msgr2=0x7f3a6c06cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f3a70bff700 1 --2- 172.21.15.132:0/4009900119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c160d20 0x7f3a6c06cb90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0098f0 tx=0x7f3a5c009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:35.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f3a70bff700 1 -- 172.21.15.132:0/4009900119 shutdown_connections 2023-05-10T04:19:35.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f3a70bff700 1 --2- 172.21.15.132:0/4009900119 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c160d20 0x7f3a6c06cb90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f3a70bff700 1 --2- 172.21.15.132:0/4009900119 >> v2:172.21.15.154:3300/0 conn(0x7f3a6c0ad690 0x7f3a6c0adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7f3a70bff700 1 -- 172.21.15.132:0/4009900119 >> 172.21.15.132:0/4009900119 conn(0x7f3a6c0cf720 msgr2=0x7f3a6c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.504+0000 7f79f87ff700 1 -- 172.21.15.132:0/1704039329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 msgr2=0x7f79f006a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.504+0000 7f79f87ff700 1 --2- 172.21.15.132:0/1704039329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f006a3e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f79f00cc6d0 tx=0x7f79e800b330 comp rx=0 tx=0).stop 2023-05-10T04:19:35.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.504+0000 7f3a70bff700 1 -- 172.21.15.132:0/4009900119 shutdown_connections 2023-05-10T04:19:35.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.504+0000 7f3a70bff700 1 -- 172.21.15.132:0/4009900119 wait complete. 2023-05-10T04:19:35.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.505+0000 7fa24a9ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa24415c590 0x7fa244160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.505+0000 7fa24a9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa2440cf010 0x7fa2440cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.505+0000 7fa24a9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2440cd520 con 0x7fa2440cfd80 2023-05-10T04:19:35.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.505+0000 7fa24a9ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2440d2640 con 0x7fa24415c590 2023-05-10T04:19:35.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.505+0000 7fa24a9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2441610d0 con 0x7fa2440cf010 2023-05-10T04:19:35.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.506+0000 7fa2437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa2440cf010 0x7fa2440cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.506+0000 7fa2437fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa2440cf010 0x7fa2440cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:45070/0 (socket says 172.21.15.132:45070) 2023-05-10T04:19:35.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.506+0000 7fa2437fe700 1 -- 172.21.15.132:0/261110678 learned_addr learned my addr 172.21.15.132:0/261110678 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.506+0000 7fa2437fe700 1 -- 172.21.15.132:0/261110678 >> v2:172.21.15.132:3300/0 conn(0x7fa24415c590 msgr2=0x7fa244160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.506+0000 7fa2437fe700 1 --2- 172.21.15.132:0/261110678 >> v2:172.21.15.132:3300/0 conn(0x7fa24415c590 0x7fa244160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.506+0000 7fa2437fe700 1 -- 172.21.15.132:0/261110678 >> v1:172.21.15.132:6789/0 conn(0x7fa2440cfd80 legacy=0x7fa2440d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.506+0000 7fa2437fe700 1 -- 172.21.15.132:0/261110678 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2440b23c0 con 0x7fa2440cf010 2023-05-10T04:19:35.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.503+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee806ace0 con 0x7fdee80ad930 2023-05-10T04:19:35.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.506+0000 7fdee4ff9700 1 -- 172.21.15.132:0/359346045 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdedc033b50 con 0x7fdee80ad930 2023-05-10T04:19:35.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7fa2437fe700 1 --2- 172.21.15.132:0/261110678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cf010 0x7fa2440cf840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa2440b4ee0 tx=0x7fa234009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=255abbdd3a5d0e7f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7fa75a3ff700 1 -- 172.21.15.132:0/262804897 shutdown_connections 2023-05-10T04:19:35.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7fa75a3ff700 1 --2- 172.21.15.132:0/262804897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540ad690 0x7fa7540adb10 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7fa75a3ff700 1 -- 172.21.15.132:0/262804897 >> 172.21.15.132:0/262804897 conn(0x7fa7540cf720 msgr2=0x7fa7540cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7f3a70bff700 1 Processor -- start 2023-05-10T04:19:35.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7fa242ffd700 1 -- 172.21.15.132:0/261110678 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa234004230 con 0x7fa2440cf010 2023-05-10T04:19:35.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7fa242ffd700 1 -- 172.21.15.132:0/261110678 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa234004390 con 0x7fa2440cf010 2023-05-10T04:19:35.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7fa242ffd700 1 -- 172.21.15.132:0/261110678 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2340036a0 con 0x7fa2440cf010 2023-05-10T04:19:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.507+0000 7f3a70bff700 1 -- start start 2023-05-10T04:19:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7fdee4ff9700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fded406adb0 0x7fded406d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7fdee4ff9700 1 -- 172.21.15.132:0/359346045 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdedc0ab9c0 con 0x7fdee80ad930 2023-05-10T04:19:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7fdee7fff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fded406adb0 0x7fded406d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7fa24a9ff700 1 -- 172.21.15.132:0/261110678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cf010 msgr2=0x7fa2440cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/261110678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cf010 0x7fa2440cf840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa2440b4ee0 tx=0x7fa234009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7fa75a3ff700 1 -- 172.21.15.132:0/262804897 shutdown_connections 2023-05-10T04:19:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7f79f87ff700 1 -- 172.21.15.132:0/1704039329 shutdown_connections 2023-05-10T04:19:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7f79f87ff700 1 --2- 172.21.15.132:0/1704039329 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f006a3e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7f79f87ff700 1 --2- 172.21.15.132:0/1704039329 >> v2:172.21.15.132:3300/0 conn(0x7f79f00cbc20 0x7f79f00add70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7f79f87ff700 1 --2- 172.21.15.132:0/1704039329 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f015cdb0 0x7f79f00cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.508+0000 7f79f87ff700 1 -- 172.21.15.132:0/1704039329 >> 172.21.15.132:0/1704039329 conn(0x7f79f00cf6e0 msgr2=0x7f79f00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7f3a70bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c0ad690 0x7f3a6c0c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7f3a70bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6c0c19c0 0x7f3a6c150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7f3a70bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a6c160d20 0x7f3a6c0c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7f3a70bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b0e00 con 0x7f3a6c160d20 2023-05-10T04:19:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7f3a70bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b10e0 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7f3a70bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a6c0b13c0 con 0x7f3a6c0ad690 2023-05-10T04:19:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7f517d1ff700 1 Processor -- start 2023-05-10T04:19:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7fa75a3ff700 1 -- 172.21.15.132:0/262804897 wait complete. 2023-05-10T04:19:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7fa24a9ff700 1 -- 172.21.15.132:0/261110678 shutdown_connections 2023-05-10T04:19:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/261110678 >> v2:172.21.15.132:3300/0 conn(0x7fa24415c590 0x7fa244160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/261110678 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cf010 0x7fa2440cf840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7fa24a9ff700 1 -- 172.21.15.132:0/261110678 >> 172.21.15.132:0/261110678 conn(0x7fa244071b10 msgr2=0x7fa244071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7fdee7fff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fded406adb0 0x7fded406d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fded8000c00 tx=0x7fded8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7fdee4ff9700 1 -- 172.21.15.132:0/359346045 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdedc0752d0 con 0x7fdee80ad930 2023-05-10T04:19:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a69d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6c0c19c0 0x7f3a6c150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a69d9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6c0c19c0 0x7f3a6c150440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:45076/0 (socket says 172.21.15.132:45076) 2023-05-10T04:19:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f79f87ff700 1 -- 172.21.15.132:0/1704039329 shutdown_connections 2023-05-10T04:19:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a69d9b700 1 -- 172.21.15.132:0/113424177 learned_addr learned my addr 172.21.15.132:0/113424177 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7fab7a9ff700 1 Processor -- start 2023-05-10T04:19:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7fab7a9ff700 1 -- start start 2023-05-10T04:19:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7fa24a9ff700 1 -- 172.21.15.132:0/261110678 shutdown_connections 2023-05-10T04:19:35.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a6ad9d700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a6c160d20 0x7f3a6c0c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a69d9b700 1 -- 172.21.15.132:0/113424177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c0ad690 msgr2=0x7f3a6c0c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a69d9b700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c0ad690 0x7f3a6c0c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a69d9b700 1 -- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a6c160d20 msgr2=0x7f3a6c0c2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a69d9b700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a6c160d20 0x7f3a6c0c2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a69d9b700 1 -- 172.21.15.132:0/113424177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c009550 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.510+0000 7f3a6ad9d700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a6c160d20 0x7f3a6c0c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:35.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.509+0000 7f517d1ff700 1 -- start start 2023-05-10T04:19:35.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7fa75a3ff700 1 Processor -- start 2023-05-10T04:19:35.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fa75a3ff700 1 -- start start 2023-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7fa75a3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7540ad690 0x7fa7541f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7fa75a3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540c19c0 0x7fa7541600d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7fa75a3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa754160d20 0x7fa7540bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7fa75a3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540b3620 con 0x7fa7540c19c0 2023-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7fa75a3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540bdb10 con 0x7fa754160d20 2023-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7fa75a3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7540bddf0 con 0x7fa7540ad690 2023-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fa75899c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa754160d20 0x7fa7540bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540c19c0 0x7fa7541600d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fa7537fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540c19c0 0x7fa7541600d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48244/0 (socket says 172.21.15.132:48244) 2023-05-10T04:19:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fa7537fe700 1 -- 172.21.15.132:0/2874375919 learned_addr learned my addr 172.21.15.132:0/2874375919 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fa753fff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7540ad690 0x7fa7541f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fa7537fe700 1 -- 172.21.15.132:0/2874375919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7540ad690 msgr2=0x7fa7541f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fa7537fe700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7540ad690 0x7fa7541f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fa7537fe700 1 -- 172.21.15.132:0/2874375919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa754160d20 msgr2=0x7fa7540bf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fa7537fe700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa754160d20 0x7fa7540bf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fa7537fe700 1 -- 172.21.15.132:0/2874375919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009430 con 0x7fa7540c19c0 2023-05-10T04:19:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f79f87ff700 1 -- 172.21.15.132:0/1704039329 wait complete. 2023-05-10T04:19:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7f79f87ff700 1 Processor -- start 2023-05-10T04:19:35.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.511+0000 7f3a69d9b700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6c0c19c0 0x7f3a6c150440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000e810 tx=0x7f3a6000ebd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f3a5affd700 1 -- 172.21.15.132:0/113424177 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60005c20 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f3a5affd700 1 -- 172.21.15.132:0/113424177 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a60005d80 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f3a5affd700 1 -- 172.21.15.132:0/113424177 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a60006250 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a6c0ccf10 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a6c0ccc30 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7fab7a9ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab740cbff0 0x7fab740cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7fab7a9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab74159050 con 0x7fab740cd690 2023-05-10T04:19:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7fab7a9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab740ca890 con 0x7fab740cbc20 2023-05-10T04:19:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7fab7a9ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab740ca5b0 con 0x7fab740cbff0 2023-05-10T04:19:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7fab73fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fab740cbc20 0x7fab74158940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:44220/0 (socket says 172.21.15.132:44220) 2023-05-10T04:19:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7fab73fff700 1 -- 172.21.15.132:0/874408695 learned_addr learned my addr 172.21.15.132:0/874408695 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2518225453 0 0) 0x7fab740ca890 con 0x7fab740cbc20 2023-05-10T04:19:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab5c0035b0 con 0x7fab740cbc20 2023-05-10T04:19:35.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590226281 0 0) 0x7fab6c001490 con 0x7fab740cd690 2023-05-10T04:19:35.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab740ca890 con 0x7fab740cd690 2023-05-10T04:19:35.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 <== mon.1 v1:172.21.15.154:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1790666470 0 0) 0x7fab5c0035b0 con 0x7fab740cbc20 2023-05-10T04:19:35.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 >> v2:172.21.15.132:3300/0 conn(0x7fab740cbff0 msgr2=0x7fab740cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 --2- 172.21.15.132:0/874408695 >> v2:172.21.15.132:3300/0 conn(0x7fab740cbff0 0x7fab740cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 >> v1:172.21.15.132:6789/0 conn(0x7fab740cd690 legacy=0x7fab7406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 --> v1:172.21.15.154:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740cc670 con 0x7fab740cbc20 2023-05-10T04:19:35.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 <== mon.1 v1:172.21.15.154:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fab64001670 con 0x7fab740cbc20 2023-05-10T04:19:35.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 >> v1:172.21.15.154:6789/0 conn(0x7fab740cbc20 legacy=0x7fab74158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 --2- 172.21.15.132:0/874408695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c003b90 0x7fab5c003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 --2- 172.21.15.132:0/874408695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c004850 0x7fab5c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 --2- 172.21.15.132:0/874408695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5c005250 0x7fab5c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab6c001740 con 0x7fab5c003b90 2023-05-10T04:19:35.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740ca5b0 con 0x7fab5c005250 2023-05-10T04:19:35.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab5c00c160 con 0x7fab5c004850 2023-05-10T04:19:35.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7fab73fff700 1 --2- 172.21.15.132:0/874408695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c003b90 0x7fab5c003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fab73fff700 1 -- 172.21.15.132:0/874408695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c004850 msgr2=0x7fab5c004cc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-10T04:19:35.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fab73fff700 1 --2- 172.21.15.132:0/874408695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab5c004850 0x7fab5c004cc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fab73fff700 1 -- 172.21.15.132:0/874408695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5c005250 msgr2=0x7fab5c00ba10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-10T04:19:35.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fab73fff700 1 --2- 172.21.15.132:0/874408695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab5c005250 0x7fab5c00ba10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fab73fff700 1 -- 172.21.15.132:0/874408695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740cc670 con 0x7fab5c003b90 2023-05-10T04:19:35.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7fab73fff700 1 --2- 172.21.15.132:0/874408695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c003b90 0x7fab5c003f60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c2c0 tx=0x7fab5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61efd72d8a72285b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6400cd80 con 0x7fab5c003b90 2023-05-10T04:19:35.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab64005960 con 0x7fab5c003b90 2023-05-10T04:19:35.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fab72ffd700 1 -- 172.21.15.132:0/874408695 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64005cf0 con 0x7fab5c003b90 2023-05-10T04:19:35.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7fab7a9ff700 1 -- 172.21.15.132:0/874408695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c003b90 msgr2=0x7fab5c003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.518+0000 7fab7a9ff700 1 --2- 172.21.15.132:0/874408695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5c003b90 0x7fab5c003f60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c2c0 tx=0x7fab5c005880 comp rx=0 tx=0).stop 2023-05-10T04:19:35.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.511+0000 7fa24a9ff700 1 -- 172.21.15.132:0/261110678 wait complete. 2023-05-10T04:19:35.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7fa24a9ff700 1 Processor -- start 2023-05-10T04:19:35.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.511+0000 7f517d1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5178160d20 0x7f517806cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.511+0000 7f517d1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f51780c20d0 0x7f51780adb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.511+0000 7f517d1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51780cd1f0 con 0x7f51780ad690 2023-05-10T04:19:35.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.511+0000 7f517d1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51781610f0 con 0x7f51780c20d0 2023-05-10T04:19:35.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.511+0000 7f517d1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51780cc670 con 0x7f5178160d20 2023-05-10T04:19:35.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f5176d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5178160d20 0x7f517806cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f5176d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5178160d20 0x7f517806cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58738/0 (socket says 172.21.15.132:58738) 2023-05-10T04:19:35.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f5176d9d700 1 -- 172.21.15.132:0/1219572606 learned_addr learned my addr 172.21.15.132:0/1219572606 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f517759e700 1 --2- 172.21.15.132:0/1219572606 >> v2:172.21.15.154:3300/0 conn(0x7f51780c20d0 0x7f51780adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f517759e700 1 -- 172.21.15.132:0/1219572606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5178160d20 msgr2=0x7f517806cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.512+0000 7f517759e700 1 --2- 172.21.15.132:0/1219572606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5178160d20 0x7f517806cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7f517759e700 1 -- 172.21.15.132:0/1219572606 >> v1:172.21.15.154:6789/0 conn(0x7f51780ad690 legacy=0x7f51780c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7f517759e700 1 -- 172.21.15.132:0/1219572606 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51780cc950 con 0x7f51780c20d0 2023-05-10T04:19:35.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7f517759e700 1 --2- 172.21.15.132:0/1219572606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51780c20d0 0x7f51780adb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5170009d90 tx=0x7f517000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b95ca01f7ab932ee server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7f5175d9b700 1 -- 172.21.15.132:0/1219572606 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f517000e070 con 0x7f51780c20d0 2023-05-10T04:19:35.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7f5175d9b700 1 -- 172.21.15.132:0/1219572606 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517000bb20 con 0x7f51780c20d0 2023-05-10T04:19:35.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.513+0000 7f5175d9b700 1 -- 172.21.15.132:0/1219572606 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170012430 con 0x7f51780c20d0 2023-05-10T04:19:35.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7f517d1ff700 1 -- 172.21.15.132:0/1219572606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51780c20d0 msgr2=0x7f51780adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7f517d1ff700 1 --2- 172.21.15.132:0/1219572606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51780c20d0 0x7f51780adb30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5170009d90 tx=0x7f517000b330 comp rx=0 tx=0).stop 2023-05-10T04:19:35.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7f517d1ff700 1 -- 172.21.15.132:0/1219572606 shutdown_connections 2023-05-10T04:19:35.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7f517d1ff700 1 --2- 172.21.15.132:0/1219572606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f51780c20d0 0x7f51780adb30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7f517d1ff700 1 --2- 172.21.15.132:0/1219572606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5178160d20 0x7f517806cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7f517d1ff700 1 -- 172.21.15.132:0/1219572606 >> 172.21.15.132:0/1219572606 conn(0x7f51780cf720 msgr2=0x7f51780cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7f517d1ff700 1 -- 172.21.15.132:0/1219572606 shutdown_connections 2023-05-10T04:19:35.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.515+0000 7f517d1ff700 1 -- 172.21.15.132:0/1219572606 wait complete. 2023-05-10T04:19:35.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7f517d1ff700 1 Processor -- start 2023-05-10T04:19:35.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7f27ea7ff700 1 Processor -- start 2023-05-10T04:19:35.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.514+0000 7f27ea7ff700 1 -- start start 2023-05-10T04:19:35.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7f27ea7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40adf70 0x7f27e40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7f27ea7ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f27e415cf10 0x7f27e406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7f27ea7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40cc9e0 con 0x7f27e40cd760 2023-05-10T04:19:35.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7f27ea7ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e415de20 con 0x7f27e415cf10 2023-05-10T04:19:35.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.516+0000 7f27ea7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e415d860 con 0x7f27e40adf70 2023-05-10T04:19:35.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7f27e37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40adf70 0x7f27e40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7f27e37fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40adf70 0x7f27e40cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58778/0 (socket says 172.21.15.132:58778) 2023-05-10T04:19:35.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7f27e37fe700 1 -- 172.21.15.132:0/1376517523 learned_addr learned my addr 172.21.15.132:0/1376517523 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7f27e37fe700 1 -- 172.21.15.132:0/1376517523 >> v2:172.21.15.132:3300/0 conn(0x7f27e415cf10 msgr2=0x7f27e406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7f27e37fe700 1 --2- 172.21.15.132:0/1376517523 >> v2:172.21.15.132:3300/0 conn(0x7f27e415cf10 0x7f27e406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7f27e37fe700 1 -- 172.21.15.132:0/1376517523 >> v1:172.21.15.132:6789/0 conn(0x7f27e40cd760 legacy=0x7f27e40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:35.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.518+0000 7f27e37fe700 1 -- 172.21.15.132:0/1376517523 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e415db40 con 0x7f27e40adf70 2023-05-10T04:19:35.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.518+0000 7fab78f9c700 1 -- 172.21.15.132:0/874408695 reap_dead start 2023-05-10T04:19:35.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.518+0000 7f27e37fe700 1 --2- 172.21.15.132:0/1376517523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40adf70 0x7f27e40cce70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f27d8006fd0 tx=0x7f27d8009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a21ccd81999c59b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.518+0000 7fab78f9c700 1 -- 172.21.15.132:0/874408695 reap_dead start 2023-05-10T04:19:35.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.518+0000 7fab7a9ff700 1 -- 172.21.15.132:0/874408695 shutdown_connections 2023-05-10T04:19:35.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.518+0000 7fab7a9ff700 1 -- 172.21.15.132:0/874408695 >> 172.21.15.132:0/874408695 conn(0x7fab740cf720 msgr2=0x7fab740cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7fab7a9ff700 1 -- 172.21.15.132:0/874408695 shutdown_connections 2023-05-10T04:19:35.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7fab7a9ff700 1 -- 172.21.15.132:0/874408695 wait complete. 2023-05-10T04:19:35.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.518+0000 7f517d1ff700 1 -- start start 2023-05-10T04:19:35.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7fa7537fe700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540c19c0 0x7fa7541600d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa744012000 tx=0x7fa744004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f27e2ffd700 1 -- 172.21.15.132:0/1376517523 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8005e30 con 0x7f27e40adf70 2023-05-10T04:19:35.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f27e2ffd700 1 -- 172.21.15.132:0/1376517523 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d8006030 con 0x7f27e40adf70 2023-05-10T04:19:35.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f27e2ffd700 1 -- 172.21.15.132:0/1376517523 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80063c0 con 0x7f27e40adf70 2023-05-10T04:19:35.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f27ea7ff700 1 -- 172.21.15.132:0/1376517523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40adf70 msgr2=0x7f27e40cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/1376517523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40adf70 0x7f27e40cce70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f27d8006fd0 tx=0x7f27d8009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f517d1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51780ad690 0x7f51780c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f517d1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51780c20d0 0x7f5178150140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f517d1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5178160d20 0x7f517814a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f517d1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51780c4690 con 0x7f51780c20d0 2023-05-10T04:19:35.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f517d1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f517814ac40 con 0x7f5178160d20 2023-05-10T04:19:35.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f517d1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f517814d320 con 0x7f51780ad690 2023-05-10T04:19:35.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f5176d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51780ad690 0x7f51780c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f5176d9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51780ad690 0x7f51780c2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58788/0 (socket says 172.21.15.132:58788) 2023-05-10T04:19:35.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f5176d9d700 1 -- 172.21.15.132:0/2879374189 learned_addr learned my addr 172.21.15.132:0/2879374189 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f517659c700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51780c20d0 0x7f5178150140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f517759e700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5178160d20 0x7f517814a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7fab7a9ff700 1 Processor -- start 2023-05-10T04:19:35.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7fa24a9ff700 1 -- start start 2023-05-10T04:19:35.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7fa24a9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440cf010 0x7fa2440b8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7fa24a9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cfd80 0x7fa24414e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7fa24a9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24415c590 0x7fa24414eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7fa24a9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24406d700 con 0x7fa2440cf010 2023-05-10T04:19:35.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7fa24a9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440c6a00 con 0x7fa2440cfd80 2023-05-10T04:19:35.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7fa24a9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2440c72a0 con 0x7fa24415c590 2023-05-10T04:19:35.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7f517759e700 1 -- 172.21.15.132:0/2879374189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51780ad690 msgr2=0x7f51780c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7f517759e700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51780ad690 0x7f51780c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7fab7a9ff700 1 -- start start 2023-05-10T04:19:35.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7f517759e700 1 -- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51780c20d0 msgr2=0x7f5178150140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7f517759e700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51780c20d0 0x7f5178150140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7f517759e700 1 -- 172.21.15.132:0/2879374189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5170009a70 con 0x7f5178160d20 2023-05-10T04:19:35.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.517+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a500052f0 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.519+0000 7f3a5affd700 1 -- 172.21.15.132:0/113424177 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a60004020 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.520+0000 7f3a5affd700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a4c06adb0 0x7f3a4c06d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7f3a5affd700 1 -- 172.21.15.132:0/113424177 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a600892b0 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa243fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440cf010 0x7fa2440b8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa248f9c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24415c590 0x7fa24414eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.521+0000 7f517759e700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5178160d20 0x7f517814a700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5170016000 tx=0x7f5170004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa243fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440cf010 0x7fa2440b8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48274/0 (socket says 172.21.15.132:48274) 2023-05-10T04:19:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa243fff700 1 -- 172.21.15.132:0/3826758601 learned_addr learned my addr 172.21.15.132:0/3826758601 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa750ff9700 1 -- 172.21.15.132:0/2874375919 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7440063a0 con 0x7fa7540c19c0 2023-05-10T04:19:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa2437fe700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cfd80 0x7fa24414e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7f3a6a59c700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a4c06adb0 0x7f3a4c06d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa243fff700 1 -- 172.21.15.132:0/3826758601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24415c590 msgr2=0x7fa24414eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa243fff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24415c590 0x7fa24414eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa243fff700 1 -- 172.21.15.132:0/3826758601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cfd80 msgr2=0x7fa24414e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa243fff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cfd80 0x7fa24414e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa243fff700 1 -- 172.21.15.132:0/3826758601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa234009550 con 0x7fa2440cf010 2023-05-10T04:19:35.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fab7a9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740b2d80 0x7fab740b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7fab7a9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740c2530 0x7fab740c1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7fab7a9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab740bf820 0x7fab740bfc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7fab7a9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740bf400 con 0x7fab740bf820 2023-05-10T04:19:35.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7fab7a9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab740bf100 con 0x7fab740c2530 2023-05-10T04:19:35.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7fab7a9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab740c29a0 con 0x7fab740b2d80 2023-05-10T04:19:35.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa750ff9700 1 -- 172.21.15.132:0/2874375919 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744020070 con 0x7fa7540c19c0 2023-05-10T04:19:35.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa750ff9700 1 -- 172.21.15.132:0/2874375919 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744006740 con 0x7fa7540c19c0 2023-05-10T04:19:35.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7540ccf10 con 0x7fa7540c19c0 2023-05-10T04:19:35.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7fa243fff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440cf010 0x7fa2440b8330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa23800b560 tx=0x7fa23800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7f515f7fe700 1 -- 172.21.15.132:0/2879374189 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5170004830 con 0x7f5178160d20 2023-05-10T04:19:35.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7f515f7fe700 1 -- 172.21.15.132:0/2879374189 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5170020070 con 0x7f5178160d20 2023-05-10T04:19:35.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7f515f7fe700 1 -- 172.21.15.132:0/2879374189 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51700276c0 con 0x7f5178160d20 2023-05-10T04:19:35.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51780ccf10 con 0x7f5178160d20 2023-05-10T04:19:35.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7fab73fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740b2d80 0x7fab740b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7fab73fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740b2d80 0x7fab740b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58806/0 (socket says 172.21.15.132:58806) 2023-05-10T04:19:35.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7fab73fff700 1 -- 172.21.15.132:0/1965303261 learned_addr learned my addr 172.21.15.132:0/1965303261 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.522+0000 7f79f87ff700 1 -- start start 2023-05-10T04:19:35.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f87ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f00b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f87ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f00cbc20 0x7f79f014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f87ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79f015cdb0 0x7f79f014e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f87ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00b48c0 con 0x7f79f015cdb0 2023-05-10T04:19:35.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f87ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00c3fb0 con 0x7f79f00c90c0 2023-05-10T04:19:35.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f87ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79f00c4290 con 0x7f79f00cbc20 2023-05-10T04:19:35.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7540ccc30 con 0x7fa7540c19c0 2023-05-10T04:19:35.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.527+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75406c8a0 con 0x7fa7540c19c0 2023-05-10T04:19:35.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f6d9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79f015cdb0 0x7f79f014e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f659b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f00b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f659b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f00b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:45140/0 (socket says 172.21.15.132:45140) 2023-05-10T04:19:35.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f79f659b700 1 -- 172.21.15.132:0/3577707770 learned_addr learned my addr 172.21.15.132:0/3577707770 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7f79f659b700 1 -- 172.21.15.132:0/3577707770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f00cbc20 msgr2=0x7f79f014df00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-10T04:19:35.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7f79f659b700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f00cbc20 0x7f79f014df00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7f79f659b700 1 -- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79f015cdb0 msgr2=0x7f79f014e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7f79f659b700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79f015cdb0 0x7f79f014e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7f79f659b700 1 -- 172.21.15.132:0/3577707770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e8009a70 con 0x7f79f00c90c0 2023-05-10T04:19:35.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7f79f659b700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f00b3f00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c750 tx=0x7f79e000cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7fab73fff700 1 -- 172.21.15.132:0/1965303261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740c2530 msgr2=0x7fab740c1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7fab73fff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740c2530 0x7fab740c1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7fab73fff700 1 -- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab740bf820 msgr2=0x7fab740bfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7fab73fff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab740bf820 0x7fab740bfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7fab73fff700 1 -- 172.21.15.132:0/1965303261 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740ccc30 con 0x7fab740b2d80 2023-05-10T04:19:35.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7fab73fff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740b2d80 0x7fab740b3150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c8b0 tx=0x7fab64001930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.526+0000 7fab70ff9700 1 -- 172.21.15.132:0/1965303261 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab64001bd0 con 0x7fab740b2d80 2023-05-10T04:19:35.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.526+0000 7fab70ff9700 1 -- 172.21.15.132:0/1965303261 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab640074e0 con 0x7fab740b2d80 2023-05-10T04:19:35.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.526+0000 7fab70ff9700 1 -- 172.21.15.132:0/1965303261 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6401e430 con 0x7fab740b2d80 2023-05-10T04:19:35.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab740cc950 con 0x7fab740b2d80 2023-05-10T04:19:35.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51780ccc30 con 0x7f5178160d20 2023-05-10T04:19:35.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.525+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51580052f0 con 0x7f5178160d20 2023-05-10T04:19:35.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7f27ea7ff700 1 -- 172.21.15.132:0/1376517523 shutdown_connections 2023-05-10T04:19:35.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/1376517523 >> v2:172.21.15.132:3300/0 conn(0x7f27e415cf10 0x7f27e406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/1376517523 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40adf70 0x7f27e40cce70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.523+0000 7f27ea7ff700 1 -- 172.21.15.132:0/1376517523 >> 172.21.15.132:0/1376517523 conn(0x7f27e40cf720 msgr2=0x7f27e40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f27ea7ff700 1 -- 172.21.15.132:0/1376517523 shutdown_connections 2023-05-10T04:19:35.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.524+0000 7f27ea7ff700 1 -- 172.21.15.132:0/1376517523 wait complete. 2023-05-10T04:19:35.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.526+0000 7f27ea7ff700 1 Processor -- start 2023-05-10T04:19:35.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f3a6a59c700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a4c06adb0 0x7f3a4c06d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0c54c0 tx=0x7f3a5c010000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f79e6ffd700 1 -- 172.21.15.132:0/3577707770 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0011800 con 0x7f79f00c90c0 2023-05-10T04:19:35.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f79e6ffd700 1 -- 172.21.15.132:0/3577707770 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0011960 con 0x7f79f00c90c0 2023-05-10T04:19:35.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f79e6ffd700 1 -- 172.21.15.132:0/3577707770 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0011cd0 con 0x7f79f00c90c0 2023-05-10T04:19:35.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7406cdd0 con 0x7fab740b2d80 2023-05-10T04:19:35.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.529+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab740c2320 con 0x7fab740b2d80 2023-05-10T04:19:35.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f515f7fe700 1 -- 172.21.15.132:0/2879374189 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5170027820 con 0x7f5178160d20 2023-05-10T04:19:35.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.529+0000 7f515f7fe700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f516406ace0 0x7f516406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.530+0000 7f515f7fe700 1 -- 172.21.15.132:0/2879374189 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5170022070 con 0x7f5178160d20 2023-05-10T04:19:35.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.530+0000 7f5176d9d700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f516406ace0 0x7f516406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.530+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79f006cc40 con 0x7f79f00c90c0 2023-05-10T04:19:35.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.530+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79f00cd2d0 con 0x7f79f00c90c0 2023-05-10T04:19:35.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.527+0000 7f27ea7ff700 1 -- start start 2023-05-10T04:19:35.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f27ea7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27e40adf70 0x7f27e40c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f27ea7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40cd760 0x7f27e40c2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f27ea7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e415cf10 0x7f27e41f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f27ea7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40c8980 con 0x7f27e40adf70 2023-05-10T04:19:35.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f27ea7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40c6560 con 0x7f27e415cf10 2023-05-10T04:19:35.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.528+0000 7f27ea7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40c5c70 con 0x7f27e40cd760 2023-05-10T04:19:35.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7fa240ff9700 1 -- 172.21.15.132:0/3826758601 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238011830 con 0x7fa2440cf010 2023-05-10T04:19:35.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7fa240ff9700 1 -- 172.21.15.132:0/3826758601 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2380119b0 con 0x7fa2440cf010 2023-05-10T04:19:35.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7fa240ff9700 1 -- 172.21.15.132:0/3826758601 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238011d60 con 0x7fa2440cf010 2023-05-10T04:19:35.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2440cd770 con 0x7fa2440cf010 2023-05-10T04:19:35.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7f27e8d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e415cf10 0x7f27e41f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7f27e8d9c700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e415cf10 0x7f27e41f9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:45156/0 (socket says 172.21.15.132:45156) 2023-05-10T04:19:35.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7f27e8d9c700 1 -- 172.21.15.132:0/347603555 learned_addr learned my addr 172.21.15.132:0/347603555 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:35.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.529+0000 7f3a5affd700 1 -- 172.21.15.132:0/113424177 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3a60054050 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7f27e8d9c700 1 -- 172.21.15.132:0/347603555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40cd760 msgr2=0x7f27e40c2bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-10T04:19:35.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7f27e8d9c700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40cd760 0x7f27e40c2bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7f27e8d9c700 1 -- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27e40adf70 msgr2=0x7f27e40c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7f27e8d9c700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27e40adf70 0x7f27e40c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7f27e8d9c700 1 -- 172.21.15.132:0/347603555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d8009500 con 0x7f27e415cf10 2023-05-10T04:19:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.533+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79f006cf20 con 0x7f79f00c90c0 2023-05-10T04:19:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2440cf560 con 0x7fa2440cf010 2023-05-10T04:19:35.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.533+0000 7f27e8d9c700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e415cf10 0x7f27e41f9a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27d400b440 tx=0x7f27d400b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.533+0000 7f5176d9d700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f516406ace0 0x7f516406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5168006fd0 tx=0x7f5168008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.534+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2440d01a0 con 0x7fa2440cf010 2023-05-10T04:19:35.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.534+0000 7f515f7fe700 1 -- 172.21.15.132:0/2879374189 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f51700563d0 con 0x7f5178160d20 2023-05-10T04:19:35.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.534+0000 7f27e0ff9700 1 -- 172.21.15.132:0/347603555 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4011830 con 0x7f27e415cf10 2023-05-10T04:19:35.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.534+0000 7f27e0ff9700 1 -- 172.21.15.132:0/347603555 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d4011990 con 0x7f27e415cf10 2023-05-10T04:19:35.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.534+0000 7f27e0ff9700 1 -- 172.21.15.132:0/347603555 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d4011d40 con 0x7f27e415cf10 2023-05-10T04:19:35.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.534+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e4071600 con 0x7f27e415cf10 2023-05-10T04:19:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.537+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e40cc670 con 0x7f27e415cf10 2023-05-10T04:19:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.537+0000 7f79e6ffd700 1 -- 172.21.15.132:0/3577707770 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f79e00193f0 con 0x7f79f00c90c0 2023-05-10T04:19:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.531+0000 7fa750ff9700 1 -- 172.21.15.132:0/2874375919 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa744022030 con 0x7fa7540c19c0 2023-05-10T04:19:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7fa750ff9700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa74006adb0 0x7fa74006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.532+0000 7fa750ff9700 1 -- 172.21.15.132:0/2874375919 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa74408afe0 con 0x7fa7540c19c0 2023-05-10T04:19:35.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.537+0000 7fa753fff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa74006adb0 0x7fa74006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.538+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e40cd3b0 con 0x7f27e415cf10 2023-05-10T04:19:35.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.538+0000 7f79e6ffd700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f79d406ad30 0x7f79d406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.538+0000 7f79e6ffd700 1 -- 172.21.15.132:0/3577707770 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f79e00898a0 con 0x7f79f00c90c0 2023-05-10T04:19:35.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.538+0000 7fa750ff9700 1 -- 172.21.15.132:0/2874375919 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa744055f30 con 0x7fa7540c19c0 2023-05-10T04:19:35.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.538+0000 7fa753fff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa74006adb0 0x7fa74006d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa7540c54e0 tx=0x7fa748009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.539+0000 7f79f5d9a700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f79d406ad30 0x7f79d406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.540+0000 7f79f5d9a700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f79d406ad30 0x7f79d406d1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f79f00c3640 tx=0x7f79ec0092c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.541+0000 7fab70ff9700 1 -- 172.21.15.132:0/1965303261 <== mon.2 v2:172.21.15.154:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab6401e590 con 0x7fab740b2d80 2023-05-10T04:19:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.541+0000 7fa240ff9700 1 -- 172.21.15.132:0/3826758601 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa23801a400 con 0x7fa2440cf010 2023-05-10T04:19:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.543+0000 7fa240ff9700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22806ad80 0x7fa22806d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.543+0000 7fa240ff9700 1 -- 172.21.15.132:0/3826758601 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa238089da0 con 0x7fa2440cf010 2023-05-10T04:19:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.544+0000 7fa2437fe700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22806ad80 0x7fa22806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.545+0000 7fa2437fe700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22806ad80 0x7fa22806d230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa24415bfa0 tx=0x7fa234008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.545+0000 7fab70ff9700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fab6006adb0 0x7fab6006d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.545+0000 7fab70ff9700 1 -- 172.21.15.132:0/1965303261 <== mon.2 v2:172.21.15.154:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fab6408b480 con 0x7fab740b2d80 2023-05-10T04:19:35.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.545+0000 7fab70ff9700 1 -- 172.21.15.132:0/1965303261 <== mon.2 v2:172.21.15.154:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fab6408b900 con 0x7fab740b2d80 2023-05-10T04:19:35.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.546+0000 7fab737fe700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fab6006adb0 0x7fab6006d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.547+0000 7fa240ff9700 1 -- 172.21.15.132:0/3826758601 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa238054bf0 con 0x7fa2440cf010 2023-05-10T04:19:35.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.550+0000 7f79e6ffd700 1 -- 172.21.15.132:0/3577707770 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f79e0058160 con 0x7f79f00c90c0 2023-05-10T04:19:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.559+0000 7fab737fe700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fab6006adb0 0x7fab6006d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fab68006fd0 tx=0x7fab68006d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.567+0000 7f27e0ff9700 1 -- 172.21.15.132:0/347603555 <== mon.1 v2:172.21.15.154:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f27d401a400 con 0x7f27e415cf10 2023-05-10T04:19:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.569+0000 7f27e0ff9700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f27c806ad80 0x7f27c806d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.569+0000 7f27e0ff9700 1 -- 172.21.15.132:0/347603555 <== mon.1 v2:172.21.15.154:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27d4089d40 con 0x7f27e415cf10 2023-05-10T04:19:35.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.570+0000 7f27e0ff9700 1 -- 172.21.15.132:0/347603555 <== mon.1 v2:172.21.15.154:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f27d408a1c0 con 0x7f27e415cf10 2023-05-10T04:19:35.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.574+0000 7f27e3fff700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f27c806ad80 0x7f27c806d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:35.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.586+0000 7f27e3fff700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f27c806ad80 0x7f27c806d230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27dc007fd0 tx=0x7f27dc007da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:35.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.946+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fdee80cc010 con 0x7fdee80ad930 2023-05-10T04:19:35.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.947+0000 7fdee4ff9700 1 -- 172.21.15.132:0/359346045 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdedc07a1f0 con 0x7fdee80ad930 2023-05-10T04:19:35.953 INFO:teuthology.orchestra.run.smithi132.stdout:55834574859 2023-05-10T04:19:35.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fded406adb0 msgr2=0x7fded406d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fded406adb0 0x7fded406d260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fded8000c00 tx=0x7fded8008030 comp rx=0 tx=0).stop 2023-05-10T04:19:35.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee80ad930 msgr2=0x7fdee80b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee80ad930 0x7fdee80b0550 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdedc02d480 tx=0x7fdedc02d790 comp rx=0 tx=0).stop 2023-05-10T04:19:35.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 shutdown_connections 2023-05-10T04:19:35.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fded406adb0 0x7fded406d260 secure :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fded8000c00 tx=0x7fded8008030 comp rx=0 tx=0).stop 2023-05-10T04:19:35.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8160fd0 0x7fdee80b0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdee806c6c0 0x7fdee80c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 --2- 172.21.15.132:0/359346045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdee80ad930 0x7fdee80b0550 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.952+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 >> 172.21.15.132:0/359346045 conn(0x7fdee80cf6e0 msgr2=0x7fdee80b2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.953+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 shutdown_connections 2023-05-10T04:19:35.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.953+0000 7fdeee3ff700 1 -- 172.21.15.132:0/359346045 wait complete. 2023-05-10T04:19:35.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.971+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa244074430 con 0x7fa2440cf010 2023-05-10T04:19:35.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.972+0000 7fa240ff9700 1 -- 172.21.15.132:0/3826758601 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa238058210 con 0x7fa2440cf010 2023-05-10T04:19:35.978 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2023-05-10T04:19:35.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.976+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22806ad80 msgr2=0x7fa22806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.976+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22806ad80 0x7fa22806d230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa24415bfa0 tx=0x7fa234008030 comp rx=0 tx=0).stop 2023-05-10T04:19:35.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.976+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440cf010 msgr2=0x7fa2440b8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.976+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440cf010 0x7fa2440b8330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa23800b560 tx=0x7fa23800b870 comp rx=0 tx=0).stop 2023-05-10T04:19:35.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.977+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 shutdown_connections 2023-05-10T04:19:35.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.977+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22806ad80 0x7fa22806d230 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.977+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24415c590 0x7fa24414eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.977+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440cf010 0x7fa2440b8330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.977+0000 7fa24a9ff700 1 --2- 172.21.15.132:0/3826758601 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa2440cfd80 0x7fa24414e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.977+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 >> 172.21.15.132:0/3826758601 conn(0x7fa244071b10 msgr2=0x7fa2440cba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.978+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 shutdown_connections 2023-05-10T04:19:35.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.978+0000 7fa24a9ff700 1 -- 172.21.15.132:0/3826758601 wait complete. 2023-05-10T04:19:35.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.977+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3a50005870 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.978+0000 7f3a5affd700 1 -- 172.21.15.132:0/113424177 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a6000c450 con 0x7f3a6c0c19c0 2023-05-10T04:19:35.982 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2023-05-10T04:19:35.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.981+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5158005870 con 0x7f5178160d20 2023-05-10T04:19:35.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.981+0000 7f515f7fe700 1 -- 172.21.15.132:0/2879374189 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f517002c030 con 0x7f5178160d20 2023-05-10T04:19:35.985 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2023-05-10T04:19:35.986 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.5 2023-05-10T04:19:35.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.983+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a4c06adb0 msgr2=0x7f3a4c06d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.983+0000 7f3a70bff700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a4c06adb0 0x7f3a4c06d260 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0c54c0 tx=0x7f3a5c010000 comp rx=0 tx=0).stop 2023-05-10T04:19:35.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.983+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6c0c19c0 msgr2=0x7f3a6c150440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.983+0000 7f3a70bff700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6c0c19c0 0x7f3a6c150440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a6000e810 tx=0x7f3a6000ebd0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.987 DEBUG:teuthology.parallel:result is None 2023-05-10T04:19:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.984+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 shutdown_connections 2023-05-10T04:19:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.984+0000 7f3a70bff700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a4c06adb0 0x7f3a4c06d260 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.984+0000 7f3a70bff700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a6c160d20 0x7f3a6c0c2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.984+0000 7f3a70bff700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a6c0ad690 0x7f3a6c0c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.984+0000 7f3a70bff700 1 --2- 172.21.15.132:0/113424177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a6c0c19c0 0x7f3a6c150440 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.984+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 >> 172.21.15.132:0/113424177 conn(0x7f3a6c0cf720 msgr2=0x7f3a6c16bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.984+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 shutdown_connections 2023-05-10T04:19:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.984+0000 7f3a70bff700 1 -- 172.21.15.132:0/113424177 wait complete. 2023-05-10T04:19:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.985+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7540c2de0 con 0x7fa7540c19c0 2023-05-10T04:19:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f516406ace0 msgr2=0x7f516406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f516406ace0 0x7f516406d190 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5168006fd0 tx=0x7f5168008040 comp rx=0 tx=0).stop 2023-05-10T04:19:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5178160d20 msgr2=0x7f517814a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5178160d20 0x7f517814a700 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5170016000 tx=0x7f5170004ad0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7fa750ff9700 1 -- 172.21.15.132:0/2874375919 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa744005c30 con 0x7fa7540c19c0 2023-05-10T04:19:35.991 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2023-05-10T04:19:35.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 shutdown_connections 2023-05-10T04:19:35.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f516406ace0 0x7f516406d190 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5178160d20 0x7f517814a700 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f51780ad690 0x7f51780c2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 --2- 172.21.15.132:0/2879374189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f51780c20d0 0x7f5178150140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.986+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 >> 172.21.15.132:0/2879374189 conn(0x7f51780cf720 msgr2=0x7f51781638c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.988+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 shutdown_connections 2023-05-10T04:19:35.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.988+0000 7f517d1ff700 1 -- 172.21.15.132:0/2879374189 wait complete. 2023-05-10T04:19:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.990+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa74006adb0 msgr2=0x7fa74006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.990+0000 7fa75a3ff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa74006adb0 0x7fa74006d260 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa7540c54e0 tx=0x7fa748009040 comp rx=0 tx=0).stop 2023-05-10T04:19:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.990+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540c19c0 msgr2=0x7fa7541600d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.990+0000 7fa75a3ff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540c19c0 0x7fa7541600d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa744012000 tx=0x7fa744004750 comp rx=0 tx=0).stop 2023-05-10T04:19:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.991+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fab740bf670 con 0x7fab740b2d80 2023-05-10T04:19:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.992+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 shutdown_connections 2023-05-10T04:19:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.992+0000 7fa75a3ff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa74006adb0 0x7fa74006d260 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.992+0000 7fa75a3ff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa754160d20 0x7fa7540bf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.992+0000 7fa75a3ff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa7540ad690 0x7fa7541f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.992+0000 7fa75a3ff700 1 --2- 172.21.15.132:0/2874375919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7540c19c0 0x7fa7541600d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.992+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 >> 172.21.15.132:0/2874375919 conn(0x7fa7540cf720 msgr2=0x7fa7540b0500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:35.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.992+0000 7fab70ff9700 1 -- 172.21.15.132:0/1965303261 <== mon.2 v2:172.21.15.154:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab640563d0 con 0x7fab740b2d80 2023-05-10T04:19:35.996 INFO:teuthology.orchestra.run.smithi132.stdout:68719476747 2023-05-10T04:19:35.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.993+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 shutdown_connections 2023-05-10T04:19:35.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.993+0000 7fa75a3ff700 1 -- 172.21.15.132:0/2874375919 wait complete. 2023-05-10T04:19:35.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.995+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f79f00c40f0 con 0x7f79f00c90c0 2023-05-10T04:19:35.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fab6006adb0 msgr2=0x7fab6006d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fab6006adb0 0x7fab6006d260 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fab68006fd0 tx=0x7fab68006d80 comp rx=0 tx=0).stop 2023-05-10T04:19:35.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740b2d80 msgr2=0x7fab740b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:35.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740b2d80 0x7fab740b3150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab6400c8b0 tx=0x7fab64001930 comp rx=0 tx=0).stop 2023-05-10T04:19:35.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 shutdown_connections 2023-05-10T04:19:35.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fab6006adb0 0x7fab6006d260 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab740bf820 0x7fab740bfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fab740b2d80 0x7fab740b3150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 --2- 172.21.15.132:0/1965303261 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fab740c2530 0x7fab740c1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 >> 172.21.15.132:0/1965303261 conn(0x7fab740cf720 msgr2=0x7fab7415b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:36.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 shutdown_connections 2023-05-10T04:19:36.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.996+0000 7fab7a9ff700 1 -- 172.21.15.132:0/1965303261 wait complete. 2023-05-10T04:19:36.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:35.997+0000 7f79e6ffd700 1 -- 172.21.15.132:0/3577707770 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f79f00c40f0 con 0x7f79f00c90c0 2023-05-10T04:19:36.001 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2023-05-10T04:19:36.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.001+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f79d406ad30 msgr2=0x7f79d406d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.001+0000 7f79f87ff700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f79d406ad30 0x7f79d406d1e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f79f00c3640 tx=0x7f79ec0092c0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.001+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 msgr2=0x7f79f00b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.001+0000 7f79f87ff700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f00b3f00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f79e000c750 tx=0x7f79e000cb10 comp rx=0 tx=0).stop 2023-05-10T04:19:36.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.006+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 shutdown_connections 2023-05-10T04:19:36.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.006+0000 7f79f87ff700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f79d406ad30 0x7f79d406d1e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.006+0000 7f79f87ff700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79f015cdb0 0x7f79f014e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.006+0000 7f79f87ff700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f79f00c90c0 0x7f79f00b3f00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.006+0000 7f79f87ff700 1 --2- 172.21.15.132:0/3577707770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f79f00cbc20 0x7f79f014df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.006+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 >> 172.21.15.132:0/3577707770 conn(0x7f79f00cf6e0 msgr2=0x7f79f00ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:36.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.006+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 shutdown_connections 2023-05-10T04:19:36.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.006+0000 7f79f87ff700 1 -- 172.21.15.132:0/3577707770 wait complete. 2023-05-10T04:19:36.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.017+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f27e40c66a0 con 0x7f27e415cf10 2023-05-10T04:19:36.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.018+0000 7f27e0ff9700 1 -- 172.21.15.132:0/347603555 <== mon.1 v2:172.21.15.154:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27d4054b70 con 0x7f27e415cf10 2023-05-10T04:19:36.021 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-05-10T04:19:36.022 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2023-05-10T04:19:36.022 DEBUG:teuthology.parallel:result is None 2023-05-10T04:19:36.023 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-05-10T04:19:36.023 DEBUG:teuthology.parallel:result is None 2023-05-10T04:19:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f27c806ad80 msgr2=0x7f27c806d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f27c806ad80 0x7f27c806d230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f27dc007fd0 tx=0x7f27dc007da0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e415cf10 msgr2=0x7f27e41f9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e415cf10 0x7f27e41f9a70 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f27d400b440 tx=0x7f27d400b800 comp rx=0 tx=0).stop 2023-05-10T04:19:36.025 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476747 got 68719476747 for osd.4 2023-05-10T04:19:36.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 shutdown_connections 2023-05-10T04:19:36.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f27c806ad80 0x7f27c806d230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27e415cf10 0x7f27e41f9a70 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27e40adf70 0x7f27e40c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 --2- 172.21.15.132:0/347603555 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27e40cd760 0x7f27e40c2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.022+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 >> 172.21.15.132:0/347603555 conn(0x7f27e40cf720 msgr2=0x7f27e406d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:36.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.023+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 shutdown_connections 2023-05-10T04:19:36.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.023+0000 7f27ea7ff700 1 -- 172.21.15.132:0/347603555 wait complete. 2023-05-10T04:19:36.027 DEBUG:teuthology.parallel:result is None 2023-05-10T04:19:36.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-05-10T04:19:36.028 DEBUG:teuthology.parallel:result is None 2023-05-10T04:19:36.031 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-05-10T04:19:36.031 DEBUG:teuthology.parallel:result is None 2023-05-10T04:19:36.037 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-05-10T04:19:36.037 DEBUG:teuthology.parallel:result is None 2023-05-10T04:19:36.043 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2023-05-10T04:19:36.043 DEBUG:teuthology.parallel:result is None 2023-05-10T04:19:36.044 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-10T04:19:36.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T04:19:36.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.263+0000 7f3d79bff700 1 Processor -- start 2023-05-10T04:19:36.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.263+0000 7f3d79bff700 1 -- start start 2023-05-10T04:19:36.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.264+0000 7f3d79bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3d740cfbf0 0x7f3d741608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.264+0000 7f3d79bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 0x7f3d740d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.264+0000 7f3d79bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d740d0020 con 0x7f3d740b87a0 2023-05-10T04:19:36.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.264+0000 7f3d79bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d740d02d0 con 0x7f3d740cfbf0 2023-05-10T04:19:36.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.264+0000 7f3d79bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740d0cb0 con 0x7f3d740d1100 2023-05-10T04:19:36.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.264+0000 7f3d737fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3d740b87a0 0x7f3d741601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50800/0 (socket says 172.21.15.132:50800) 2023-05-10T04:19:36.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.264+0000 7f3d737fe700 1 -- 172.21.15.132:0/185881762 learned_addr learned my addr 172.21.15.132:0/185881762 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:36.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d72ffd700 1 --2- 172.21.15.132:0/185881762 >> v2:172.21.15.154:3300/0 conn(0x7f3d740cfbf0 0x7f3d741608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d73fff700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 0x7f3d740d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3859022870 0 0) 0x7f3d740d0020 con 0x7f3d740b87a0 2023-05-10T04:19:36.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d5c0035b0 con 0x7f3d740b87a0 2023-05-10T04:19:36.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1768042933 0 0) 0x7f3d5c0035b0 con 0x7f3d740b87a0 2023-05-10T04:19:36.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 msgr2=0x7f3d740d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:36.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 0x7f3d740d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 >> v2:172.21.15.154:3300/0 conn(0x7f3d740cfbf0 msgr2=0x7f3d741608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:36.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 --2- 172.21.15.132:0/185881762 >> v2:172.21.15.154:3300/0 conn(0x7f3d740cfbf0 0x7f3d741608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d740cdc60 con 0x7f3d740b87a0 2023-05-10T04:19:36.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f3d64001670 con 0x7f3d740b87a0 2023-05-10T04:19:36.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 >> v1:172.21.15.132:6789/0 conn(0x7f3d740b87a0 legacy=0x7f3d741601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d5c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d5c004430 0x7f3d5c0048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 0x7f3d5c004fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740d02d0 con 0x7f3d5c003a00 2023-05-10T04:19:36.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c005700 con 0x7f3d5c004430 2023-05-10T04:19:36.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.265+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5c00ba90 con 0x7f3d740d1100 2023-05-10T04:19:36.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d737fe700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d5c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d72ffd700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d5c004430 0x7f3d5c0048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d73fff700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 0x7f3d5c004fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d737fe700 1 -- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 msgr2=0x7f3d5c004fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:36.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d737fe700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 0x7f3d5c004fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d737fe700 1 -- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d5c004430 msgr2=0x7f3d5c0048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:36.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d737fe700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d5c004430 0x7f3d5c0048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d737fe700 1 -- 172.21.15.132:0/185881762 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d5c0035b0 con 0x7f3d5c003a00 2023-05-10T04:19:36.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d72ffd700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d5c004430 0x7f3d5c0048f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:36.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d73fff700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d740d1100 0x7f3d5c004fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:36.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d737fe700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d5c003e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400c320 tx=0x7f3d5c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d22c09d349ca591 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:36.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400ce60 con 0x7f3d5c003a00 2023-05-10T04:19:36.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d64005960 con 0x7f3d5c003a00 2023-05-10T04:19:36.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.266+0000 7f3d727fc700 1 -- 172.21.15.132:0/185881762 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64005d10 con 0x7f3d5c003a00 2023-05-10T04:19:36.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.267+0000 7f3d79bff700 1 -- 172.21.15.132:0/185881762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 msgr2=0x7f3d5c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.267+0000 7f3d79bff700 1 --2- 172.21.15.132:0/185881762 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d5c003e10 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3d6400c320 tx=0x7f3d5c005880 comp rx=0 tx=0).stop 2023-05-10T04:19:36.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.267+0000 7f3d73fff700 1 -- 172.21.15.132:0/185881762 reap_dead start 2023-05-10T04:19:36.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.267+0000 7f3d79bff700 1 -- 172.21.15.132:0/185881762 shutdown_connections 2023-05-10T04:19:36.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.267+0000 7f3d79bff700 1 -- 172.21.15.132:0/185881762 >> 172.21.15.132:0/185881762 conn(0x7f3d74071b10 msgr2=0x7f3d74071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:36.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.267+0000 7f3d79bff700 1 -- 172.21.15.132:0/185881762 shutdown_connections 2023-05-10T04:19:36.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.267+0000 7f3d79bff700 1 -- 172.21.15.132:0/185881762 wait complete. 2023-05-10T04:19:36.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.269+0000 7f3d79bff700 1 Processor -- start 2023-05-10T04:19:36.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.270+0000 7f3d79bff700 1 -- start start 2023-05-10T04:19:36.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d79bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d7414aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d79bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d74157630 0x7f3d7415f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d79bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d7415d820 0x7f3d74149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d79bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740cb270 con 0x7f3d5c003a00 2023-05-10T04:19:36.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d79bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740cb550 con 0x7f3d74157630 2023-05-10T04:19:36.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d79bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740cb830 con 0x7f3d7415d820 2023-05-10T04:19:36.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d737fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d7414aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d737fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d7414aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48346/0 (socket says 172.21.15.132:48346) 2023-05-10T04:19:36.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d737fe700 1 -- 172.21.15.132:0/1932890446 learned_addr learned my addr 172.21.15.132:0/1932890446 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:36.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d737fe700 1 -- 172.21.15.132:0/1932890446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d7415d820 msgr2=0x7f3d74149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d737fe700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d7415d820 0x7f3d74149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d737fe700 1 -- 172.21.15.132:0/1932890446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d74157630 msgr2=0x7f3d7415f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d72ffd700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d74157630 0x7f3d7415f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.271+0000 7f3d737fe700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d74157630 0x7f3d7415f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.272+0000 7f3d737fe700 1 -- 172.21.15.132:0/1932890446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d740cd980 con 0x7f3d5c003a00 2023-05-10T04:19:36.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.272+0000 7f3d737fe700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d7414aae0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0056d0 tx=0x7f3d64001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:36.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.272+0000 7f3d5bfff700 1 -- 172.21.15.132:0/1932890446 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64001680 con 0x7f3d5c003a00 2023-05-10T04:19:36.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.272+0000 7f3d5bfff700 1 -- 172.21.15.132:0/1932890446 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d64004a80 con 0x7f3d5c003a00 2023-05-10T04:19:36.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.272+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d740cd6a0 con 0x7f3d5c003a00 2023-05-10T04:19:36.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.272+0000 7f3d5bfff700 1 -- 172.21.15.132:0/1932890446 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64004e30 con 0x7f3d5c003a00 2023-05-10T04:19:36.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.272+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d74160e30 con 0x7f3d5c003a00 2023-05-10T04:19:36.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.273+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d740b52f0 con 0x7f3d5c003a00 2023-05-10T04:19:36.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.274+0000 7f3d5bfff700 1 -- 172.21.15.132:0/1932890446 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3d640070d0 con 0x7f3d5c003a00 2023-05-10T04:19:36.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.275+0000 7f3d5bfff700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d6006ace0 0x7f3d6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.275+0000 7f3d5bfff700 1 -- 172.21.15.132:0/1932890446 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3d6408aa30 con 0x7f3d5c003a00 2023-05-10T04:19:36.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.275+0000 7f3d72ffd700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d6006ace0 0x7f3d6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.276+0000 7f3d72ffd700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d6006ace0 0x7f3d6006d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d741f5ab0 tx=0x7f3d68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:36.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.279+0000 7f3d5bfff700 1 -- 172.21.15.132:0/1932890446 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3d640558a0 con 0x7f3d5c003a00 2023-05-10T04:19:36.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.472+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 --> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3d740b32e0 con 0x7f3d6006ace0 2023-05-10T04:19:36.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.482+0000 7f3d5bfff700 1 -- 172.21.15.132:0/1932890446 <== mgr.4100 v2:172.21.15.132:6832/1621031024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367312 (secure 0 0 0) 0x7f3d740b32e0 con 0x7f3d6006ace0 2023-05-10T04:19:36.489 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d6006ace0 msgr2=0x7f3d6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d6006ace0 0x7f3d6006d190 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3d741f5ab0 tx=0x7f3d68008040 comp rx=0 tx=0).stop 2023-05-10T04:19:36.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 msgr2=0x7f3d7414aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d7414aae0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3d5c0056d0 tx=0x7f3d64001a00 comp rx=0 tx=0).stop 2023-05-10T04:19:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 shutdown_connections 2023-05-10T04:19:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d6006ace0 0x7f3d6006d190 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3d7415d820 0x7f3d74149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d5c003a00 0x7f3d7414aae0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 --2- 172.21.15.132:0/1932890446 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3d74157630 0x7f3d7415f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 >> 172.21.15.132:0/1932890446 conn(0x7f3d74071b10 msgr2=0x7f3d740cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:36.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 shutdown_connections 2023-05-10T04:19:36.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.487+0000 7f3d79bff700 1 -- 172.21.15.132:0/1932890446 wait complete. 2023-05-10T04:19:36.493 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-05-10T04:19:36.508 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-05-10T04:19:35.326821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67720,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":64064,"kb_avail":754907000,"statfs":{"total":773094113280,"available":773024768000,"internally_reserved":0,"allocated":3678208,"data_stored":2182864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65601536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007624"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578590+0000","last_change":"2023-05-10T04:19:09.980944+0000","last_active":"2023-05-10T04:19:14.578590+0000","last_peered":"2023-05-10T04:19:14.578590+0000","last_clean":"2023-05-10T04:19:14.578590+0000","last_became_active":"2023-05-10T04:19:09.980469+0000","last_became_peered":"2023-05-10T04:19:09.980469+0000","last_unstale":"2023-05-10T04:19:14.578590+0000","last_undegraded":"2023-05-10T04:19:14.578590+0000","last_fullsized":"2023-05-10T04:19:14.578590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:55:07.690476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202665+0000","last_change":"2023-05-10T04:19:09.966435+0000","last_active":"2023-05-10T04:19:15.202665+0000","last_peered":"2023-05-10T04:19:15.202665+0000","last_clean":"2023-05-10T04:19:15.202665+0000","last_became_active":"2023-05-10T04:19:09.966166+0000","last_became_peered":"2023-05-10T04:19:09.966166+0000","last_unstale":"2023-05-10T04:19:15.202665+0000","last_undegraded":"2023-05-10T04:19:15.202665+0000","last_fullsized":"2023-05-10T04:19:15.202665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:27:35.392807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468705+0000","last_change":"2023-05-10T04:19:09.984558+0000","last_active":"2023-05-10T04:19:14.468705+0000","last_peered":"2023-05-10T04:19:14.468705+0000","last_clean":"2023-05-10T04:19:14.468705+0000","last_became_active":"2023-05-10T04:19:09.984302+0000","last_became_peered":"2023-05-10T04:19:09.984302+0000","last_unstale":"2023-05-10T04:19:14.468705+0000","last_undegraded":"2023-05-10T04:19:14.468705+0000","last_fullsized":"2023-05-10T04:19:14.468705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:04:32.114370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468704+0000","last_change":"2023-05-10T04:19:09.974290+0000","last_active":"2023-05-10T04:19:14.468704+0000","last_peered":"2023-05-10T04:19:14.468704+0000","last_clean":"2023-05-10T04:19:14.468704+0000","last_became_active":"2023-05-10T04:19:09.973974+0000","last_became_peered":"2023-05-10T04:19:09.973974+0000","last_unstale":"2023-05-10T04:19:14.468704+0000","last_undegraded":"2023-05-10T04:19:14.468704+0000","last_fullsized":"2023-05-10T04:19:14.468704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:42.762389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469158+0000","last_change":"2023-05-10T04:19:09.969611+0000","last_active":"2023-05-10T04:19:14.469158+0000","last_peered":"2023-05-10T04:19:14.469158+0000","last_clean":"2023-05-10T04:19:14.469158+0000","last_became_active":"2023-05-10T04:19:09.969348+0000","last_became_peered":"2023-05-10T04:19:09.969348+0000","last_unstale":"2023-05-10T04:19:14.469158+0000","last_undegraded":"2023-05-10T04:19:14.469158+0000","last_fullsized":"2023-05-10T04:19:14.469158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:09:45.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202245+0000","last_change":"2023-05-10T04:19:09.958269+0000","last_active":"2023-05-10T04:19:15.202245+0000","last_peered":"2023-05-10T04:19:15.202245+0000","last_clean":"2023-05-10T04:19:15.202245+0000","last_became_active":"2023-05-10T04:19:09.958012+0000","last_became_peered":"2023-05-10T04:19:09.958012+0000","last_unstale":"2023-05-10T04:19:15.202245+0000","last_undegraded":"2023-05-10T04:19:15.202245+0000","last_fullsized":"2023-05-10T04:19:15.202245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:46:10.564631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201730+0000","last_change":"2023-05-10T04:19:09.977451+0000","last_active":"2023-05-10T04:19:15.201730+0000","last_peered":"2023-05-10T04:19:15.201730+0000","last_clean":"2023-05-10T04:19:15.201730+0000","last_became_active":"2023-05-10T04:19:09.977096+0000","last_became_peered":"2023-05-10T04:19:09.977096+0000","last_unstale":"2023-05-10T04:19:15.201730+0000","last_undegraded":"2023-05-10T04:19:15.201730+0000","last_fullsized":"2023-05-10T04:19:15.201730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:08:03.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203498+0000","last_change":"2023-05-10T04:19:09.983987+0000","last_active":"2023-05-10T04:19:15.203498+0000","last_peered":"2023-05-10T04:19:15.203498+0000","last_clean":"2023-05-10T04:19:15.203498+0000","last_became_active":"2023-05-10T04:19:09.983498+0000","last_became_peered":"2023-05-10T04:19:09.983498+0000","last_unstale":"2023-05-10T04:19:15.203498+0000","last_undegraded":"2023-05-10T04:19:15.203498+0000","last_fullsized":"2023-05-10T04:19:15.203498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:24:07.309535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470244+0000","last_change":"2023-05-10T04:19:09.985793+0000","last_active":"2023-05-10T04:19:14.470244+0000","last_peered":"2023-05-10T04:19:14.470244+0000","last_clean":"2023-05-10T04:19:14.470244+0000","last_became_active":"2023-05-10T04:19:09.985536+0000","last_became_peered":"2023-05-10T04:19:09.985536+0000","last_unstale":"2023-05-10T04:19:14.470244+0000","last_undegraded":"2023-05-10T04:19:14.470244+0000","last_fullsized":"2023-05-10T04:19:14.470244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:26:03.971644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204267+0000","last_change":"2023-05-10T04:19:09.977082+0000","last_active":"2023-05-10T04:19:15.204267+0000","last_peered":"2023-05-10T04:19:15.204267+0000","last_clean":"2023-05-10T04:19:15.204267+0000","last_became_active":"2023-05-10T04:19:09.976807+0000","last_became_peered":"2023-05-10T04:19:09.976807+0000","last_unstale":"2023-05-10T04:19:15.204267+0000","last_undegraded":"2023-05-10T04:19:15.204267+0000","last_fullsized":"2023-05-10T04:19:15.204267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:57.684710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204207+0000","last_change":"2023-05-10T04:19:09.977165+0000","last_active":"2023-05-10T04:19:15.204207+0000","last_peered":"2023-05-10T04:19:15.204207+0000","last_clean":"2023-05-10T04:19:15.204207+0000","last_became_active":"2023-05-10T04:19:09.976881+0000","last_became_peered":"2023-05-10T04:19:09.976881+0000","last_unstale":"2023-05-10T04:19:15.204207+0000","last_undegraded":"2023-05-10T04:19:15.204207+0000","last_fullsized":"2023-05-10T04:19:15.204207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:33:39.200185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578113+0000","last_change":"2023-05-10T04:19:09.981309+0000","last_active":"2023-05-10T04:19:14.578113+0000","last_peered":"2023-05-10T04:19:14.578113+0000","last_clean":"2023-05-10T04:19:14.578113+0000","last_became_active":"2023-05-10T04:19:09.981029+0000","last_became_peered":"2023-05-10T04:19:09.981029+0000","last_unstale":"2023-05-10T04:19:14.578113+0000","last_undegraded":"2023-05-10T04:19:14.578113+0000","last_fullsized":"2023-05-10T04:19:14.578113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:39:32.302218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468965+0000","last_change":"2023-05-10T04:19:09.986829+0000","last_active":"2023-05-10T04:19:14.468965+0000","last_peered":"2023-05-10T04:19:14.468965+0000","last_clean":"2023-05-10T04:19:14.468965+0000","last_became_active":"2023-05-10T04:19:09.986539+0000","last_became_peered":"2023-05-10T04:19:09.986539+0000","last_unstale":"2023-05-10T04:19:14.468965+0000","last_undegraded":"2023-05-10T04:19:14.468965+0000","last_fullsized":"2023-05-10T04:19:14.468965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:01.243491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203681+0000","last_change":"2023-05-10T04:19:09.985452+0000","last_active":"2023-05-10T04:19:15.203681+0000","last_peered":"2023-05-10T04:19:15.203681+0000","last_clean":"2023-05-10T04:19:15.203681+0000","last_became_active":"2023-05-10T04:19:09.985150+0000","last_became_peered":"2023-05-10T04:19:09.985150+0000","last_unstale":"2023-05-10T04:19:15.203681+0000","last_undegraded":"2023-05-10T04:19:15.203681+0000","last_fullsized":"2023-05-10T04:19:15.203681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:01:52.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468391+0000","last_change":"2023-05-10T04:19:09.976517+0000","last_active":"2023-05-10T04:19:14.468391+0000","last_peered":"2023-05-10T04:19:14.468391+0000","last_clean":"2023-05-10T04:19:14.468391+0000","last_became_active":"2023-05-10T04:19:09.976213+0000","last_became_peered":"2023-05-10T04:19:09.976213+0000","last_unstale":"2023-05-10T04:19:14.468391+0000","last_undegraded":"2023-05-10T04:19:14.468391+0000","last_fullsized":"2023-05-10T04:19:14.468391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:16.831438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201721+0000","last_change":"2023-05-10T04:19:09.974190+0000","last_active":"2023-05-10T04:19:15.201721+0000","last_peered":"2023-05-10T04:19:15.201721+0000","last_clean":"2023-05-10T04:19:15.201721+0000","last_became_active":"2023-05-10T04:19:09.973917+0000","last_became_peered":"2023-05-10T04:19:09.973917+0000","last_unstale":"2023-05-10T04:19:15.201721+0000","last_undegraded":"2023-05-10T04:19:15.201721+0000","last_fullsized":"2023-05-10T04:19:15.201721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:23:32.089101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628444+0000","last_change":"2023-05-10T04:19:09.976310+0000","last_active":"2023-05-10T04:19:14.628444+0000","last_peered":"2023-05-10T04:19:14.628444+0000","last_clean":"2023-05-10T04:19:14.628444+0000","last_became_active":"2023-05-10T04:19:09.975809+0000","last_became_peered":"2023-05-10T04:19:09.975809+0000","last_unstale":"2023-05-10T04:19:14.628444+0000","last_undegraded":"2023-05-10T04:19:14.628444+0000","last_fullsized":"2023-05-10T04:19:14.628444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:07.446800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468880+0000","last_change":"2023-05-10T04:19:09.980962+0000","last_active":"2023-05-10T04:19:14.468880+0000","last_peered":"2023-05-10T04:19:14.468880+0000","last_clean":"2023-05-10T04:19:14.468880+0000","last_became_active":"2023-05-10T04:19:09.980600+0000","last_became_peered":"2023-05-10T04:19:09.980600+0000","last_unstale":"2023-05-10T04:19:14.468880+0000","last_undegraded":"2023-05-10T04:19:14.468880+0000","last_fullsized":"2023-05-10T04:19:14.468880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:02.084506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578180+0000","last_change":"2023-05-10T04:19:09.983155+0000","last_active":"2023-05-10T04:19:14.578180+0000","last_peered":"2023-05-10T04:19:14.578180+0000","last_clean":"2023-05-10T04:19:14.578180+0000","last_became_active":"2023-05-10T04:19:09.982831+0000","last_became_peered":"2023-05-10T04:19:09.982831+0000","last_unstale":"2023-05-10T04:19:14.578180+0000","last_undegraded":"2023-05-10T04:19:14.578180+0000","last_fullsized":"2023-05-10T04:19:14.578180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:33:39.200185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204200+0000","last_change":"2023-05-10T04:19:09.974974+0000","last_active":"2023-05-10T04:19:15.204200+0000","last_peered":"2023-05-10T04:19:15.204200+0000","last_clean":"2023-05-10T04:19:15.204200+0000","last_became_active":"2023-05-10T04:19:09.974693+0000","last_became_peered":"2023-05-10T04:19:09.974693+0000","last_unstale":"2023-05-10T04:19:15.204200+0000","last_undegraded":"2023-05-10T04:19:15.204200+0000","last_fullsized":"2023-05-10T04:19:15.204200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:55:21.820447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203862+0000","last_change":"2023-05-10T04:19:09.986983+0000","last_active":"2023-05-10T04:19:15.203862+0000","last_peered":"2023-05-10T04:19:15.203862+0000","last_clean":"2023-05-10T04:19:15.203862+0000","last_became_active":"2023-05-10T04:19:09.986701+0000","last_became_peered":"2023-05-10T04:19:09.986701+0000","last_unstale":"2023-05-10T04:19:15.203862+0000","last_undegraded":"2023-05-10T04:19:15.203862+0000","last_fullsized":"2023-05-10T04:19:15.203862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:21:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627999+0000","last_change":"2023-05-10T04:19:09.977136+0000","last_active":"2023-05-10T04:19:14.627999+0000","last_peered":"2023-05-10T04:19:14.627999+0000","last_clean":"2023-05-10T04:19:14.627999+0000","last_became_active":"2023-05-10T04:19:09.976794+0000","last_became_peered":"2023-05-10T04:19:09.976794+0000","last_unstale":"2023-05-10T04:19:14.627999+0000","last_undegraded":"2023-05-10T04:19:14.627999+0000","last_fullsized":"2023-05-10T04:19:14.627999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:19:39.672723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469767+0000","last_change":"2023-05-10T04:19:09.984844+0000","last_active":"2023-05-10T04:19:14.469767+0000","last_peered":"2023-05-10T04:19:14.469767+0000","last_clean":"2023-05-10T04:19:14.469767+0000","last_became_active":"2023-05-10T04:19:09.984531+0000","last_became_peered":"2023-05-10T04:19:09.984531+0000","last_unstale":"2023-05-10T04:19:14.469767+0000","last_undegraded":"2023-05-10T04:19:14.469767+0000","last_fullsized":"2023-05-10T04:19:14.469767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:33.935006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203424+0000","last_change":"2023-05-10T04:19:09.986208+0000","last_active":"2023-05-10T04:19:15.203424+0000","last_peered":"2023-05-10T04:19:15.203424+0000","last_clean":"2023-05-10T04:19:15.203424+0000","last_became_active":"2023-05-10T04:19:09.985544+0000","last_became_peered":"2023-05-10T04:19:09.985544+0000","last_unstale":"2023-05-10T04:19:15.203424+0000","last_undegraded":"2023-05-10T04:19:15.203424+0000","last_fullsized":"2023-05-10T04:19:15.203424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:08.821912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470497+0000","last_change":"2023-05-10T04:19:09.960642+0000","last_active":"2023-05-10T04:19:14.470497+0000","last_peered":"2023-05-10T04:19:14.470497+0000","last_clean":"2023-05-10T04:19:14.470497+0000","last_became_active":"2023-05-10T04:19:09.960283+0000","last_became_peered":"2023-05-10T04:19:09.960283+0000","last_unstale":"2023-05-10T04:19:14.470497+0000","last_undegraded":"2023-05-10T04:19:14.470497+0000","last_fullsized":"2023-05-10T04:19:14.470497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:57:41.293004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628247+0000","last_change":"2023-05-10T04:19:09.977728+0000","last_active":"2023-05-10T04:19:14.628247+0000","last_peered":"2023-05-10T04:19:14.628247+0000","last_clean":"2023-05-10T04:19:14.628247+0000","last_became_active":"2023-05-10T04:19:09.971618+0000","last_became_peered":"2023-05-10T04:19:09.971618+0000","last_unstale":"2023-05-10T04:19:14.628247+0000","last_undegraded":"2023-05-10T04:19:14.628247+0000","last_fullsized":"2023-05-10T04:19:14.628247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:55.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202232+0000","last_change":"2023-05-10T04:19:09.972981+0000","last_active":"2023-05-10T04:19:15.202232+0000","last_peered":"2023-05-10T04:19:15.202232+0000","last_clean":"2023-05-10T04:19:15.202232+0000","last_became_active":"2023-05-10T04:19:09.972690+0000","last_became_peered":"2023-05-10T04:19:09.972690+0000","last_unstale":"2023-05-10T04:19:15.202232+0000","last_undegraded":"2023-05-10T04:19:15.202232+0000","last_fullsized":"2023-05-10T04:19:15.202232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:35:07.369264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202719+0000","last_change":"2023-05-10T04:19:13.994524+0000","last_active":"2023-05-10T04:19:15.202719+0000","last_peered":"2023-05-10T04:19:15.202719+0000","last_clean":"2023-05-10T04:19:15.202719+0000","last_became_active":"2023-05-10T04:19:13.994164+0000","last_became_peered":"2023-05-10T04:19:13.994164+0000","last_unstale":"2023-05-10T04:19:15.202719+0000","last_undegraded":"2023-05-10T04:19:15.202719+0000","last_fullsized":"2023-05-10T04:19:15.202719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:16.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203829+0000","last_change":"2023-05-10T04:19:09.487208+0000","last_active":"2023-05-10T04:19:15.203829+0000","last_peered":"2023-05-10T04:19:15.203829+0000","last_clean":"2023-05-10T04:19:15.203829+0000","last_became_active":"2023-05-10T04:19:09.486969+0000","last_became_peered":"2023-05-10T04:19:09.486969+0000","last_unstale":"2023-05-10T04:19:15.203829+0000","last_undegraded":"2023-05-10T04:19:15.203829+0000","last_fullsized":"2023-05-10T04:19:15.203829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:03.029871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628183+0000","last_change":"2023-05-10T04:19:09.982864+0000","last_active":"2023-05-10T04:19:14.628183+0000","last_peered":"2023-05-10T04:19:14.628183+0000","last_clean":"2023-05-10T04:19:14.628183+0000","last_became_active":"2023-05-10T04:19:09.982599+0000","last_became_peered":"2023-05-10T04:19:09.982599+0000","last_unstale":"2023-05-10T04:19:14.628183+0000","last_undegraded":"2023-05-10T04:19:14.628183+0000","last_fullsized":"2023-05-10T04:19:14.628183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:56:49.205595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203762+0000","last_change":"2023-05-10T04:19:13.991870+0000","last_active":"2023-05-10T04:19:15.203762+0000","last_peered":"2023-05-10T04:19:15.203762+0000","last_clean":"2023-05-10T04:19:15.203762+0000","last_became_active":"2023-05-10T04:19:13.991396+0000","last_became_peered":"2023-05-10T04:19:13.991396+0000","last_unstale":"2023-05-10T04:19:15.203762+0000","last_undegraded":"2023-05-10T04:19:15.203762+0000","last_fullsized":"2023-05-10T04:19:15.203762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:04.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469470+0000","last_change":"2023-05-10T04:19:09.483051+0000","last_active":"2023-05-10T04:19:14.469470+0000","last_peered":"2023-05-10T04:19:14.469470+0000","last_clean":"2023-05-10T04:19:14.469470+0000","last_became_active":"2023-05-10T04:19:09.482746+0000","last_became_peered":"2023-05-10T04:19:09.482746+0000","last_unstale":"2023-05-10T04:19:14.469470+0000","last_undegraded":"2023-05-10T04:19:14.469470+0000","last_fullsized":"2023-05-10T04:19:14.469470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:40:44.146612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470309+0000","last_change":"2023-05-10T04:19:09.983015+0000","last_active":"2023-05-10T04:19:14.470309+0000","last_peered":"2023-05-10T04:19:14.470309+0000","last_clean":"2023-05-10T04:19:14.470309+0000","last_became_active":"2023-05-10T04:19:09.982704+0000","last_became_peered":"2023-05-10T04:19:09.982704+0000","last_unstale":"2023-05-10T04:19:14.470309+0000","last_undegraded":"2023-05-10T04:19:14.470309+0000","last_fullsized":"2023-05-10T04:19:14.470309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:01:13.105870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468779+0000","last_change":"2023-05-10T04:19:13.991979+0000","last_active":"2023-05-10T04:19:14.468779+0000","last_peered":"2023-05-10T04:19:14.468779+0000","last_clean":"2023-05-10T04:19:14.468779+0000","last_became_active":"2023-05-10T04:19:13.991551+0000","last_became_peered":"2023-05-10T04:19:13.991551+0000","last_unstale":"2023-05-10T04:19:14.468779+0000","last_undegraded":"2023-05-10T04:19:14.468779+0000","last_fullsized":"2023-05-10T04:19:14.468779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:08:02.858561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577630+0000","last_change":"2023-05-10T04:19:09.480268+0000","last_active":"2023-05-10T04:19:14.577630+0000","last_peered":"2023-05-10T04:19:14.577630+0000","last_clean":"2023-05-10T04:19:14.577630+0000","last_became_active":"2023-05-10T04:19:09.480011+0000","last_became_peered":"2023-05-10T04:19:09.480011+0000","last_unstale":"2023-05-10T04:19:14.577630+0000","last_undegraded":"2023-05-10T04:19:14.577630+0000","last_fullsized":"2023-05-10T04:19:14.577630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:21.331301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202970+0000","last_change":"2023-05-10T04:19:09.981253+0000","last_active":"2023-05-10T04:19:15.202970+0000","last_peered":"2023-05-10T04:19:15.202970+0000","last_clean":"2023-05-10T04:19:15.202970+0000","last_became_active":"2023-05-10T04:19:09.981006+0000","last_became_peered":"2023-05-10T04:19:09.981006+0000","last_unstale":"2023-05-10T04:19:15.202970+0000","last_undegraded":"2023-05-10T04:19:15.202970+0000","last_fullsized":"2023-05-10T04:19:15.202970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:03.498156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201539+0000","last_change":"2023-05-10T04:19:13.987144+0000","last_active":"2023-05-10T04:19:15.201539+0000","last_peered":"2023-05-10T04:19:15.201539+0000","last_clean":"2023-05-10T04:19:15.201539+0000","last_became_active":"2023-05-10T04:19:13.986831+0000","last_became_peered":"2023-05-10T04:19:13.986831+0000","last_unstale":"2023-05-10T04:19:15.201539+0000","last_undegraded":"2023-05-10T04:19:15.201539+0000","last_fullsized":"2023-05-10T04:19:15.201539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:17:32.556742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578392+0000","last_change":"2023-05-10T04:19:09.478894+0000","last_active":"2023-05-10T04:19:14.578392+0000","last_peered":"2023-05-10T04:19:14.578392+0000","last_clean":"2023-05-10T04:19:14.578392+0000","last_became_active":"2023-05-10T04:19:09.478612+0000","last_became_peered":"2023-05-10T04:19:09.478612+0000","last_unstale":"2023-05-10T04:19:14.578392+0000","last_undegraded":"2023-05-10T04:19:14.578392+0000","last_fullsized":"2023-05-10T04:19:14.578392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:18:29.989914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627929+0000","last_change":"2023-05-10T04:19:09.975444+0000","last_active":"2023-05-10T04:19:14.627929+0000","last_peered":"2023-05-10T04:19:14.627929+0000","last_clean":"2023-05-10T04:19:14.627929+0000","last_became_active":"2023-05-10T04:19:09.971745+0000","last_became_peered":"2023-05-10T04:19:09.971745+0000","last_unstale":"2023-05-10T04:19:14.627929+0000","last_undegraded":"2023-05-10T04:19:14.627929+0000","last_fullsized":"2023-05-10T04:19:14.627929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:35:02.017465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201957+0000","last_change":"2023-05-10T04:19:14.001881+0000","last_active":"2023-05-10T04:19:15.201957+0000","last_peered":"2023-05-10T04:19:15.201957+0000","last_clean":"2023-05-10T04:19:15.201957+0000","last_became_active":"2023-05-10T04:19:14.001490+0000","last_became_peered":"2023-05-10T04:19:14.001490+0000","last_unstale":"2023-05-10T04:19:15.201957+0000","last_undegraded":"2023-05-10T04:19:15.201957+0000","last_fullsized":"2023-05-10T04:19:15.201957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:10.947560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202406+0000","last_change":"2023-05-10T04:19:09.479617+0000","last_active":"2023-05-10T04:19:15.202406+0000","last_peered":"2023-05-10T04:19:15.202406+0000","last_clean":"2023-05-10T04:19:15.202406+0000","last_became_active":"2023-05-10T04:19:09.479285+0000","last_became_peered":"2023-05-10T04:19:09.479285+0000","last_unstale":"2023-05-10T04:19:15.202406+0000","last_undegraded":"2023-05-10T04:19:15.202406+0000","last_fullsized":"2023-05-10T04:19:15.202406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:39:56.952219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469360+0000","last_change":"2023-05-10T04:19:09.972832+0000","last_active":"2023-05-10T04:19:14.469360+0000","last_peered":"2023-05-10T04:19:14.469360+0000","last_clean":"2023-05-10T04:19:14.469360+0000","last_became_active":"2023-05-10T04:19:09.972564+0000","last_became_peered":"2023-05-10T04:19:09.972564+0000","last_unstale":"2023-05-10T04:19:14.469360+0000","last_undegraded":"2023-05-10T04:19:14.469360+0000","last_fullsized":"2023-05-10T04:19:14.469360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:04:31.918880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468579+0000","last_change":"2023-05-10T04:19:13.994267+0000","last_active":"2023-05-10T04:19:14.468579+0000","last_peered":"2023-05-10T04:19:14.468579+0000","last_clean":"2023-05-10T04:19:14.468579+0000","last_became_active":"2023-05-10T04:19:13.993865+0000","last_became_peered":"2023-05-10T04:19:13.993865+0000","last_unstale":"2023-05-10T04:19:14.468579+0000","last_undegraded":"2023-05-10T04:19:14.468579+0000","last_fullsized":"2023-05-10T04:19:14.468579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:51:00.039452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468689+0000","last_change":"2023-05-10T04:19:09.484992+0000","last_active":"2023-05-10T04:19:14.468689+0000","last_peered":"2023-05-10T04:19:14.468689+0000","last_clean":"2023-05-10T04:19:14.468689+0000","last_became_active":"2023-05-10T04:19:09.484709+0000","last_became_peered":"2023-05-10T04:19:09.484709+0000","last_unstale":"2023-05-10T04:19:14.468689+0000","last_undegraded":"2023-05-10T04:19:14.468689+0000","last_fullsized":"2023-05-10T04:19:14.468689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:06.444490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469770+0000","last_change":"2023-05-10T04:19:09.964540+0000","last_active":"2023-05-10T04:19:14.469770+0000","last_peered":"2023-05-10T04:19:14.469770+0000","last_clean":"2023-05-10T04:19:14.469770+0000","last_became_active":"2023-05-10T04:19:09.964164+0000","last_became_peered":"2023-05-10T04:19:09.964164+0000","last_unstale":"2023-05-10T04:19:14.469770+0000","last_undegraded":"2023-05-10T04:19:14.469770+0000","last_fullsized":"2023-05-10T04:19:14.469770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:13:47.427518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468432+0000","last_change":"2023-05-10T04:19:13.997349+0000","last_active":"2023-05-10T04:19:14.468432+0000","last_peered":"2023-05-10T04:19:14.468432+0000","last_clean":"2023-05-10T04:19:14.468432+0000","last_became_active":"2023-05-10T04:19:13.996910+0000","last_became_peered":"2023-05-10T04:19:13.996910+0000","last_unstale":"2023-05-10T04:19:14.468432+0000","last_undegraded":"2023-05-10T04:19:14.468432+0000","last_fullsized":"2023-05-10T04:19:14.468432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:27:38.893568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:28.525847+0000","last_change":"2023-05-10T04:19:09.487001+0000","last_active":"2023-05-10T04:19:28.525847+0000","last_peered":"2023-05-10T04:19:28.525847+0000","last_clean":"2023-05-10T04:19:28.525847+0000","last_became_active":"2023-05-10T04:19:09.486586+0000","last_became_peered":"2023-05-10T04:19:09.486586+0000","last_unstale":"2023-05-10T04:19:28.525847+0000","last_undegraded":"2023-05-10T04:19:28.525847+0000","last_fullsized":"2023-05-10T04:19:28.525847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:00:37.583297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202590+0000","last_change":"2023-05-10T04:19:09.957140+0000","last_active":"2023-05-10T04:19:15.202590+0000","last_peered":"2023-05-10T04:19:15.202590+0000","last_clean":"2023-05-10T04:19:15.202590+0000","last_became_active":"2023-05-10T04:19:09.956865+0000","last_became_peered":"2023-05-10T04:19:09.956865+0000","last_unstale":"2023-05-10T04:19:15.202590+0000","last_undegraded":"2023-05-10T04:19:15.202590+0000","last_fullsized":"2023-05-10T04:19:15.202590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:02.330187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202728+0000","last_change":"2023-05-10T04:19:13.993185+0000","last_active":"2023-05-10T04:19:15.202728+0000","last_peered":"2023-05-10T04:19:15.202728+0000","last_clean":"2023-05-10T04:19:15.202728+0000","last_became_active":"2023-05-10T04:19:13.992692+0000","last_became_peered":"2023-05-10T04:19:13.992692+0000","last_unstale":"2023-05-10T04:19:15.202728+0000","last_undegraded":"2023-05-10T04:19:15.202728+0000","last_fullsized":"2023-05-10T04:19:15.202728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:47:10.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202224+0000","last_change":"2023-05-10T04:19:09.484968+0000","last_active":"2023-05-10T04:19:15.202224+0000","last_peered":"2023-05-10T04:19:15.202224+0000","last_clean":"2023-05-10T04:19:15.202224+0000","last_became_active":"2023-05-10T04:19:09.484666+0000","last_became_peered":"2023-05-10T04:19:09.484666+0000","last_unstale":"2023-05-10T04:19:15.202224+0000","last_undegraded":"2023-05-10T04:19:15.202224+0000","last_fullsized":"2023-05-10T04:19:15.202224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:34:47.348283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468720+0000","last_change":"2023-05-10T04:19:09.965098+0000","last_active":"2023-05-10T04:19:14.468720+0000","last_peered":"2023-05-10T04:19:14.468720+0000","last_clean":"2023-05-10T04:19:14.468720+0000","last_became_active":"2023-05-10T04:19:09.964725+0000","last_became_peered":"2023-05-10T04:19:09.964725+0000","last_unstale":"2023-05-10T04:19:14.468720+0000","last_undegraded":"2023-05-10T04:19:14.468720+0000","last_fullsized":"2023-05-10T04:19:14.468720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:03.210099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469999+0000","last_change":"2023-05-10T04:19:13.993540+0000","last_active":"2023-05-10T04:19:14.469999+0000","last_peered":"2023-05-10T04:19:14.469999+0000","last_clean":"2023-05-10T04:19:14.469999+0000","last_became_active":"2023-05-10T04:19:13.993066+0000","last_became_peered":"2023-05-10T04:19:13.993066+0000","last_unstale":"2023-05-10T04:19:14.469999+0000","last_undegraded":"2023-05-10T04:19:14.469999+0000","last_fullsized":"2023-05-10T04:19:14.469999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:14:45.505584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470101+0000","last_change":"2023-05-10T04:19:09.488098+0000","last_active":"2023-05-10T04:19:14.470101+0000","last_peered":"2023-05-10T04:19:14.470101+0000","last_clean":"2023-05-10T04:19:14.470101+0000","last_became_active":"2023-05-10T04:19:09.487742+0000","last_became_peered":"2023-05-10T04:19:09.487742+0000","last_unstale":"2023-05-10T04:19:14.470101+0000","last_undegraded":"2023-05-10T04:19:14.470101+0000","last_fullsized":"2023-05-10T04:19:14.470101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:07.819601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202937+0000","last_change":"2023-05-10T04:19:09.972874+0000","last_active":"2023-05-10T04:19:15.202937+0000","last_peered":"2023-05-10T04:19:15.202937+0000","last_clean":"2023-05-10T04:19:15.202937+0000","last_became_active":"2023-05-10T04:19:09.972566+0000","last_became_peered":"2023-05-10T04:19:09.972566+0000","last_unstale":"2023-05-10T04:19:15.202937+0000","last_undegraded":"2023-05-10T04:19:15.202937+0000","last_fullsized":"2023-05-10T04:19:15.202937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:13:49.010588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470263+0000","last_change":"2023-05-10T04:19:13.993797+0000","last_active":"2023-05-10T04:19:14.470263+0000","last_peered":"2023-05-10T04:19:14.470263+0000","last_clean":"2023-05-10T04:19:14.470263+0000","last_became_active":"2023-05-10T04:19:13.993365+0000","last_became_peered":"2023-05-10T04:19:13.993365+0000","last_unstale":"2023-05-10T04:19:14.470263+0000","last_undegraded":"2023-05-10T04:19:14.470263+0000","last_fullsized":"2023-05-10T04:19:14.470263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:09:47.459492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201324+0000","last_change":"2023-05-10T04:19:09.486993+0000","last_active":"2023-05-10T04:19:15.201324+0000","last_peered":"2023-05-10T04:19:15.201324+0000","last_clean":"2023-05-10T04:19:15.201324+0000","last_became_active":"2023-05-10T04:19:09.486669+0000","last_became_peered":"2023-05-10T04:19:09.486669+0000","last_unstale":"2023-05-10T04:19:15.201324+0000","last_undegraded":"2023-05-10T04:19:15.201324+0000","last_fullsized":"2023-05-10T04:19:15.201324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:16:36.569982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578044+0000","last_change":"2023-05-10T04:19:09.983016+0000","last_active":"2023-05-10T04:19:14.578044+0000","last_peered":"2023-05-10T04:19:14.578044+0000","last_clean":"2023-05-10T04:19:14.578044+0000","last_became_active":"2023-05-10T04:19:09.982497+0000","last_became_peered":"2023-05-10T04:19:09.982497+0000","last_unstale":"2023-05-10T04:19:14.578044+0000","last_undegraded":"2023-05-10T04:19:14.578044+0000","last_fullsized":"2023-05-10T04:19:14.578044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:21:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203604+0000","last_change":"2023-05-10T04:19:13.994827+0000","last_active":"2023-05-10T04:19:15.203604+0000","last_peered":"2023-05-10T04:19:15.203604+0000","last_clean":"2023-05-10T04:19:15.203604+0000","last_became_active":"2023-05-10T04:19:13.994438+0000","last_became_peered":"2023-05-10T04:19:13.994438+0000","last_unstale":"2023-05-10T04:19:15.203604+0000","last_undegraded":"2023-05-10T04:19:15.203604+0000","last_fullsized":"2023-05-10T04:19:15.203604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:46.248734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203225+0000","last_change":"2023-05-10T04:19:09.487877+0000","last_active":"2023-05-10T04:19:15.203225+0000","last_peered":"2023-05-10T04:19:15.203225+0000","last_clean":"2023-05-10T04:19:15.203225+0000","last_became_active":"2023-05-10T04:19:09.487604+0000","last_became_peered":"2023-05-10T04:19:09.487604+0000","last_unstale":"2023-05-10T04:19:15.203225+0000","last_undegraded":"2023-05-10T04:19:15.203225+0000","last_fullsized":"2023-05-10T04:19:15.203225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:53:17.665016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578524+0000","last_change":"2023-05-10T04:19:09.980726+0000","last_active":"2023-05-10T04:19:14.578524+0000","last_peered":"2023-05-10T04:19:14.578524+0000","last_clean":"2023-05-10T04:19:14.578524+0000","last_became_active":"2023-05-10T04:19:09.980180+0000","last_became_peered":"2023-05-10T04:19:09.980180+0000","last_unstale":"2023-05-10T04:19:14.578524+0000","last_undegraded":"2023-05-10T04:19:14.578524+0000","last_fullsized":"2023-05-10T04:19:14.578524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:00.301504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203398+0000","last_change":"2023-05-10T04:19:14.003780+0000","last_active":"2023-05-10T04:19:15.203398+0000","last_peered":"2023-05-10T04:19:15.203398+0000","last_clean":"2023-05-10T04:19:15.203398+0000","last_became_active":"2023-05-10T04:19:14.003409+0000","last_became_peered":"2023-05-10T04:19:14.003409+0000","last_unstale":"2023-05-10T04:19:15.203398+0000","last_undegraded":"2023-05-10T04:19:15.203398+0000","last_fullsized":"2023-05-10T04:19:15.203398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:50:12.629644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469034+0000","last_change":"2023-05-10T04:19:09.483762+0000","last_active":"2023-05-10T04:19:14.469034+0000","last_peered":"2023-05-10T04:19:14.469034+0000","last_clean":"2023-05-10T04:19:14.469034+0000","last_became_active":"2023-05-10T04:19:09.483508+0000","last_became_peered":"2023-05-10T04:19:09.483508+0000","last_unstale":"2023-05-10T04:19:14.469034+0000","last_undegraded":"2023-05-10T04:19:14.469034+0000","last_fullsized":"2023-05-10T04:19:14.469034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:01.327876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201995+0000","last_change":"2023-05-10T04:19:09.978563+0000","last_active":"2023-05-10T04:19:15.201995+0000","last_peered":"2023-05-10T04:19:15.201995+0000","last_clean":"2023-05-10T04:19:15.201995+0000","last_became_active":"2023-05-10T04:19:09.978238+0000","last_became_peered":"2023-05-10T04:19:09.978238+0000","last_unstale":"2023-05-10T04:19:15.201995+0000","last_undegraded":"2023-05-10T04:19:15.201995+0000","last_fullsized":"2023-05-10T04:19:15.201995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:20:11.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468304+0000","last_change":"2023-05-10T04:19:13.991533+0000","last_active":"2023-05-10T04:19:14.468304+0000","last_peered":"2023-05-10T04:19:14.468304+0000","last_clean":"2023-05-10T04:19:14.468304+0000","last_became_active":"2023-05-10T04:19:13.990999+0000","last_became_peered":"2023-05-10T04:19:13.990999+0000","last_unstale":"2023-05-10T04:19:14.468304+0000","last_undegraded":"2023-05-10T04:19:14.468304+0000","last_fullsized":"2023-05-10T04:19:14.468304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:05.585266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202273+0000","last_change":"2023-05-10T04:19:09.485526+0000","last_active":"2023-05-10T04:19:15.202273+0000","last_peered":"2023-05-10T04:19:15.202273+0000","last_clean":"2023-05-10T04:19:15.202273+0000","last_became_active":"2023-05-10T04:19:09.485273+0000","last_became_peered":"2023-05-10T04:19:09.485273+0000","last_unstale":"2023-05-10T04:19:15.202273+0000","last_undegraded":"2023-05-10T04:19:15.202273+0000","last_fullsized":"2023-05-10T04:19:15.202273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:41.760079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203432+0000","last_change":"2023-05-10T04:19:09.985453+0000","last_active":"2023-05-10T04:19:15.203432+0000","last_peered":"2023-05-10T04:19:15.203432+0000","last_clean":"2023-05-10T04:19:15.203432+0000","last_became_active":"2023-05-10T04:19:09.985167+0000","last_became_peered":"2023-05-10T04:19:09.985167+0000","last_unstale":"2023-05-10T04:19:15.203432+0000","last_undegraded":"2023-05-10T04:19:15.203432+0000","last_fullsized":"2023-05-10T04:19:15.203432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:22.333611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577827+0000","last_change":"2023-05-10T04:19:14.004309+0000","last_active":"2023-05-10T04:19:14.577827+0000","last_peered":"2023-05-10T04:19:14.577827+0000","last_clean":"2023-05-10T04:19:14.577827+0000","last_became_active":"2023-05-10T04:19:14.003928+0000","last_became_peered":"2023-05-10T04:19:14.003928+0000","last_unstale":"2023-05-10T04:19:14.577827+0000","last_undegraded":"2023-05-10T04:19:14.577827+0000","last_fullsized":"2023-05-10T04:19:14.577827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:24:10.810295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202378+0000","last_change":"2023-05-10T04:19:09.482542+0000","last_active":"2023-05-10T04:19:15.202378+0000","last_peered":"2023-05-10T04:19:15.202378+0000","last_clean":"2023-05-10T04:19:15.202378+0000","last_became_active":"2023-05-10T04:19:09.482173+0000","last_became_peered":"2023-05-10T04:19:09.482173+0000","last_unstale":"2023-05-10T04:19:15.202378+0000","last_undegraded":"2023-05-10T04:19:15.202378+0000","last_fullsized":"2023-05-10T04:19:15.202378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:55:03.870485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202375+0000","last_change":"2023-05-10T04:19:09.957801+0000","last_active":"2023-05-10T04:19:15.202375+0000","last_peered":"2023-05-10T04:19:15.202375+0000","last_clean":"2023-05-10T04:19:15.202375+0000","last_became_active":"2023-05-10T04:19:09.957469+0000","last_became_peered":"2023-05-10T04:19:09.957469+0000","last_unstale":"2023-05-10T04:19:15.202375+0000","last_undegraded":"2023-05-10T04:19:15.202375+0000","last_fullsized":"2023-05-10T04:19:15.202375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:26:39.953202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469741+0000","last_change":"2023-05-10T04:19:13.991736+0000","last_active":"2023-05-10T04:19:14.469741+0000","last_peered":"2023-05-10T04:19:14.469741+0000","last_clean":"2023-05-10T04:19:14.469741+0000","last_became_active":"2023-05-10T04:19:13.991194+0000","last_became_peered":"2023-05-10T04:19:13.991194+0000","last_unstale":"2023-05-10T04:19:14.469741+0000","last_undegraded":"2023-05-10T04:19:14.469741+0000","last_fullsized":"2023-05-10T04:19:14.469741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:50:12.629644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468850+0000","last_change":"2023-05-10T04:19:09.483818+0000","last_active":"2023-05-10T04:19:14.468850+0000","last_peered":"2023-05-10T04:19:14.468850+0000","last_clean":"2023-05-10T04:19:14.468850+0000","last_became_active":"2023-05-10T04:19:09.483516+0000","last_became_peered":"2023-05-10T04:19:09.483516+0000","last_unstale":"2023-05-10T04:19:14.468850+0000","last_undegraded":"2023-05-10T04:19:14.468850+0000","last_fullsized":"2023-05-10T04:19:14.468850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:39:56.952219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577909+0000","last_change":"2023-05-10T04:19:09.979521+0000","last_active":"2023-05-10T04:19:14.577909+0000","last_peered":"2023-05-10T04:19:14.577909+0000","last_clean":"2023-05-10T04:19:14.577909+0000","last_became_active":"2023-05-10T04:19:09.979271+0000","last_became_peered":"2023-05-10T04:19:09.979271+0000","last_unstale":"2023-05-10T04:19:14.577909+0000","last_undegraded":"2023-05-10T04:19:14.577909+0000","last_fullsized":"2023-05-10T04:19:14.577909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:05:43.697518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628055+0000","last_change":"2023-05-10T04:19:13.998610+0000","last_active":"2023-05-10T04:19:14.628055+0000","last_peered":"2023-05-10T04:19:14.628055+0000","last_clean":"2023-05-10T04:19:14.628055+0000","last_became_active":"2023-05-10T04:19:13.996908+0000","last_became_peered":"2023-05-10T04:19:13.996908+0000","last_unstale":"2023-05-10T04:19:14.628055+0000","last_undegraded":"2023-05-10T04:19:14.628055+0000","last_fullsized":"2023-05-10T04:19:14.628055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:00:47.831221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628332+0000","last_change":"2023-05-10T04:19:09.482944+0000","last_active":"2023-05-10T04:19:14.628332+0000","last_peered":"2023-05-10T04:19:14.628332+0000","last_clean":"2023-05-10T04:19:14.628332+0000","last_became_active":"2023-05-10T04:19:09.482584+0000","last_became_peered":"2023-05-10T04:19:09.482584+0000","last_unstale":"2023-05-10T04:19:14.628332+0000","last_undegraded":"2023-05-10T04:19:14.628332+0000","last_fullsized":"2023-05-10T04:19:14.628332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:22:54.728492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468803+0000","last_change":"2023-05-10T04:19:09.971873+0000","last_active":"2023-05-10T04:19:14.468803+0000","last_peered":"2023-05-10T04:19:14.468803+0000","last_clean":"2023-05-10T04:19:14.468803+0000","last_became_active":"2023-05-10T04:19:09.971597+0000","last_became_peered":"2023-05-10T04:19:09.971597+0000","last_unstale":"2023-05-10T04:19:14.468803+0000","last_undegraded":"2023-05-10T04:19:14.468803+0000","last_fullsized":"2023-05-10T04:19:14.468803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:26:39.953202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577980+0000","last_change":"2023-05-10T04:19:14.004765+0000","last_active":"2023-05-10T04:19:14.577980+0000","last_peered":"2023-05-10T04:19:14.577980+0000","last_clean":"2023-05-10T04:19:14.577980+0000","last_became_active":"2023-05-10T04:19:14.004329+0000","last_became_peered":"2023-05-10T04:19:14.004329+0000","last_unstale":"2023-05-10T04:19:14.577980+0000","last_undegraded":"2023-05-10T04:19:14.577980+0000","last_fullsized":"2023-05-10T04:19:14.577980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:01:56.052239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202125+0000","last_change":"2023-05-10T04:19:09.477530+0000","last_active":"2023-05-10T04:19:15.202125+0000","last_peered":"2023-05-10T04:19:15.202125+0000","last_clean":"2023-05-10T04:19:15.202125+0000","last_became_active":"2023-05-10T04:19:09.477212+0000","last_became_peered":"2023-05-10T04:19:09.477212+0000","last_unstale":"2023-05-10T04:19:15.202125+0000","last_undegraded":"2023-05-10T04:19:15.202125+0000","last_fullsized":"2023-05-10T04:19:15.202125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:43.682176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203043+0000","last_change":"2023-05-10T04:19:09.979824+0000","last_active":"2023-05-10T04:19:15.203043+0000","last_peered":"2023-05-10T04:19:15.203043+0000","last_clean":"2023-05-10T04:19:15.203043+0000","last_became_active":"2023-05-10T04:19:09.979050+0000","last_became_peered":"2023-05-10T04:19:09.979050+0000","last_unstale":"2023-05-10T04:19:15.203043+0000","last_undegraded":"2023-05-10T04:19:15.203043+0000","last_fullsized":"2023-05-10T04:19:15.203043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:38:42.232230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203438+0000","last_change":"2023-05-10T04:19:14.002975+0000","last_active":"2023-05-10T04:19:15.203438+0000","last_peered":"2023-05-10T04:19:15.203438+0000","last_clean":"2023-05-10T04:19:15.203438+0000","last_became_active":"2023-05-10T04:19:14.002560+0000","last_became_peered":"2023-05-10T04:19:14.002560+0000","last_unstale":"2023-05-10T04:19:15.203438+0000","last_undegraded":"2023-05-10T04:19:15.203438+0000","last_fullsized":"2023-05-10T04:19:15.203438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:23:30.609594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201619+0000","last_change":"2023-05-10T04:19:09.474972+0000","last_active":"2023-05-10T04:19:15.201619+0000","last_peered":"2023-05-10T04:19:15.201619+0000","last_clean":"2023-05-10T04:19:15.201619+0000","last_became_active":"2023-05-10T04:19:09.474099+0000","last_became_peered":"2023-05-10T04:19:09.474099+0000","last_unstale":"2023-05-10T04:19:15.201619+0000","last_undegraded":"2023-05-10T04:19:15.201619+0000","last_fullsized":"2023-05-10T04:19:15.201619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:54:08.193033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202858+0000","last_change":"2023-05-10T04:19:09.957614+0000","last_active":"2023-05-10T04:19:15.202858+0000","last_peered":"2023-05-10T04:19:15.202858+0000","last_clean":"2023-05-10T04:19:15.202858+0000","last_became_active":"2023-05-10T04:19:09.957357+0000","last_became_peered":"2023-05-10T04:19:09.957357+0000","last_unstale":"2023-05-10T04:19:15.202858+0000","last_undegraded":"2023-05-10T04:19:15.202858+0000","last_fullsized":"2023-05-10T04:19:15.202858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:58:35.622573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202916+0000","last_change":"2023-05-10T04:19:13.993397+0000","last_active":"2023-05-10T04:19:15.202916+0000","last_peered":"2023-05-10T04:19:15.202916+0000","last_clean":"2023-05-10T04:19:15.202916+0000","last_became_active":"2023-05-10T04:19:13.992829+0000","last_became_peered":"2023-05-10T04:19:13.992829+0000","last_unstale":"2023-05-10T04:19:15.202916+0000","last_undegraded":"2023-05-10T04:19:15.202916+0000","last_fullsized":"2023-05-10T04:19:15.202916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:20:16.772499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469100+0000","last_change":"2023-05-10T04:19:09.473096+0000","last_active":"2023-05-10T04:19:14.469100+0000","last_peered":"2023-05-10T04:19:14.469100+0000","last_clean":"2023-05-10T04:19:14.469100+0000","last_became_active":"2023-05-10T04:19:09.472782+0000","last_became_peered":"2023-05-10T04:19:09.472782+0000","last_unstale":"2023-05-10T04:19:14.469100+0000","last_undegraded":"2023-05-10T04:19:14.469100+0000","last_fullsized":"2023-05-10T04:19:14.469100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:55:45.107377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628277+0000","last_change":"2023-05-10T04:19:09.976127+0000","last_active":"2023-05-10T04:19:14.628277+0000","last_peered":"2023-05-10T04:19:14.628277+0000","last_clean":"2023-05-10T04:19:14.628277+0000","last_became_active":"2023-05-10T04:19:09.975290+0000","last_became_peered":"2023-05-10T04:19:09.975290+0000","last_unstale":"2023-05-10T04:19:14.628277+0000","last_undegraded":"2023-05-10T04:19:14.628277+0000","last_fullsized":"2023-05-10T04:19:14.628277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:16.352843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468740+0000","last_change":"2023-05-10T04:19:13.993845+0000","last_active":"2023-05-10T04:19:14.468740+0000","last_peered":"2023-05-10T04:19:14.468740+0000","last_clean":"2023-05-10T04:19:14.468740+0000","last_became_active":"2023-05-10T04:19:13.993409+0000","last_became_peered":"2023-05-10T04:19:13.993409+0000","last_unstale":"2023-05-10T04:19:14.468740+0000","last_undegraded":"2023-05-10T04:19:14.468740+0000","last_fullsized":"2023-05-10T04:19:14.468740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:43:57.821791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578256+0000","last_change":"2023-05-10T04:19:04.607342+0000","last_active":"2023-05-10T04:19:14.578256+0000","last_peered":"2023-05-10T04:19:14.578256+0000","last_clean":"2023-05-10T04:19:14.578256+0000","last_became_active":"2023-05-10T04:19:04.606956+0000","last_became_peered":"2023-05-10T04:19:04.606956+0000","last_unstale":"2023-05-10T04:19:14.578256+0000","last_undegraded":"2023-05-10T04:19:14.578256+0000","last_fullsized":"2023-05-10T04:19:14.578256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:51.656021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203073+0000","last_change":"2023-05-10T04:19:09.480586+0000","last_active":"2023-05-10T04:19:15.203073+0000","last_peered":"2023-05-10T04:19:15.203073+0000","last_clean":"2023-05-10T04:19:15.203073+0000","last_became_active":"2023-05-10T04:19:09.480088+0000","last_became_peered":"2023-05-10T04:19:09.480088+0000","last_unstale":"2023-05-10T04:19:15.203073+0000","last_undegraded":"2023-05-10T04:19:15.203073+0000","last_fullsized":"2023-05-10T04:19:15.203073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:07:58.355490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469903+0000","last_change":"2023-05-10T04:19:09.961077+0000","last_active":"2023-05-10T04:19:14.469903+0000","last_peered":"2023-05-10T04:19:14.469903+0000","last_clean":"2023-05-10T04:19:14.469903+0000","last_became_active":"2023-05-10T04:19:09.960790+0000","last_became_peered":"2023-05-10T04:19:09.960790+0000","last_unstale":"2023-05-10T04:19:14.469903+0000","last_undegraded":"2023-05-10T04:19:14.469903+0000","last_fullsized":"2023-05-10T04:19:14.469903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:23:27.108834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628434+0000","last_change":"2023-05-10T04:19:13.996996+0000","last_active":"2023-05-10T04:19:14.628434+0000","last_peered":"2023-05-10T04:19:14.628434+0000","last_clean":"2023-05-10T04:19:14.628434+0000","last_became_active":"2023-05-10T04:19:13.996598+0000","last_became_peered":"2023-05-10T04:19:13.996598+0000","last_unstale":"2023-05-10T04:19:14.628434+0000","last_undegraded":"2023-05-10T04:19:14.628434+0000","last_fullsized":"2023-05-10T04:19:14.628434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:28.777158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204389+0000","last_change":"2023-05-10T04:19:04.607370+0000","last_active":"2023-05-10T04:19:15.204389+0000","last_peered":"2023-05-10T04:19:15.204389+0000","last_clean":"2023-05-10T04:19:15.204389+0000","last_became_active":"2023-05-10T04:19:04.606959+0000","last_became_peered":"2023-05-10T04:19:04.606959+0000","last_unstale":"2023-05-10T04:19:15.204389+0000","last_undegraded":"2023-05-10T04:19:15.204389+0000","last_fullsized":"2023-05-10T04:19:15.204389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:46:45.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468586+0000","last_change":"2023-05-10T04:19:09.485273+0000","last_active":"2023-05-10T04:19:14.468586+0000","last_peered":"2023-05-10T04:19:14.468586+0000","last_clean":"2023-05-10T04:19:14.468586+0000","last_became_active":"2023-05-10T04:19:09.484339+0000","last_became_peered":"2023-05-10T04:19:09.484339+0000","last_unstale":"2023-05-10T04:19:14.468586+0000","last_undegraded":"2023-05-10T04:19:14.468586+0000","last_fullsized":"2023-05-10T04:19:14.468586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:22:54.728492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468949+0000","last_change":"2023-05-10T04:19:09.972782+0000","last_active":"2023-05-10T04:19:14.468949+0000","last_peered":"2023-05-10T04:19:14.468949+0000","last_clean":"2023-05-10T04:19:14.468949+0000","last_became_active":"2023-05-10T04:19:09.972529+0000","last_became_peered":"2023-05-10T04:19:09.972529+0000","last_unstale":"2023-05-10T04:19:14.468949+0000","last_undegraded":"2023-05-10T04:19:14.468949+0000","last_fullsized":"2023-05-10T04:19:14.468949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:58:35.622573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628526+0000","last_change":"2023-05-10T04:19:13.998192+0000","last_active":"2023-05-10T04:19:14.628526+0000","last_peered":"2023-05-10T04:19:14.628526+0000","last_clean":"2023-05-10T04:19:14.628526+0000","last_became_active":"2023-05-10T04:19:13.997769+0000","last_became_peered":"2023-05-10T04:19:13.997769+0000","last_unstale":"2023-05-10T04:19:14.628526+0000","last_undegraded":"2023-05-10T04:19:14.628526+0000","last_fullsized":"2023-05-10T04:19:14.628526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:46.263150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627832+0000","last_change":"2023-05-10T04:19:04.443832+0000","last_active":"2023-05-10T04:19:14.627832+0000","last_peered":"2023-05-10T04:19:14.627832+0000","last_clean":"2023-05-10T04:19:14.627832+0000","last_became_active":"2023-05-10T04:19:04.443487+0000","last_became_peered":"2023-05-10T04:19:04.443487+0000","last_unstale":"2023-05-10T04:19:14.627832+0000","last_undegraded":"2023-05-10T04:19:14.627832+0000","last_fullsized":"2023-05-10T04:19:14.627832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:15:00.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577489+0000","last_change":"2023-05-10T04:19:09.485735+0000","last_active":"2023-05-10T04:19:14.577489+0000","last_peered":"2023-05-10T04:19:14.577489+0000","last_clean":"2023-05-10T04:19:14.577489+0000","last_became_active":"2023-05-10T04:19:09.485425+0000","last_became_peered":"2023-05-10T04:19:09.485425+0000","last_unstale":"2023-05-10T04:19:14.577489+0000","last_undegraded":"2023-05-10T04:19:14.577489+0000","last_fullsized":"2023-05-10T04:19:14.577489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:07.819601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469043+0000","last_change":"2023-05-10T04:19:09.977673+0000","last_active":"2023-05-10T04:19:14.469043+0000","last_peered":"2023-05-10T04:19:14.469043+0000","last_clean":"2023-05-10T04:19:14.469043+0000","last_became_active":"2023-05-10T04:19:09.977396+0000","last_became_peered":"2023-05-10T04:19:09.977396+0000","last_unstale":"2023-05-10T04:19:14.469043+0000","last_undegraded":"2023-05-10T04:19:14.469043+0000","last_fullsized":"2023-05-10T04:19:14.469043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:19.596953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468711+0000","last_change":"2023-05-10T04:19:13.997725+0000","last_active":"2023-05-10T04:19:14.468711+0000","last_peered":"2023-05-10T04:19:14.468711+0000","last_clean":"2023-05-10T04:19:14.468711+0000","last_became_active":"2023-05-10T04:19:13.997358+0000","last_became_peered":"2023-05-10T04:19:13.997358+0000","last_unstale":"2023-05-10T04:19:14.468711+0000","last_undegraded":"2023-05-10T04:19:14.468711+0000","last_fullsized":"2023-05-10T04:19:14.468711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:28.777158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202014+0000","last_change":"2023-05-10T04:19:04.443331+0000","last_active":"2023-05-10T04:19:15.202014+0000","last_peered":"2023-05-10T04:19:15.202014+0000","last_clean":"2023-05-10T04:19:15.202014+0000","last_became_active":"2023-05-10T04:19:04.443060+0000","last_became_peered":"2023-05-10T04:19:04.443060+0000","last_unstale":"2023-05-10T04:19:15.202014+0000","last_undegraded":"2023-05-10T04:19:15.202014+0000","last_fullsized":"2023-05-10T04:19:15.202014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:57:20.264880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203569+0000","last_change":"2023-05-10T04:18:57.192195+0000","last_active":"2023-05-10T04:19:15.203569+0000","last_peered":"2023-05-10T04:19:15.203569+0000","last_clean":"2023-05-10T04:19:15.203569+0000","last_became_active":"2023-05-10T04:18:57.191298+0000","last_became_peered":"2023-05-10T04:18:57.191298+0000","last_unstale":"2023-05-10T04:19:15.203569+0000","last_undegraded":"2023-05-10T04:19:15.203569+0000","last_fullsized":"2023-05-10T04:19:15.203569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_clean_scrub_stamp":"2023-05-10T04:18:56.172967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:05:30.415630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469650+0000","last_change":"2023-05-10T04:19:09.473780+0000","last_active":"2023-05-10T04:19:14.469650+0000","last_peered":"2023-05-10T04:19:14.469650+0000","last_clean":"2023-05-10T04:19:14.469650+0000","last_became_active":"2023-05-10T04:19:09.473417+0000","last_became_peered":"2023-05-10T04:19:09.473417+0000","last_unstale":"2023-05-10T04:19:14.469650+0000","last_undegraded":"2023-05-10T04:19:14.469650+0000","last_fullsized":"2023-05-10T04:19:14.469650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:35:58.690053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202817+0000","last_change":"2023-05-10T04:19:09.980022+0000","last_active":"2023-05-10T04:19:15.202817+0000","last_peered":"2023-05-10T04:19:15.202817+0000","last_clean":"2023-05-10T04:19:15.202817+0000","last_became_active":"2023-05-10T04:19:09.979557+0000","last_became_peered":"2023-05-10T04:19:09.979557+0000","last_unstale":"2023-05-10T04:19:15.202817+0000","last_undegraded":"2023-05-10T04:19:15.202817+0000","last_fullsized":"2023-05-10T04:19:15.202817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:27:31.317037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202554+0000","last_change":"2023-05-10T04:19:13.990077+0000","last_active":"2023-05-10T04:19:15.202554+0000","last_peered":"2023-05-10T04:19:15.202554+0000","last_clean":"2023-05-10T04:19:15.202554+0000","last_became_active":"2023-05-10T04:19:13.989665+0000","last_became_peered":"2023-05-10T04:19:13.989665+0000","last_unstale":"2023-05-10T04:19:15.202554+0000","last_undegraded":"2023-05-10T04:19:15.202554+0000","last_fullsized":"2023-05-10T04:19:15.202554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:56:23.432293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201872+0000","last_change":"2023-05-10T04:19:04.443785+0000","last_active":"2023-05-10T04:19:15.201872+0000","last_peered":"2023-05-10T04:19:15.201872+0000","last_clean":"2023-05-10T04:19:15.201872+0000","last_became_active":"2023-05-10T04:19:04.443499+0000","last_became_peered":"2023-05-10T04:19:04.443499+0000","last_unstale":"2023-05-10T04:19:15.201872+0000","last_undegraded":"2023-05-10T04:19:15.201872+0000","last_fullsized":"2023-05-10T04:19:15.201872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:36:06.817648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468318+0000","last_change":"2023-05-10T04:19:09.480112+0000","last_active":"2023-05-10T04:19:14.468318+0000","last_peered":"2023-05-10T04:19:14.468318+0000","last_clean":"2023-05-10T04:19:14.468318+0000","last_became_active":"2023-05-10T04:19:09.479809+0000","last_became_peered":"2023-05-10T04:19:09.479809+0000","last_unstale":"2023-05-10T04:19:14.468318+0000","last_undegraded":"2023-05-10T04:19:14.468318+0000","last_fullsized":"2023-05-10T04:19:14.468318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:01.327876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578367+0000","last_change":"2023-05-10T04:19:09.982844+0000","last_active":"2023-05-10T04:19:14.578367+0000","last_peered":"2023-05-10T04:19:14.578367+0000","last_clean":"2023-05-10T04:19:14.578367+0000","last_became_active":"2023-05-10T04:19:09.982169+0000","last_became_peered":"2023-05-10T04:19:09.982169+0000","last_unstale":"2023-05-10T04:19:14.578367+0000","last_undegraded":"2023-05-10T04:19:14.578367+0000","last_fullsized":"2023-05-10T04:19:14.578367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:15:37.641989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468590+0000","last_change":"2023-05-10T04:19:13.996191+0000","last_active":"2023-05-10T04:19:14.468590+0000","last_peered":"2023-05-10T04:19:14.468590+0000","last_clean":"2023-05-10T04:19:14.468590+0000","last_became_active":"2023-05-10T04:19:13.995821+0000","last_became_peered":"2023-05-10T04:19:13.995821+0000","last_unstale":"2023-05-10T04:19:14.468590+0000","last_undegraded":"2023-05-10T04:19:14.468590+0000","last_fullsized":"2023-05-10T04:19:14.468590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:19.853603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202501+0000","last_change":"2023-05-10T04:19:04.442968+0000","last_active":"2023-05-10T04:19:15.202501+0000","last_peered":"2023-05-10T04:19:15.202501+0000","last_clean":"2023-05-10T04:19:15.202501+0000","last_became_active":"2023-05-10T04:19:04.442633+0000","last_became_peered":"2023-05-10T04:19:04.442633+0000","last_unstale":"2023-05-10T04:19:15.202501+0000","last_undegraded":"2023-05-10T04:19:15.202501+0000","last_fullsized":"2023-05-10T04:19:15.202501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:25:07.501670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469097+0000","last_change":"2023-05-10T04:19:09.484103+0000","last_active":"2023-05-10T04:19:14.469097+0000","last_peered":"2023-05-10T04:19:14.469097+0000","last_clean":"2023-05-10T04:19:14.469097+0000","last_became_active":"2023-05-10T04:19:09.483770+0000","last_became_peered":"2023-05-10T04:19:09.483770+0000","last_unstale":"2023-05-10T04:19:14.469097+0000","last_undegraded":"2023-05-10T04:19:14.469097+0000","last_fullsized":"2023-05-10T04:19:14.469097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:53:17.665016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469128+0000","last_change":"2023-05-10T04:19:09.971611+0000","last_active":"2023-05-10T04:19:14.469128+0000","last_peered":"2023-05-10T04:19:14.469128+0000","last_clean":"2023-05-10T04:19:14.469128+0000","last_became_active":"2023-05-10T04:19:09.971338+0000","last_became_peered":"2023-05-10T04:19:09.971338+0000","last_unstale":"2023-05-10T04:19:14.469128+0000","last_undegraded":"2023-05-10T04:19:14.469128+0000","last_fullsized":"2023-05-10T04:19:14.469128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:54:23.670496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202060+0000","last_change":"2023-05-10T04:19:13.990413+0000","last_active":"2023-05-10T04:19:15.202060+0000","last_peered":"2023-05-10T04:19:15.202060+0000","last_clean":"2023-05-10T04:19:15.202060+0000","last_became_active":"2023-05-10T04:19:13.988555+0000","last_became_peered":"2023-05-10T04:19:13.988555+0000","last_unstale":"2023-05-10T04:19:15.202060+0000","last_undegraded":"2023-05-10T04:19:15.202060+0000","last_fullsized":"2023-05-10T04:19:15.202060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:44:59.851980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470404+0000","last_change":"2023-05-10T04:19:09.480141+0000","last_active":"2023-05-10T04:19:14.470404+0000","last_peered":"2023-05-10T04:19:14.470404+0000","last_clean":"2023-05-10T04:19:14.470404+0000","last_became_active":"2023-05-10T04:19:09.479868+0000","last_became_peered":"2023-05-10T04:19:09.479868+0000","last_unstale":"2023-05-10T04:19:14.470404+0000","last_undegraded":"2023-05-10T04:19:14.470404+0000","last_fullsized":"2023-05-10T04:19:14.470404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:40:32.714684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470401+0000","last_change":"2023-05-10T04:19:04.440282+0000","last_active":"2023-05-10T04:19:14.470401+0000","last_peered":"2023-05-10T04:19:14.470401+0000","last_clean":"2023-05-10T04:19:14.470401+0000","last_became_active":"2023-05-10T04:19:04.439945+0000","last_became_peered":"2023-05-10T04:19:04.439945+0000","last_unstale":"2023-05-10T04:19:14.470401+0000","last_undegraded":"2023-05-10T04:19:14.470401+0000","last_fullsized":"2023-05-10T04:19:14.470401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:08:26.159897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468913+0000","last_change":"2023-05-10T04:19:09.983026+0000","last_active":"2023-05-10T04:19:14.468913+0000","last_peered":"2023-05-10T04:19:14.468913+0000","last_clean":"2023-05-10T04:19:14.468913+0000","last_became_active":"2023-05-10T04:19:09.982665+0000","last_became_peered":"2023-05-10T04:19:09.982665+0000","last_unstale":"2023-05-10T04:19:14.468913+0000","last_undegraded":"2023-05-10T04:19:14.468913+0000","last_fullsized":"2023-05-10T04:19:14.468913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:36:35.332796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469350+0000","last_change":"2023-05-10T04:19:14.006885+0000","last_active":"2023-05-10T04:19:14.469350+0000","last_peered":"2023-05-10T04:19:14.469350+0000","last_clean":"2023-05-10T04:19:14.469350+0000","last_became_active":"2023-05-10T04:19:14.006506+0000","last_became_peered":"2023-05-10T04:19:14.006506+0000","last_unstale":"2023-05-10T04:19:14.469350+0000","last_undegraded":"2023-05-10T04:19:14.469350+0000","last_fullsized":"2023-05-10T04:19:14.469350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:31:03.826068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202770+0000","last_change":"2023-05-10T04:19:04.444610+0000","last_active":"2023-05-10T04:19:15.202770+0000","last_peered":"2023-05-10T04:19:15.202770+0000","last_clean":"2023-05-10T04:19:15.202770+0000","last_became_active":"2023-05-10T04:19:04.444273+0000","last_became_peered":"2023-05-10T04:19:04.444273+0000","last_unstale":"2023-05-10T04:19:15.202770+0000","last_undegraded":"2023-05-10T04:19:15.202770+0000","last_fullsized":"2023-05-10T04:19:15.202770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:16:40.114985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470258+0000","last_change":"2023-05-10T04:19:09.477274+0000","last_active":"2023-05-10T04:19:14.470258+0000","last_peered":"2023-05-10T04:19:14.470258+0000","last_clean":"2023-05-10T04:19:14.470258+0000","last_became_active":"2023-05-10T04:19:09.476956+0000","last_became_peered":"2023-05-10T04:19:09.476956+0000","last_unstale":"2023-05-10T04:19:14.470258+0000","last_undegraded":"2023-05-10T04:19:14.470258+0000","last_fullsized":"2023-05-10T04:19:14.470258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:59.737968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202341+0000","last_change":"2023-05-10T04:19:09.959284+0000","last_active":"2023-05-10T04:19:15.202341+0000","last_peered":"2023-05-10T04:19:15.202341+0000","last_clean":"2023-05-10T04:19:15.202341+0000","last_became_active":"2023-05-10T04:19:09.959030+0000","last_became_peered":"2023-05-10T04:19:09.959030+0000","last_unstale":"2023-05-10T04:19:15.202341+0000","last_undegraded":"2023-05-10T04:19:15.202341+0000","last_fullsized":"2023-05-10T04:19:15.202341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:04:32.114370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469919+0000","last_change":"2023-05-10T04:19:13.995438+0000","last_active":"2023-05-10T04:19:14.469919+0000","last_peered":"2023-05-10T04:19:14.469919+0000","last_clean":"2023-05-10T04:19:14.469919+0000","last_became_active":"2023-05-10T04:19:13.994966+0000","last_became_peered":"2023-05-10T04:19:13.994966+0000","last_unstale":"2023-05-10T04:19:14.469919+0000","last_undegraded":"2023-05-10T04:19:14.469919+0000","last_fullsized":"2023-05-10T04:19:14.469919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:05:44.625042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468987+0000","last_change":"2023-05-10T04:19:09.485131+0000","last_active":"2023-05-10T04:19:14.468987+0000","last_peered":"2023-05-10T04:19:14.468987+0000","last_clean":"2023-05-10T04:19:14.468987+0000","last_became_active":"2023-05-10T04:19:09.484754+0000","last_became_peered":"2023-05-10T04:19:09.484754+0000","last_unstale":"2023-05-10T04:19:14.468987+0000","last_undegraded":"2023-05-10T04:19:14.468987+0000","last_fullsized":"2023-05-10T04:19:14.468987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:30:21.704079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469574+0000","last_change":"2023-05-10T04:19:09.970210+0000","last_active":"2023-05-10T04:19:14.469574+0000","last_peered":"2023-05-10T04:19:14.469574+0000","last_clean":"2023-05-10T04:19:14.469574+0000","last_became_active":"2023-05-10T04:19:09.969916+0000","last_became_peered":"2023-05-10T04:19:09.969916+0000","last_unstale":"2023-05-10T04:19:14.469574+0000","last_undegraded":"2023-05-10T04:19:14.469574+0000","last_fullsized":"2023-05-10T04:19:14.469574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:08:49.572839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203900+0000","last_change":"2023-05-10T04:19:14.000125+0000","last_active":"2023-05-10T04:19:15.203900+0000","last_peered":"2023-05-10T04:19:15.203900+0000","last_clean":"2023-05-10T04:19:15.203900+0000","last_became_active":"2023-05-10T04:19:13.998988+0000","last_became_peered":"2023-05-10T04:19:13.998988+0000","last_unstale":"2023-05-10T04:19:15.203900+0000","last_undegraded":"2023-05-10T04:19:15.203900+0000","last_fullsized":"2023-05-10T04:19:15.203900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:39:35.802978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204178+0000","last_change":"2023-05-10T04:19:09.488600+0000","last_active":"2023-05-10T04:19:15.204178+0000","last_peered":"2023-05-10T04:19:15.204178+0000","last_clean":"2023-05-10T04:19:15.204178+0000","last_became_active":"2023-05-10T04:19:09.488320+0000","last_became_peered":"2023-05-10T04:19:09.488320+0000","last_unstale":"2023-05-10T04:19:15.204178+0000","last_undegraded":"2023-05-10T04:19:15.204178+0000","last_fullsized":"2023-05-10T04:19:15.204178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:14:10.406433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202715+0000","last_change":"2023-05-10T04:19:09.986548+0000","last_active":"2023-05-10T04:19:15.202715+0000","last_peered":"2023-05-10T04:19:15.202715+0000","last_clean":"2023-05-10T04:19:15.202715+0000","last_became_active":"2023-05-10T04:19:09.986228+0000","last_became_peered":"2023-05-10T04:19:09.986228+0000","last_unstale":"2023-05-10T04:19:15.202715+0000","last_undegraded":"2023-05-10T04:19:15.202715+0000","last_fullsized":"2023-05-10T04:19:15.202715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:03.210099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202625+0000","last_change":"2023-05-10T04:19:13.997285+0000","last_active":"2023-05-10T04:19:15.202625+0000","last_peered":"2023-05-10T04:19:15.202625+0000","last_clean":"2023-05-10T04:19:15.202625+0000","last_became_active":"2023-05-10T04:19:13.996851+0000","last_became_peered":"2023-05-10T04:19:13.996851+0000","last_unstale":"2023-05-10T04:19:15.202625+0000","last_undegraded":"2023-05-10T04:19:15.202625+0000","last_fullsized":"2023-05-10T04:19:15.202625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:05.585266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202534+0000","last_change":"2023-05-10T04:19:09.485989+0000","last_active":"2023-05-10T04:19:15.202534+0000","last_peered":"2023-05-10T04:19:15.202534+0000","last_clean":"2023-05-10T04:19:15.202534+0000","last_became_active":"2023-05-10T04:19:09.485739+0000","last_became_peered":"2023-05-10T04:19:09.485739+0000","last_unstale":"2023-05-10T04:19:15.202534+0000","last_undegraded":"2023-05-10T04:19:15.202534+0000","last_fullsized":"2023-05-10T04:19:15.202534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:34.153625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203031+0000","last_change":"2023-05-10T04:19:09.966736+0000","last_active":"2023-05-10T04:19:15.203031+0000","last_peered":"2023-05-10T04:19:15.203031+0000","last_clean":"2023-05-10T04:19:15.203031+0000","last_became_active":"2023-05-10T04:19:09.966474+0000","last_became_peered":"2023-05-10T04:19:09.966474+0000","last_unstale":"2023-05-10T04:19:15.203031+0000","last_undegraded":"2023-05-10T04:19:15.203031+0000","last_fullsized":"2023-05-10T04:19:15.203031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:19.596953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203129+0000","last_change":"2023-05-10T04:19:13.993407+0000","last_active":"2023-05-10T04:19:15.203129+0000","last_peered":"2023-05-10T04:19:15.203129+0000","last_clean":"2023-05-10T04:19:15.203129+0000","last_became_active":"2023-05-10T04:19:13.992979+0000","last_became_peered":"2023-05-10T04:19:13.992979+0000","last_unstale":"2023-05-10T04:19:15.203129+0000","last_undegraded":"2023-05-10T04:19:15.203129+0000","last_fullsized":"2023-05-10T04:19:15.203129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:23.097714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578128+0000","last_change":"2023-05-10T04:19:09.482747+0000","last_active":"2023-05-10T04:19:14.578128+0000","last_peered":"2023-05-10T04:19:14.578128+0000","last_clean":"2023-05-10T04:19:14.578128+0000","last_became_active":"2023-05-10T04:19:09.482405+0000","last_became_peered":"2023-05-10T04:19:09.482405+0000","last_unstale":"2023-05-10T04:19:14.578128+0000","last_undegraded":"2023-05-10T04:19:14.578128+0000","last_fullsized":"2023-05-10T04:19:14.578128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:14:10.406433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628203+0000","last_change":"2023-05-10T04:19:09.976125+0000","last_active":"2023-05-10T04:19:14.628203+0000","last_peered":"2023-05-10T04:19:14.628203+0000","last_clean":"2023-05-10T04:19:14.628203+0000","last_became_active":"2023-05-10T04:19:09.975822+0000","last_became_peered":"2023-05-10T04:19:09.975822+0000","last_unstale":"2023-05-10T04:19:14.628203+0000","last_undegraded":"2023-05-10T04:19:14.628203+0000","last_fullsized":"2023-05-10T04:19:14.628203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:16.831438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469659+0000","last_change":"2023-05-10T04:19:13.995689+0000","last_active":"2023-05-10T04:19:14.469659+0000","last_peered":"2023-05-10T04:19:14.469659+0000","last_clean":"2023-05-10T04:19:14.469659+0000","last_became_active":"2023-05-10T04:19:13.995260+0000","last_became_peered":"2023-05-10T04:19:13.995260+0000","last_unstale":"2023-05-10T04:19:14.469659+0000","last_undegraded":"2023-05-10T04:19:14.469659+0000","last_fullsized":"2023-05-10T04:19:14.469659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:23:01.528439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578389+0000","last_change":"2023-05-10T04:19:09.483097+0000","last_active":"2023-05-10T04:19:14.578389+0000","last_peered":"2023-05-10T04:19:14.578389+0000","last_clean":"2023-05-10T04:19:14.578389+0000","last_became_active":"2023-05-10T04:19:09.482753+0000","last_became_peered":"2023-05-10T04:19:09.482753+0000","last_unstale":"2023-05-10T04:19:14.578389+0000","last_undegraded":"2023-05-10T04:19:14.578389+0000","last_fullsized":"2023-05-10T04:19:14.578389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:47:36.189819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201669+0000","last_change":"2023-05-10T04:19:09.965711+0000","last_active":"2023-05-10T04:19:15.201669+0000","last_peered":"2023-05-10T04:19:15.201669+0000","last_clean":"2023-05-10T04:19:15.201669+0000","last_became_active":"2023-05-10T04:19:09.965427+0000","last_became_peered":"2023-05-10T04:19:09.965427+0000","last_unstale":"2023-05-10T04:19:15.201669+0000","last_undegraded":"2023-05-10T04:19:15.201669+0000","last_fullsized":"2023-05-10T04:19:15.201669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:25.276398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203303+0000","last_change":"2023-05-10T04:19:09.977970+0000","last_active":"2023-05-10T04:19:15.203303+0000","last_peered":"2023-05-10T04:19:15.203303+0000","last_clean":"2023-05-10T04:19:15.203303+0000","last_became_active":"2023-05-10T04:19:09.977559+0000","last_became_peered":"2023-05-10T04:19:09.977559+0000","last_unstale":"2023-05-10T04:19:15.203303+0000","last_undegraded":"2023-05-10T04:19:15.203303+0000","last_fullsized":"2023-05-10T04:19:15.203303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:54:23.670496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468413+0000","last_change":"2023-05-10T04:19:09.985063+0000","last_active":"2023-05-10T04:19:14.468413+0000","last_peered":"2023-05-10T04:19:14.468413+0000","last_clean":"2023-05-10T04:19:14.468413+0000","last_became_active":"2023-05-10T04:19:09.984788+0000","last_became_peered":"2023-05-10T04:19:09.984788+0000","last_unstale":"2023-05-10T04:19:14.468413+0000","last_undegraded":"2023-05-10T04:19:14.468413+0000","last_fullsized":"2023-05-10T04:19:14.468413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:13.062393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468430+0000","last_change":"2023-05-10T04:19:09.969178+0000","last_active":"2023-05-10T04:19:14.468430+0000","last_peered":"2023-05-10T04:19:14.468430+0000","last_clean":"2023-05-10T04:19:14.468430+0000","last_became_active":"2023-05-10T04:19:09.968882+0000","last_became_peered":"2023-05-10T04:19:09.968882+0000","last_unstale":"2023-05-10T04:19:14.468430+0000","last_undegraded":"2023-05-10T04:19:14.468430+0000","last_fullsized":"2023-05-10T04:19:14.468430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:55.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577956+0000","last_change":"2023-05-10T04:19:09.978972+0000","last_active":"2023-05-10T04:19:14.577956+0000","last_peered":"2023-05-10T04:19:14.577956+0000","last_clean":"2023-05-10T04:19:14.577956+0000","last_became_active":"2023-05-10T04:19:09.978677+0000","last_became_peered":"2023-05-10T04:19:09.978677+0000","last_unstale":"2023-05-10T04:19:14.577956+0000","last_undegraded":"2023-05-10T04:19:14.577956+0000","last_fullsized":"2023-05-10T04:19:14.577956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:04.032181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578091+0000","last_change":"2023-05-10T04:19:09.982469+0000","last_active":"2023-05-10T04:19:14.578091+0000","last_peered":"2023-05-10T04:19:14.578091+0000","last_clean":"2023-05-10T04:19:14.578091+0000","last_became_active":"2023-05-10T04:19:09.982174+0000","last_became_peered":"2023-05-10T04:19:09.982174+0000","last_unstale":"2023-05-10T04:19:14.578091+0000","last_undegraded":"2023-05-10T04:19:14.578091+0000","last_fullsized":"2023-05-10T04:19:14.578091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:55:21.820447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":16,"seq":68719476747,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":909312,"data_stored":715160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":124264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":127912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8380000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6230000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.617}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.532}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5069999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.746}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8260,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363580,"statfs":{"total":96636764160,"available":96628305920,"internally_reserved":0,"allocated":323584,"data_stored":128016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":124208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T04:19:36.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T04:19:36.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.728+0000 7f27679ff700 1 Processor -- start 2023-05-10T04:19:36.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.728+0000 7f27679ff700 1 -- start start 2023-05-10T04:19:36.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.729+0000 7f27679ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f276015c590 0x7f2760160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.729+0000 7f27679ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27600cd520 con 0x7f27600cff50 2023-05-10T04:19:36.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.729+0000 7f27679ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27600d2640 con 0x7f27600cf010 2023-05-10T04:19:36.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.729+0000 7f27679ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27601610d0 con 0x7f276015c590 2023-05-10T04:19:36.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f2765f9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f27600cff50 0x7f27600d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50806/0 (socket says 172.21.15.132:50806) 2023-05-10T04:19:36.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f2765f9c700 1 -- 172.21.15.132:0/3371727354 learned_addr learned my addr 172.21.15.132:0/3371727354 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:36.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f276579b700 1 --2- 172.21.15.132:0/3371727354 >> v2:172.21.15.154:3300/0 conn(0x7f276015c590 0x7f2760160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f2757fff700 1 -- 172.21.15.132:0/3371727354 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3367927906 0 0) 0x7f27600cd520 con 0x7f27600cff50 2023-05-10T04:19:36.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f2757fff700 1 -- 172.21.15.132:0/3371727354 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274c0035b0 con 0x7f27600cff50 2023-05-10T04:19:36.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f2757fff700 1 -- 172.21.15.132:0/3371727354 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 807203518 0 0) 0x7f27600d2640 con 0x7f27600cf010 2023-05-10T04:19:36.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f2757fff700 1 -- 172.21.15.132:0/3371727354 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27600cd520 con 0x7f27600cf010 2023-05-10T04:19:36.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f276579b700 1 -- 172.21.15.132:0/3371727354 >> v1:172.21.15.154:6789/0 conn(0x7f27600cf010 legacy=0x7f27600cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f276579b700 1 -- 172.21.15.132:0/3371727354 >> v1:172.21.15.132:6789/0 conn(0x7f27600cff50 legacy=0x7f27600d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.730+0000 7f276579b700 1 -- 172.21.15.132:0/3371727354 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27600b23c0 con 0x7f276015c590 2023-05-10T04:19:36.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.731+0000 7f276579b700 1 --2- 172.21.15.132:0/3371727354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276015c590 0x7f2760160b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f275c009840 tx=0x7f275c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14a7ce40570cf6fc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:36.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.731+0000 7f2757fff700 1 -- 172.21.15.132:0/3371727354 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c011830 con 0x7f276015c590 2023-05-10T04:19:36.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.731+0000 7f2757fff700 1 -- 172.21.15.132:0/3371727354 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c011990 con 0x7f276015c590 2023-05-10T04:19:36.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.731+0000 7f2757fff700 1 -- 172.21.15.132:0/3371727354 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c011d00 con 0x7f276015c590 2023-05-10T04:19:36.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.731+0000 7f27679ff700 1 -- 172.21.15.132:0/3371727354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276015c590 msgr2=0x7f2760160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.731+0000 7f27679ff700 1 --2- 172.21.15.132:0/3371727354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276015c590 0x7f2760160b90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f275c009840 tx=0x7f275c009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:36.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.731+0000 7f27679ff700 1 -- 172.21.15.132:0/3371727354 shutdown_connections 2023-05-10T04:19:36.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.732+0000 7f27679ff700 1 --2- 172.21.15.132:0/3371727354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f276015c590 0x7f2760160b90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.732+0000 7f27679ff700 1 -- 172.21.15.132:0/3371727354 >> 172.21.15.132:0/3371727354 conn(0x7f2760071b10 msgr2=0x7f2760071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:36.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.732+0000 7f27679ff700 1 -- 172.21.15.132:0/3371727354 shutdown_connections 2023-05-10T04:19:36.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.732+0000 7f27679ff700 1 -- 172.21.15.132:0/3371727354 wait complete. 2023-05-10T04:19:36.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.733+0000 7f27679ff700 1 Processor -- start 2023-05-10T04:19:36.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.733+0000 7f27679ff700 1 -- start start 2023-05-10T04:19:36.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f27679ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27600cf010 0x7f27600b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f27679ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27600cff50 0x7f2760155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f27679ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276015c590 0x7f27600b6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f27679ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c7b10 con 0x7f27600cff50 2023-05-10T04:19:36.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f27679ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c6f00 con 0x7f27600cf010 2023-05-10T04:19:36.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f27679ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27600c71e0 con 0x7f276015c590 2023-05-10T04:19:36.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f2764f9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27600cff50 0x7f2760155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f2764f9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27600cff50 0x7f2760155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48350/0 (socket says 172.21.15.132:48350) 2023-05-10T04:19:36.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.734+0000 7f2764f9a700 1 -- 172.21.15.132:0/775925174 learned_addr learned my addr 172.21.15.132:0/775925174 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:36.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f276579b700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27600cf010 0x7f27600b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2764f9a700 1 -- 172.21.15.132:0/775925174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276015c590 msgr2=0x7f27600b6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2764f9a700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276015c590 0x7f27600b6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2764f9a700 1 -- 172.21.15.132:0/775925174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27600cf010 msgr2=0x7f27600b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2764f9a700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27600cf010 0x7f27600b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2764f9a700 1 -- 172.21.15.132:0/775925174 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c0094a0 con 0x7f27600cff50 2023-05-10T04:19:36.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f276579b700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27600cf010 0x7f27600b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:36.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2764f9a700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27600cff50 0x7f2760155520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f275000c520 tx=0x7f275000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:36.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2755ffb700 1 -- 172.21.15.132:0/775925174 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500052d0 con 0x7f27600cff50 2023-05-10T04:19:36.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2755ffb700 1 -- 172.21.15.132:0/775925174 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2750005430 con 0x7f27600cff50 2023-05-10T04:19:36.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27600cd770 con 0x7f27600cff50 2023-05-10T04:19:36.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f2755ffb700 1 -- 172.21.15.132:0/775925174 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27500038c0 con 0x7f27600cff50 2023-05-10T04:19:36.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.735+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27600cf560 con 0x7f27600cff50 2023-05-10T04:19:36.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.736+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276015c960 con 0x7f27600cff50 2023-05-10T04:19:36.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.737+0000 7f2755ffb700 1 -- 172.21.15.132:0/775925174 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2750003a20 con 0x7f27600cff50 2023-05-10T04:19:36.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.738+0000 7f2755ffb700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f274406ace0 0x7f274406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:36.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.738+0000 7f2755ffb700 1 -- 172.21.15.132:0/775925174 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2750088db0 con 0x7f27600cff50 2023-05-10T04:19:36.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.739+0000 7f276579b700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f274406ace0 0x7f274406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:36.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.739+0000 7f276579b700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f274406ace0 0x7f274406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f275c009fd0 tx=0x7f275c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:36.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.742+0000 7f2755ffb700 1 -- 172.21.15.132:0/775925174 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f275008d070 con 0x7f27600cff50 2023-05-10T04:19:36.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.933+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 --> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f27600b1e90 con 0x7f274406ace0 2023-05-10T04:19:36.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.943+0000 7f2755ffb700 1 -- 172.21.15.132:0/775925174 <== mgr.4100 v2:172.21.15.132:6832/1621031024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367312 (secure 0 0 0) 0x7f27600b1e90 con 0x7f274406ace0 2023-05-10T04:19:36.950 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:36.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f274406ace0 msgr2=0x7f274406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f274406ace0 0x7f274406d190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f275c009fd0 tx=0x7f275c008030 comp rx=0 tx=0).stop 2023-05-10T04:19:36.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27600cff50 msgr2=0x7f2760155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:36.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27600cff50 0x7f2760155520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f275000c520 tx=0x7f275000c8e0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 shutdown_connections 2023-05-10T04:19:36.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f274406ace0 0x7f274406d190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f276015c590 0x7f27600b6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27600cf010 0x7f27600b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.947+0000 7f27679ff700 1 --2- 172.21.15.132:0/775925174 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27600cff50 0x7f2760155520 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:36.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.948+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 >> 172.21.15.132:0/775925174 conn(0x7f2760071b10 msgr2=0x7f27600b3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:36.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.948+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 shutdown_connections 2023-05-10T04:19:36.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:36.948+0000 7f27679ff700 1 -- 172.21.15.132:0/775925174 wait complete. 2023-05-10T04:19:36.953 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-05-10T04:19:36.968 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-05-10T04:19:35.326821+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":67720,"kb_used_data":3592,"kb_used_omap":0,"kb_used_meta":64064,"kb_avail":754907000,"statfs":{"total":773094113280,"available":773024768000,"internally_reserved":0,"allocated":3678208,"data_stored":2182864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":65601536},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007624"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578590+0000","last_change":"2023-05-10T04:19:09.980944+0000","last_active":"2023-05-10T04:19:14.578590+0000","last_peered":"2023-05-10T04:19:14.578590+0000","last_clean":"2023-05-10T04:19:14.578590+0000","last_became_active":"2023-05-10T04:19:09.980469+0000","last_became_peered":"2023-05-10T04:19:09.980469+0000","last_unstale":"2023-05-10T04:19:14.578590+0000","last_undegraded":"2023-05-10T04:19:14.578590+0000","last_fullsized":"2023-05-10T04:19:14.578590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:55:07.690476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202665+0000","last_change":"2023-05-10T04:19:09.966435+0000","last_active":"2023-05-10T04:19:15.202665+0000","last_peered":"2023-05-10T04:19:15.202665+0000","last_clean":"2023-05-10T04:19:15.202665+0000","last_became_active":"2023-05-10T04:19:09.966166+0000","last_became_peered":"2023-05-10T04:19:09.966166+0000","last_unstale":"2023-05-10T04:19:15.202665+0000","last_undegraded":"2023-05-10T04:19:15.202665+0000","last_fullsized":"2023-05-10T04:19:15.202665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:27:35.392807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468705+0000","last_change":"2023-05-10T04:19:09.984558+0000","last_active":"2023-05-10T04:19:14.468705+0000","last_peered":"2023-05-10T04:19:14.468705+0000","last_clean":"2023-05-10T04:19:14.468705+0000","last_became_active":"2023-05-10T04:19:09.984302+0000","last_became_peered":"2023-05-10T04:19:09.984302+0000","last_unstale":"2023-05-10T04:19:14.468705+0000","last_undegraded":"2023-05-10T04:19:14.468705+0000","last_fullsized":"2023-05-10T04:19:14.468705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:04:32.114370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468704+0000","last_change":"2023-05-10T04:19:09.974290+0000","last_active":"2023-05-10T04:19:14.468704+0000","last_peered":"2023-05-10T04:19:14.468704+0000","last_clean":"2023-05-10T04:19:14.468704+0000","last_became_active":"2023-05-10T04:19:09.973974+0000","last_became_peered":"2023-05-10T04:19:09.973974+0000","last_unstale":"2023-05-10T04:19:14.468704+0000","last_undegraded":"2023-05-10T04:19:14.468704+0000","last_fullsized":"2023-05-10T04:19:14.468704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:42.762389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469158+0000","last_change":"2023-05-10T04:19:09.969611+0000","last_active":"2023-05-10T04:19:14.469158+0000","last_peered":"2023-05-10T04:19:14.469158+0000","last_clean":"2023-05-10T04:19:14.469158+0000","last_became_active":"2023-05-10T04:19:09.969348+0000","last_became_peered":"2023-05-10T04:19:09.969348+0000","last_unstale":"2023-05-10T04:19:14.469158+0000","last_undegraded":"2023-05-10T04:19:14.469158+0000","last_fullsized":"2023-05-10T04:19:14.469158+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:09:45.474894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202245+0000","last_change":"2023-05-10T04:19:09.958269+0000","last_active":"2023-05-10T04:19:15.202245+0000","last_peered":"2023-05-10T04:19:15.202245+0000","last_clean":"2023-05-10T04:19:15.202245+0000","last_became_active":"2023-05-10T04:19:09.958012+0000","last_became_peered":"2023-05-10T04:19:09.958012+0000","last_unstale":"2023-05-10T04:19:15.202245+0000","last_undegraded":"2023-05-10T04:19:15.202245+0000","last_fullsized":"2023-05-10T04:19:15.202245+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:46:10.564631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201730+0000","last_change":"2023-05-10T04:19:09.977451+0000","last_active":"2023-05-10T04:19:15.201730+0000","last_peered":"2023-05-10T04:19:15.201730+0000","last_clean":"2023-05-10T04:19:15.201730+0000","last_became_active":"2023-05-10T04:19:09.977096+0000","last_became_peered":"2023-05-10T04:19:09.977096+0000","last_unstale":"2023-05-10T04:19:15.201730+0000","last_undegraded":"2023-05-10T04:19:15.201730+0000","last_fullsized":"2023-05-10T04:19:15.201730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:08:03.559858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203498+0000","last_change":"2023-05-10T04:19:09.983987+0000","last_active":"2023-05-10T04:19:15.203498+0000","last_peered":"2023-05-10T04:19:15.203498+0000","last_clean":"2023-05-10T04:19:15.203498+0000","last_became_active":"2023-05-10T04:19:09.983498+0000","last_became_peered":"2023-05-10T04:19:09.983498+0000","last_unstale":"2023-05-10T04:19:15.203498+0000","last_undegraded":"2023-05-10T04:19:15.203498+0000","last_fullsized":"2023-05-10T04:19:15.203498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:24:07.309535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470244+0000","last_change":"2023-05-10T04:19:09.985793+0000","last_active":"2023-05-10T04:19:14.470244+0000","last_peered":"2023-05-10T04:19:14.470244+0000","last_clean":"2023-05-10T04:19:14.470244+0000","last_became_active":"2023-05-10T04:19:09.985536+0000","last_became_peered":"2023-05-10T04:19:09.985536+0000","last_unstale":"2023-05-10T04:19:14.470244+0000","last_undegraded":"2023-05-10T04:19:14.470244+0000","last_fullsized":"2023-05-10T04:19:14.470244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:26:03.971644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204267+0000","last_change":"2023-05-10T04:19:09.977082+0000","last_active":"2023-05-10T04:19:15.204267+0000","last_peered":"2023-05-10T04:19:15.204267+0000","last_clean":"2023-05-10T04:19:15.204267+0000","last_became_active":"2023-05-10T04:19:09.976807+0000","last_became_peered":"2023-05-10T04:19:09.976807+0000","last_unstale":"2023-05-10T04:19:15.204267+0000","last_undegraded":"2023-05-10T04:19:15.204267+0000","last_fullsized":"2023-05-10T04:19:15.204267+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:57.684710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204207+0000","last_change":"2023-05-10T04:19:09.977165+0000","last_active":"2023-05-10T04:19:15.204207+0000","last_peered":"2023-05-10T04:19:15.204207+0000","last_clean":"2023-05-10T04:19:15.204207+0000","last_became_active":"2023-05-10T04:19:09.976881+0000","last_became_peered":"2023-05-10T04:19:09.976881+0000","last_unstale":"2023-05-10T04:19:15.204207+0000","last_undegraded":"2023-05-10T04:19:15.204207+0000","last_fullsized":"2023-05-10T04:19:15.204207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:33:39.200185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578113+0000","last_change":"2023-05-10T04:19:09.981309+0000","last_active":"2023-05-10T04:19:14.578113+0000","last_peered":"2023-05-10T04:19:14.578113+0000","last_clean":"2023-05-10T04:19:14.578113+0000","last_became_active":"2023-05-10T04:19:09.981029+0000","last_became_peered":"2023-05-10T04:19:09.981029+0000","last_unstale":"2023-05-10T04:19:14.578113+0000","last_undegraded":"2023-05-10T04:19:14.578113+0000","last_fullsized":"2023-05-10T04:19:14.578113+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:39:32.302218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468965+0000","last_change":"2023-05-10T04:19:09.986829+0000","last_active":"2023-05-10T04:19:14.468965+0000","last_peered":"2023-05-10T04:19:14.468965+0000","last_clean":"2023-05-10T04:19:14.468965+0000","last_became_active":"2023-05-10T04:19:09.986539+0000","last_became_peered":"2023-05-10T04:19:09.986539+0000","last_unstale":"2023-05-10T04:19:14.468965+0000","last_undegraded":"2023-05-10T04:19:14.468965+0000","last_fullsized":"2023-05-10T04:19:14.468965+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:01.243491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203681+0000","last_change":"2023-05-10T04:19:09.985452+0000","last_active":"2023-05-10T04:19:15.203681+0000","last_peered":"2023-05-10T04:19:15.203681+0000","last_clean":"2023-05-10T04:19:15.203681+0000","last_became_active":"2023-05-10T04:19:09.985150+0000","last_became_peered":"2023-05-10T04:19:09.985150+0000","last_unstale":"2023-05-10T04:19:15.203681+0000","last_undegraded":"2023-05-10T04:19:15.203681+0000","last_fullsized":"2023-05-10T04:19:15.203681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:01:52.551479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468391+0000","last_change":"2023-05-10T04:19:09.976517+0000","last_active":"2023-05-10T04:19:14.468391+0000","last_peered":"2023-05-10T04:19:14.468391+0000","last_clean":"2023-05-10T04:19:14.468391+0000","last_became_active":"2023-05-10T04:19:09.976213+0000","last_became_peered":"2023-05-10T04:19:09.976213+0000","last_unstale":"2023-05-10T04:19:14.468391+0000","last_undegraded":"2023-05-10T04:19:14.468391+0000","last_fullsized":"2023-05-10T04:19:14.468391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:16.831438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201721+0000","last_change":"2023-05-10T04:19:09.974190+0000","last_active":"2023-05-10T04:19:15.201721+0000","last_peered":"2023-05-10T04:19:15.201721+0000","last_clean":"2023-05-10T04:19:15.201721+0000","last_became_active":"2023-05-10T04:19:09.973917+0000","last_became_peered":"2023-05-10T04:19:09.973917+0000","last_unstale":"2023-05-10T04:19:15.201721+0000","last_undegraded":"2023-05-10T04:19:15.201721+0000","last_fullsized":"2023-05-10T04:19:15.201721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:23:32.089101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628444+0000","last_change":"2023-05-10T04:19:09.976310+0000","last_active":"2023-05-10T04:19:14.628444+0000","last_peered":"2023-05-10T04:19:14.628444+0000","last_clean":"2023-05-10T04:19:14.628444+0000","last_became_active":"2023-05-10T04:19:09.975809+0000","last_became_peered":"2023-05-10T04:19:09.975809+0000","last_unstale":"2023-05-10T04:19:14.628444+0000","last_undegraded":"2023-05-10T04:19:14.628444+0000","last_fullsized":"2023-05-10T04:19:14.628444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:07.446800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468880+0000","last_change":"2023-05-10T04:19:09.980962+0000","last_active":"2023-05-10T04:19:14.468880+0000","last_peered":"2023-05-10T04:19:14.468880+0000","last_clean":"2023-05-10T04:19:14.468880+0000","last_became_active":"2023-05-10T04:19:09.980600+0000","last_became_peered":"2023-05-10T04:19:09.980600+0000","last_unstale":"2023-05-10T04:19:14.468880+0000","last_undegraded":"2023-05-10T04:19:14.468880+0000","last_fullsized":"2023-05-10T04:19:14.468880+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:02.084506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578180+0000","last_change":"2023-05-10T04:19:09.983155+0000","last_active":"2023-05-10T04:19:14.578180+0000","last_peered":"2023-05-10T04:19:14.578180+0000","last_clean":"2023-05-10T04:19:14.578180+0000","last_became_active":"2023-05-10T04:19:09.982831+0000","last_became_peered":"2023-05-10T04:19:09.982831+0000","last_unstale":"2023-05-10T04:19:14.578180+0000","last_undegraded":"2023-05-10T04:19:14.578180+0000","last_fullsized":"2023-05-10T04:19:14.578180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:33:39.200185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204200+0000","last_change":"2023-05-10T04:19:09.974974+0000","last_active":"2023-05-10T04:19:15.204200+0000","last_peered":"2023-05-10T04:19:15.204200+0000","last_clean":"2023-05-10T04:19:15.204200+0000","last_became_active":"2023-05-10T04:19:09.974693+0000","last_became_peered":"2023-05-10T04:19:09.974693+0000","last_unstale":"2023-05-10T04:19:15.204200+0000","last_undegraded":"2023-05-10T04:19:15.204200+0000","last_fullsized":"2023-05-10T04:19:15.204200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:55:21.820447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203862+0000","last_change":"2023-05-10T04:19:09.986983+0000","last_active":"2023-05-10T04:19:15.203862+0000","last_peered":"2023-05-10T04:19:15.203862+0000","last_clean":"2023-05-10T04:19:15.203862+0000","last_became_active":"2023-05-10T04:19:09.986701+0000","last_became_peered":"2023-05-10T04:19:09.986701+0000","last_unstale":"2023-05-10T04:19:15.203862+0000","last_undegraded":"2023-05-10T04:19:15.203862+0000","last_fullsized":"2023-05-10T04:19:15.203862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:21:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627999+0000","last_change":"2023-05-10T04:19:09.977136+0000","last_active":"2023-05-10T04:19:14.627999+0000","last_peered":"2023-05-10T04:19:14.627999+0000","last_clean":"2023-05-10T04:19:14.627999+0000","last_became_active":"2023-05-10T04:19:09.976794+0000","last_became_peered":"2023-05-10T04:19:09.976794+0000","last_unstale":"2023-05-10T04:19:14.627999+0000","last_undegraded":"2023-05-10T04:19:14.627999+0000","last_fullsized":"2023-05-10T04:19:14.627999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:19:39.672723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469767+0000","last_change":"2023-05-10T04:19:09.984844+0000","last_active":"2023-05-10T04:19:14.469767+0000","last_peered":"2023-05-10T04:19:14.469767+0000","last_clean":"2023-05-10T04:19:14.469767+0000","last_became_active":"2023-05-10T04:19:09.984531+0000","last_became_peered":"2023-05-10T04:19:09.984531+0000","last_unstale":"2023-05-10T04:19:14.469767+0000","last_undegraded":"2023-05-10T04:19:14.469767+0000","last_fullsized":"2023-05-10T04:19:14.469767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:33.935006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203424+0000","last_change":"2023-05-10T04:19:09.986208+0000","last_active":"2023-05-10T04:19:15.203424+0000","last_peered":"2023-05-10T04:19:15.203424+0000","last_clean":"2023-05-10T04:19:15.203424+0000","last_became_active":"2023-05-10T04:19:09.985544+0000","last_became_peered":"2023-05-10T04:19:09.985544+0000","last_unstale":"2023-05-10T04:19:15.203424+0000","last_undegraded":"2023-05-10T04:19:15.203424+0000","last_fullsized":"2023-05-10T04:19:15.203424+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:08.821912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470497+0000","last_change":"2023-05-10T04:19:09.960642+0000","last_active":"2023-05-10T04:19:14.470497+0000","last_peered":"2023-05-10T04:19:14.470497+0000","last_clean":"2023-05-10T04:19:14.470497+0000","last_became_active":"2023-05-10T04:19:09.960283+0000","last_became_peered":"2023-05-10T04:19:09.960283+0000","last_unstale":"2023-05-10T04:19:14.470497+0000","last_undegraded":"2023-05-10T04:19:14.470497+0000","last_fullsized":"2023-05-10T04:19:14.470497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:57:41.293004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628247+0000","last_change":"2023-05-10T04:19:09.977728+0000","last_active":"2023-05-10T04:19:14.628247+0000","last_peered":"2023-05-10T04:19:14.628247+0000","last_clean":"2023-05-10T04:19:14.628247+0000","last_became_active":"2023-05-10T04:19:09.971618+0000","last_became_peered":"2023-05-10T04:19:09.971618+0000","last_unstale":"2023-05-10T04:19:14.628247+0000","last_undegraded":"2023-05-10T04:19:14.628247+0000","last_fullsized":"2023-05-10T04:19:14.628247+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:55.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202232+0000","last_change":"2023-05-10T04:19:09.972981+0000","last_active":"2023-05-10T04:19:15.202232+0000","last_peered":"2023-05-10T04:19:15.202232+0000","last_clean":"2023-05-10T04:19:15.202232+0000","last_became_active":"2023-05-10T04:19:09.972690+0000","last_became_peered":"2023-05-10T04:19:09.972690+0000","last_unstale":"2023-05-10T04:19:15.202232+0000","last_undegraded":"2023-05-10T04:19:15.202232+0000","last_fullsized":"2023-05-10T04:19:15.202232+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:35:07.369264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202719+0000","last_change":"2023-05-10T04:19:13.994524+0000","last_active":"2023-05-10T04:19:15.202719+0000","last_peered":"2023-05-10T04:19:15.202719+0000","last_clean":"2023-05-10T04:19:15.202719+0000","last_became_active":"2023-05-10T04:19:13.994164+0000","last_became_peered":"2023-05-10T04:19:13.994164+0000","last_unstale":"2023-05-10T04:19:15.202719+0000","last_undegraded":"2023-05-10T04:19:15.202719+0000","last_fullsized":"2023-05-10T04:19:15.202719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:16.563153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,6,0],"acting":[2,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203829+0000","last_change":"2023-05-10T04:19:09.487208+0000","last_active":"2023-05-10T04:19:15.203829+0000","last_peered":"2023-05-10T04:19:15.203829+0000","last_clean":"2023-05-10T04:19:15.203829+0000","last_became_active":"2023-05-10T04:19:09.486969+0000","last_became_peered":"2023-05-10T04:19:09.486969+0000","last_unstale":"2023-05-10T04:19:15.203829+0000","last_undegraded":"2023-05-10T04:19:15.203829+0000","last_fullsized":"2023-05-10T04:19:15.203829+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:03.029871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628183+0000","last_change":"2023-05-10T04:19:09.982864+0000","last_active":"2023-05-10T04:19:14.628183+0000","last_peered":"2023-05-10T04:19:14.628183+0000","last_clean":"2023-05-10T04:19:14.628183+0000","last_became_active":"2023-05-10T04:19:09.982599+0000","last_became_peered":"2023-05-10T04:19:09.982599+0000","last_unstale":"2023-05-10T04:19:14.628183+0000","last_undegraded":"2023-05-10T04:19:14.628183+0000","last_fullsized":"2023-05-10T04:19:14.628183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:56:49.205595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203762+0000","last_change":"2023-05-10T04:19:13.991870+0000","last_active":"2023-05-10T04:19:15.203762+0000","last_peered":"2023-05-10T04:19:15.203762+0000","last_clean":"2023-05-10T04:19:15.203762+0000","last_became_active":"2023-05-10T04:19:13.991396+0000","last_became_peered":"2023-05-10T04:19:13.991396+0000","last_unstale":"2023-05-10T04:19:15.203762+0000","last_undegraded":"2023-05-10T04:19:15.203762+0000","last_fullsized":"2023-05-10T04:19:15.203762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:04.744252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,5],"acting":[2,7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469470+0000","last_change":"2023-05-10T04:19:09.483051+0000","last_active":"2023-05-10T04:19:14.469470+0000","last_peered":"2023-05-10T04:19:14.469470+0000","last_clean":"2023-05-10T04:19:14.469470+0000","last_became_active":"2023-05-10T04:19:09.482746+0000","last_became_peered":"2023-05-10T04:19:09.482746+0000","last_unstale":"2023-05-10T04:19:14.469470+0000","last_undegraded":"2023-05-10T04:19:14.469470+0000","last_fullsized":"2023-05-10T04:19:14.469470+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:40:44.146612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470309+0000","last_change":"2023-05-10T04:19:09.983015+0000","last_active":"2023-05-10T04:19:14.470309+0000","last_peered":"2023-05-10T04:19:14.470309+0000","last_clean":"2023-05-10T04:19:14.470309+0000","last_became_active":"2023-05-10T04:19:09.982704+0000","last_became_peered":"2023-05-10T04:19:09.982704+0000","last_unstale":"2023-05-10T04:19:14.470309+0000","last_undegraded":"2023-05-10T04:19:14.470309+0000","last_fullsized":"2023-05-10T04:19:14.470309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:01:13.105870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468779+0000","last_change":"2023-05-10T04:19:13.991979+0000","last_active":"2023-05-10T04:19:14.468779+0000","last_peered":"2023-05-10T04:19:14.468779+0000","last_clean":"2023-05-10T04:19:14.468779+0000","last_became_active":"2023-05-10T04:19:13.991551+0000","last_became_peered":"2023-05-10T04:19:13.991551+0000","last_unstale":"2023-05-10T04:19:14.468779+0000","last_undegraded":"2023-05-10T04:19:14.468779+0000","last_fullsized":"2023-05-10T04:19:14.468779+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:08:02.858561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2,7],"acting":[6,3,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577630+0000","last_change":"2023-05-10T04:19:09.480268+0000","last_active":"2023-05-10T04:19:14.577630+0000","last_peered":"2023-05-10T04:19:14.577630+0000","last_clean":"2023-05-10T04:19:14.577630+0000","last_became_active":"2023-05-10T04:19:09.480011+0000","last_became_peered":"2023-05-10T04:19:09.480011+0000","last_unstale":"2023-05-10T04:19:14.577630+0000","last_undegraded":"2023-05-10T04:19:14.577630+0000","last_fullsized":"2023-05-10T04:19:14.577630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:21.331301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202970+0000","last_change":"2023-05-10T04:19:09.981253+0000","last_active":"2023-05-10T04:19:15.202970+0000","last_peered":"2023-05-10T04:19:15.202970+0000","last_clean":"2023-05-10T04:19:15.202970+0000","last_became_active":"2023-05-10T04:19:09.981006+0000","last_became_peered":"2023-05-10T04:19:09.981006+0000","last_unstale":"2023-05-10T04:19:15.202970+0000","last_undegraded":"2023-05-10T04:19:15.202970+0000","last_fullsized":"2023-05-10T04:19:15.202970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:03.498156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201539+0000","last_change":"2023-05-10T04:19:13.987144+0000","last_active":"2023-05-10T04:19:15.201539+0000","last_peered":"2023-05-10T04:19:15.201539+0000","last_clean":"2023-05-10T04:19:15.201539+0000","last_became_active":"2023-05-10T04:19:13.986831+0000","last_became_peered":"2023-05-10T04:19:13.986831+0000","last_unstale":"2023-05-10T04:19:15.201539+0000","last_undegraded":"2023-05-10T04:19:15.201539+0000","last_fullsized":"2023-05-10T04:19:15.201539+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:17:32.556742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,5],"acting":[3,2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578392+0000","last_change":"2023-05-10T04:19:09.478894+0000","last_active":"2023-05-10T04:19:14.578392+0000","last_peered":"2023-05-10T04:19:14.578392+0000","last_clean":"2023-05-10T04:19:14.578392+0000","last_became_active":"2023-05-10T04:19:09.478612+0000","last_became_peered":"2023-05-10T04:19:09.478612+0000","last_unstale":"2023-05-10T04:19:14.578392+0000","last_undegraded":"2023-05-10T04:19:14.578392+0000","last_fullsized":"2023-05-10T04:19:14.578392+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:18:29.989914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627929+0000","last_change":"2023-05-10T04:19:09.975444+0000","last_active":"2023-05-10T04:19:14.627929+0000","last_peered":"2023-05-10T04:19:14.627929+0000","last_clean":"2023-05-10T04:19:14.627929+0000","last_became_active":"2023-05-10T04:19:09.971745+0000","last_became_peered":"2023-05-10T04:19:09.971745+0000","last_unstale":"2023-05-10T04:19:14.627929+0000","last_undegraded":"2023-05-10T04:19:14.627929+0000","last_fullsized":"2023-05-10T04:19:14.627929+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:35:02.017465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201957+0000","last_change":"2023-05-10T04:19:14.001881+0000","last_active":"2023-05-10T04:19:15.201957+0000","last_peered":"2023-05-10T04:19:15.201957+0000","last_clean":"2023-05-10T04:19:15.201957+0000","last_became_active":"2023-05-10T04:19:14.001490+0000","last_became_peered":"2023-05-10T04:19:14.001490+0000","last_unstale":"2023-05-10T04:19:15.201957+0000","last_undegraded":"2023-05-10T04:19:15.201957+0000","last_fullsized":"2023-05-10T04:19:15.201957+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:10.947560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,4],"acting":[2,1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202406+0000","last_change":"2023-05-10T04:19:09.479617+0000","last_active":"2023-05-10T04:19:15.202406+0000","last_peered":"2023-05-10T04:19:15.202406+0000","last_clean":"2023-05-10T04:19:15.202406+0000","last_became_active":"2023-05-10T04:19:09.479285+0000","last_became_peered":"2023-05-10T04:19:09.479285+0000","last_unstale":"2023-05-10T04:19:15.202406+0000","last_undegraded":"2023-05-10T04:19:15.202406+0000","last_fullsized":"2023-05-10T04:19:15.202406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:39:56.952219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469360+0000","last_change":"2023-05-10T04:19:09.972832+0000","last_active":"2023-05-10T04:19:14.469360+0000","last_peered":"2023-05-10T04:19:14.469360+0000","last_clean":"2023-05-10T04:19:14.469360+0000","last_became_active":"2023-05-10T04:19:09.972564+0000","last_became_peered":"2023-05-10T04:19:09.972564+0000","last_unstale":"2023-05-10T04:19:14.469360+0000","last_undegraded":"2023-05-10T04:19:14.469360+0000","last_fullsized":"2023-05-10T04:19:14.469360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:04:31.918880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468579+0000","last_change":"2023-05-10T04:19:13.994267+0000","last_active":"2023-05-10T04:19:14.468579+0000","last_peered":"2023-05-10T04:19:14.468579+0000","last_clean":"2023-05-10T04:19:14.468579+0000","last_became_active":"2023-05-10T04:19:13.993865+0000","last_became_peered":"2023-05-10T04:19:13.993865+0000","last_unstale":"2023-05-10T04:19:14.468579+0000","last_undegraded":"2023-05-10T04:19:14.468579+0000","last_fullsized":"2023-05-10T04:19:14.468579+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:51:00.039452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,7,1],"acting":[4,6,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468689+0000","last_change":"2023-05-10T04:19:09.484992+0000","last_active":"2023-05-10T04:19:14.468689+0000","last_peered":"2023-05-10T04:19:14.468689+0000","last_clean":"2023-05-10T04:19:14.468689+0000","last_became_active":"2023-05-10T04:19:09.484709+0000","last_became_peered":"2023-05-10T04:19:09.484709+0000","last_unstale":"2023-05-10T04:19:14.468689+0000","last_undegraded":"2023-05-10T04:19:14.468689+0000","last_fullsized":"2023-05-10T04:19:14.468689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:33:06.444490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469770+0000","last_change":"2023-05-10T04:19:09.964540+0000","last_active":"2023-05-10T04:19:14.469770+0000","last_peered":"2023-05-10T04:19:14.469770+0000","last_clean":"2023-05-10T04:19:14.469770+0000","last_became_active":"2023-05-10T04:19:09.964164+0000","last_became_peered":"2023-05-10T04:19:09.964164+0000","last_unstale":"2023-05-10T04:19:14.469770+0000","last_undegraded":"2023-05-10T04:19:14.469770+0000","last_fullsized":"2023-05-10T04:19:14.469770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:13:47.427518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468432+0000","last_change":"2023-05-10T04:19:13.997349+0000","last_active":"2023-05-10T04:19:14.468432+0000","last_peered":"2023-05-10T04:19:14.468432+0000","last_clean":"2023-05-10T04:19:14.468432+0000","last_became_active":"2023-05-10T04:19:13.996910+0000","last_became_peered":"2023-05-10T04:19:13.996910+0000","last_unstale":"2023-05-10T04:19:14.468432+0000","last_undegraded":"2023-05-10T04:19:14.468432+0000","last_fullsized":"2023-05-10T04:19:14.468432+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:27:38.893568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,4,3],"acting":[6,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.14","version":"28'10","reported_seq":31,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:28.525847+0000","last_change":"2023-05-10T04:19:09.487001+0000","last_active":"2023-05-10T04:19:28.525847+0000","last_peered":"2023-05-10T04:19:28.525847+0000","last_clean":"2023-05-10T04:19:28.525847+0000","last_became_active":"2023-05-10T04:19:09.486586+0000","last_became_peered":"2023-05-10T04:19:09.486586+0000","last_unstale":"2023-05-10T04:19:28.525847+0000","last_undegraded":"2023-05-10T04:19:28.525847+0000","last_fullsized":"2023-05-10T04:19:28.525847+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:00:37.583297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202590+0000","last_change":"2023-05-10T04:19:09.957140+0000","last_active":"2023-05-10T04:19:15.202590+0000","last_peered":"2023-05-10T04:19:15.202590+0000","last_clean":"2023-05-10T04:19:15.202590+0000","last_became_active":"2023-05-10T04:19:09.956865+0000","last_became_peered":"2023-05-10T04:19:09.956865+0000","last_unstale":"2023-05-10T04:19:15.202590+0000","last_undegraded":"2023-05-10T04:19:15.202590+0000","last_fullsized":"2023-05-10T04:19:15.202590+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:02.330187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202728+0000","last_change":"2023-05-10T04:19:13.993185+0000","last_active":"2023-05-10T04:19:15.202728+0000","last_peered":"2023-05-10T04:19:15.202728+0000","last_clean":"2023-05-10T04:19:15.202728+0000","last_became_active":"2023-05-10T04:19:13.992692+0000","last_became_peered":"2023-05-10T04:19:13.992692+0000","last_unstale":"2023-05-10T04:19:15.202728+0000","last_undegraded":"2023-05-10T04:19:15.202728+0000","last_fullsized":"2023-05-10T04:19:15.202728+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:47:10.276053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,0,6],"acting":[3,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202224+0000","last_change":"2023-05-10T04:19:09.484968+0000","last_active":"2023-05-10T04:19:15.202224+0000","last_peered":"2023-05-10T04:19:15.202224+0000","last_clean":"2023-05-10T04:19:15.202224+0000","last_became_active":"2023-05-10T04:19:09.484666+0000","last_became_peered":"2023-05-10T04:19:09.484666+0000","last_unstale":"2023-05-10T04:19:15.202224+0000","last_undegraded":"2023-05-10T04:19:15.202224+0000","last_fullsized":"2023-05-10T04:19:15.202224+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:34:47.348283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468720+0000","last_change":"2023-05-10T04:19:09.965098+0000","last_active":"2023-05-10T04:19:14.468720+0000","last_peered":"2023-05-10T04:19:14.468720+0000","last_clean":"2023-05-10T04:19:14.468720+0000","last_became_active":"2023-05-10T04:19:09.964725+0000","last_became_peered":"2023-05-10T04:19:09.964725+0000","last_unstale":"2023-05-10T04:19:14.468720+0000","last_undegraded":"2023-05-10T04:19:14.468720+0000","last_fullsized":"2023-05-10T04:19:14.468720+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:03.210099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469999+0000","last_change":"2023-05-10T04:19:13.993540+0000","last_active":"2023-05-10T04:19:14.469999+0000","last_peered":"2023-05-10T04:19:14.469999+0000","last_clean":"2023-05-10T04:19:14.469999+0000","last_became_active":"2023-05-10T04:19:13.993066+0000","last_became_peered":"2023-05-10T04:19:13.993066+0000","last_unstale":"2023-05-10T04:19:14.469999+0000","last_undegraded":"2023-05-10T04:19:14.469999+0000","last_fullsized":"2023-05-10T04:19:14.469999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:14:45.505584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5,7],"acting":[4,2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470101+0000","last_change":"2023-05-10T04:19:09.488098+0000","last_active":"2023-05-10T04:19:14.470101+0000","last_peered":"2023-05-10T04:19:14.470101+0000","last_clean":"2023-05-10T04:19:14.470101+0000","last_became_active":"2023-05-10T04:19:09.487742+0000","last_became_peered":"2023-05-10T04:19:09.487742+0000","last_unstale":"2023-05-10T04:19:14.470101+0000","last_undegraded":"2023-05-10T04:19:14.470101+0000","last_fullsized":"2023-05-10T04:19:14.470101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:07.819601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202937+0000","last_change":"2023-05-10T04:19:09.972874+0000","last_active":"2023-05-10T04:19:15.202937+0000","last_peered":"2023-05-10T04:19:15.202937+0000","last_clean":"2023-05-10T04:19:15.202937+0000","last_became_active":"2023-05-10T04:19:09.972566+0000","last_became_peered":"2023-05-10T04:19:09.972566+0000","last_unstale":"2023-05-10T04:19:15.202937+0000","last_undegraded":"2023-05-10T04:19:15.202937+0000","last_fullsized":"2023-05-10T04:19:15.202937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:13:49.010588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470263+0000","last_change":"2023-05-10T04:19:13.993797+0000","last_active":"2023-05-10T04:19:14.470263+0000","last_peered":"2023-05-10T04:19:14.470263+0000","last_clean":"2023-05-10T04:19:14.470263+0000","last_became_active":"2023-05-10T04:19:13.993365+0000","last_became_peered":"2023-05-10T04:19:13.993365+0000","last_unstale":"2023-05-10T04:19:14.470263+0000","last_undegraded":"2023-05-10T04:19:14.470263+0000","last_fullsized":"2023-05-10T04:19:14.470263+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:09:47.459492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1,6],"acting":[4,5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201324+0000","last_change":"2023-05-10T04:19:09.486993+0000","last_active":"2023-05-10T04:19:15.201324+0000","last_peered":"2023-05-10T04:19:15.201324+0000","last_clean":"2023-05-10T04:19:15.201324+0000","last_became_active":"2023-05-10T04:19:09.486669+0000","last_became_peered":"2023-05-10T04:19:09.486669+0000","last_unstale":"2023-05-10T04:19:15.201324+0000","last_undegraded":"2023-05-10T04:19:15.201324+0000","last_fullsized":"2023-05-10T04:19:15.201324+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:16:36.569982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578044+0000","last_change":"2023-05-10T04:19:09.983016+0000","last_active":"2023-05-10T04:19:14.578044+0000","last_peered":"2023-05-10T04:19:14.578044+0000","last_clean":"2023-05-10T04:19:14.578044+0000","last_became_active":"2023-05-10T04:19:09.982497+0000","last_became_peered":"2023-05-10T04:19:09.982497+0000","last_unstale":"2023-05-10T04:19:14.578044+0000","last_undegraded":"2023-05-10T04:19:14.578044+0000","last_fullsized":"2023-05-10T04:19:14.578044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:21:36.260108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203604+0000","last_change":"2023-05-10T04:19:13.994827+0000","last_active":"2023-05-10T04:19:15.203604+0000","last_peered":"2023-05-10T04:19:15.203604+0000","last_clean":"2023-05-10T04:19:15.203604+0000","last_became_active":"2023-05-10T04:19:13.994438+0000","last_became_peered":"2023-05-10T04:19:13.994438+0000","last_unstale":"2023-05-10T04:19:15.203604+0000","last_undegraded":"2023-05-10T04:19:15.203604+0000","last_fullsized":"2023-05-10T04:19:15.203604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:46.248734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,4,0],"acting":[3,6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203225+0000","last_change":"2023-05-10T04:19:09.487877+0000","last_active":"2023-05-10T04:19:15.203225+0000","last_peered":"2023-05-10T04:19:15.203225+0000","last_clean":"2023-05-10T04:19:15.203225+0000","last_became_active":"2023-05-10T04:19:09.487604+0000","last_became_peered":"2023-05-10T04:19:09.487604+0000","last_unstale":"2023-05-10T04:19:15.203225+0000","last_undegraded":"2023-05-10T04:19:15.203225+0000","last_fullsized":"2023-05-10T04:19:15.203225+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:53:17.665016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578524+0000","last_change":"2023-05-10T04:19:09.980726+0000","last_active":"2023-05-10T04:19:14.578524+0000","last_peered":"2023-05-10T04:19:14.578524+0000","last_clean":"2023-05-10T04:19:14.578524+0000","last_became_active":"2023-05-10T04:19:09.980180+0000","last_became_peered":"2023-05-10T04:19:09.980180+0000","last_unstale":"2023-05-10T04:19:14.578524+0000","last_undegraded":"2023-05-10T04:19:14.578524+0000","last_fullsized":"2023-05-10T04:19:14.578524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:00.301504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203398+0000","last_change":"2023-05-10T04:19:14.003780+0000","last_active":"2023-05-10T04:19:15.203398+0000","last_peered":"2023-05-10T04:19:15.203398+0000","last_clean":"2023-05-10T04:19:15.203398+0000","last_became_active":"2023-05-10T04:19:14.003409+0000","last_became_peered":"2023-05-10T04:19:14.003409+0000","last_unstale":"2023-05-10T04:19:15.203398+0000","last_undegraded":"2023-05-10T04:19:15.203398+0000","last_fullsized":"2023-05-10T04:19:15.203398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:50:12.629644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,7],"acting":[1,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469034+0000","last_change":"2023-05-10T04:19:09.483762+0000","last_active":"2023-05-10T04:19:14.469034+0000","last_peered":"2023-05-10T04:19:14.469034+0000","last_clean":"2023-05-10T04:19:14.469034+0000","last_became_active":"2023-05-10T04:19:09.483508+0000","last_became_peered":"2023-05-10T04:19:09.483508+0000","last_unstale":"2023-05-10T04:19:14.469034+0000","last_undegraded":"2023-05-10T04:19:14.469034+0000","last_fullsized":"2023-05-10T04:19:14.469034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:01.327876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201995+0000","last_change":"2023-05-10T04:19:09.978563+0000","last_active":"2023-05-10T04:19:15.201995+0000","last_peered":"2023-05-10T04:19:15.201995+0000","last_clean":"2023-05-10T04:19:15.201995+0000","last_became_active":"2023-05-10T04:19:09.978238+0000","last_became_peered":"2023-05-10T04:19:09.978238+0000","last_unstale":"2023-05-10T04:19:15.201995+0000","last_undegraded":"2023-05-10T04:19:15.201995+0000","last_fullsized":"2023-05-10T04:19:15.201995+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:20:11.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468304+0000","last_change":"2023-05-10T04:19:13.991533+0000","last_active":"2023-05-10T04:19:14.468304+0000","last_peered":"2023-05-10T04:19:14.468304+0000","last_clean":"2023-05-10T04:19:14.468304+0000","last_became_active":"2023-05-10T04:19:13.990999+0000","last_became_peered":"2023-05-10T04:19:13.990999+0000","last_unstale":"2023-05-10T04:19:14.468304+0000","last_undegraded":"2023-05-10T04:19:14.468304+0000","last_fullsized":"2023-05-10T04:19:14.468304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:05.585266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,0],"acting":[6,4,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202273+0000","last_change":"2023-05-10T04:19:09.485526+0000","last_active":"2023-05-10T04:19:15.202273+0000","last_peered":"2023-05-10T04:19:15.202273+0000","last_clean":"2023-05-10T04:19:15.202273+0000","last_became_active":"2023-05-10T04:19:09.485273+0000","last_became_peered":"2023-05-10T04:19:09.485273+0000","last_unstale":"2023-05-10T04:19:15.202273+0000","last_undegraded":"2023-05-10T04:19:15.202273+0000","last_fullsized":"2023-05-10T04:19:15.202273+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:41.760079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203432+0000","last_change":"2023-05-10T04:19:09.985453+0000","last_active":"2023-05-10T04:19:15.203432+0000","last_peered":"2023-05-10T04:19:15.203432+0000","last_clean":"2023-05-10T04:19:15.203432+0000","last_became_active":"2023-05-10T04:19:09.985167+0000","last_became_peered":"2023-05-10T04:19:09.985167+0000","last_unstale":"2023-05-10T04:19:15.203432+0000","last_undegraded":"2023-05-10T04:19:15.203432+0000","last_fullsized":"2023-05-10T04:19:15.203432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:01:22.333611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577827+0000","last_change":"2023-05-10T04:19:14.004309+0000","last_active":"2023-05-10T04:19:14.577827+0000","last_peered":"2023-05-10T04:19:14.577827+0000","last_clean":"2023-05-10T04:19:14.577827+0000","last_became_active":"2023-05-10T04:19:14.003928+0000","last_became_peered":"2023-05-10T04:19:14.003928+0000","last_unstale":"2023-05-10T04:19:14.577827+0000","last_undegraded":"2023-05-10T04:19:14.577827+0000","last_fullsized":"2023-05-10T04:19:14.577827+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:24:10.810295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202378+0000","last_change":"2023-05-10T04:19:09.482542+0000","last_active":"2023-05-10T04:19:15.202378+0000","last_peered":"2023-05-10T04:19:15.202378+0000","last_clean":"2023-05-10T04:19:15.202378+0000","last_became_active":"2023-05-10T04:19:09.482173+0000","last_became_peered":"2023-05-10T04:19:09.482173+0000","last_unstale":"2023-05-10T04:19:15.202378+0000","last_undegraded":"2023-05-10T04:19:15.202378+0000","last_fullsized":"2023-05-10T04:19:15.202378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:55:03.870485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202375+0000","last_change":"2023-05-10T04:19:09.957801+0000","last_active":"2023-05-10T04:19:15.202375+0000","last_peered":"2023-05-10T04:19:15.202375+0000","last_clean":"2023-05-10T04:19:15.202375+0000","last_became_active":"2023-05-10T04:19:09.957469+0000","last_became_peered":"2023-05-10T04:19:09.957469+0000","last_unstale":"2023-05-10T04:19:15.202375+0000","last_undegraded":"2023-05-10T04:19:15.202375+0000","last_fullsized":"2023-05-10T04:19:15.202375+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:26:39.953202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469741+0000","last_change":"2023-05-10T04:19:13.991736+0000","last_active":"2023-05-10T04:19:14.469741+0000","last_peered":"2023-05-10T04:19:14.469741+0000","last_clean":"2023-05-10T04:19:14.469741+0000","last_became_active":"2023-05-10T04:19:13.991194+0000","last_became_peered":"2023-05-10T04:19:13.991194+0000","last_unstale":"2023-05-10T04:19:14.469741+0000","last_undegraded":"2023-05-10T04:19:14.469741+0000","last_fullsized":"2023-05-10T04:19:14.469741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:50:12.629644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,7],"acting":[6,0,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468850+0000","last_change":"2023-05-10T04:19:09.483818+0000","last_active":"2023-05-10T04:19:14.468850+0000","last_peered":"2023-05-10T04:19:14.468850+0000","last_clean":"2023-05-10T04:19:14.468850+0000","last_became_active":"2023-05-10T04:19:09.483516+0000","last_became_peered":"2023-05-10T04:19:09.483516+0000","last_unstale":"2023-05-10T04:19:14.468850+0000","last_undegraded":"2023-05-10T04:19:14.468850+0000","last_fullsized":"2023-05-10T04:19:14.468850+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:39:56.952219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577909+0000","last_change":"2023-05-10T04:19:09.979521+0000","last_active":"2023-05-10T04:19:14.577909+0000","last_peered":"2023-05-10T04:19:14.577909+0000","last_clean":"2023-05-10T04:19:14.577909+0000","last_became_active":"2023-05-10T04:19:09.979271+0000","last_became_peered":"2023-05-10T04:19:09.979271+0000","last_unstale":"2023-05-10T04:19:14.577909+0000","last_undegraded":"2023-05-10T04:19:14.577909+0000","last_fullsized":"2023-05-10T04:19:14.577909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:05:43.697518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628055+0000","last_change":"2023-05-10T04:19:13.998610+0000","last_active":"2023-05-10T04:19:14.628055+0000","last_peered":"2023-05-10T04:19:14.628055+0000","last_clean":"2023-05-10T04:19:14.628055+0000","last_became_active":"2023-05-10T04:19:13.996908+0000","last_became_peered":"2023-05-10T04:19:13.996908+0000","last_unstale":"2023-05-10T04:19:14.628055+0000","last_undegraded":"2023-05-10T04:19:14.628055+0000","last_fullsized":"2023-05-10T04:19:14.628055+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:00:47.831221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,5,1],"acting":[7,0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628332+0000","last_change":"2023-05-10T04:19:09.482944+0000","last_active":"2023-05-10T04:19:14.628332+0000","last_peered":"2023-05-10T04:19:14.628332+0000","last_clean":"2023-05-10T04:19:14.628332+0000","last_became_active":"2023-05-10T04:19:09.482584+0000","last_became_peered":"2023-05-10T04:19:09.482584+0000","last_unstale":"2023-05-10T04:19:14.628332+0000","last_undegraded":"2023-05-10T04:19:14.628332+0000","last_fullsized":"2023-05-10T04:19:14.628332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:22:54.728492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468803+0000","last_change":"2023-05-10T04:19:09.971873+0000","last_active":"2023-05-10T04:19:14.468803+0000","last_peered":"2023-05-10T04:19:14.468803+0000","last_clean":"2023-05-10T04:19:14.468803+0000","last_became_active":"2023-05-10T04:19:09.971597+0000","last_became_peered":"2023-05-10T04:19:09.971597+0000","last_unstale":"2023-05-10T04:19:14.468803+0000","last_undegraded":"2023-05-10T04:19:14.468803+0000","last_fullsized":"2023-05-10T04:19:14.468803+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:26:39.953202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577980+0000","last_change":"2023-05-10T04:19:14.004765+0000","last_active":"2023-05-10T04:19:14.577980+0000","last_peered":"2023-05-10T04:19:14.577980+0000","last_clean":"2023-05-10T04:19:14.577980+0000","last_became_active":"2023-05-10T04:19:14.004329+0000","last_became_peered":"2023-05-10T04:19:14.004329+0000","last_unstale":"2023-05-10T04:19:14.577980+0000","last_undegraded":"2023-05-10T04:19:14.577980+0000","last_fullsized":"2023-05-10T04:19:14.577980+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:01:56.052239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4,2],"acting":[5,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202125+0000","last_change":"2023-05-10T04:19:09.477530+0000","last_active":"2023-05-10T04:19:15.202125+0000","last_peered":"2023-05-10T04:19:15.202125+0000","last_clean":"2023-05-10T04:19:15.202125+0000","last_became_active":"2023-05-10T04:19:09.477212+0000","last_became_peered":"2023-05-10T04:19:09.477212+0000","last_unstale":"2023-05-10T04:19:15.202125+0000","last_undegraded":"2023-05-10T04:19:15.202125+0000","last_fullsized":"2023-05-10T04:19:15.202125+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:43.682176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203043+0000","last_change":"2023-05-10T04:19:09.979824+0000","last_active":"2023-05-10T04:19:15.203043+0000","last_peered":"2023-05-10T04:19:15.203043+0000","last_clean":"2023-05-10T04:19:15.203043+0000","last_became_active":"2023-05-10T04:19:09.979050+0000","last_became_peered":"2023-05-10T04:19:09.979050+0000","last_unstale":"2023-05-10T04:19:15.203043+0000","last_undegraded":"2023-05-10T04:19:15.203043+0000","last_fullsized":"2023-05-10T04:19:15.203043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:38:42.232230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203438+0000","last_change":"2023-05-10T04:19:14.002975+0000","last_active":"2023-05-10T04:19:15.203438+0000","last_peered":"2023-05-10T04:19:15.203438+0000","last_clean":"2023-05-10T04:19:15.203438+0000","last_became_active":"2023-05-10T04:19:14.002560+0000","last_became_peered":"2023-05-10T04:19:14.002560+0000","last_unstale":"2023-05-10T04:19:15.203438+0000","last_undegraded":"2023-05-10T04:19:15.203438+0000","last_fullsized":"2023-05-10T04:19:15.203438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:23:30.609594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,5],"acting":[1,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201619+0000","last_change":"2023-05-10T04:19:09.474972+0000","last_active":"2023-05-10T04:19:15.201619+0000","last_peered":"2023-05-10T04:19:15.201619+0000","last_clean":"2023-05-10T04:19:15.201619+0000","last_became_active":"2023-05-10T04:19:09.474099+0000","last_became_peered":"2023-05-10T04:19:09.474099+0000","last_unstale":"2023-05-10T04:19:15.201619+0000","last_undegraded":"2023-05-10T04:19:15.201619+0000","last_fullsized":"2023-05-10T04:19:15.201619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:54:08.193033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202858+0000","last_change":"2023-05-10T04:19:09.957614+0000","last_active":"2023-05-10T04:19:15.202858+0000","last_peered":"2023-05-10T04:19:15.202858+0000","last_clean":"2023-05-10T04:19:15.202858+0000","last_became_active":"2023-05-10T04:19:09.957357+0000","last_became_peered":"2023-05-10T04:19:09.957357+0000","last_unstale":"2023-05-10T04:19:15.202858+0000","last_undegraded":"2023-05-10T04:19:15.202858+0000","last_fullsized":"2023-05-10T04:19:15.202858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:58:35.622573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202916+0000","last_change":"2023-05-10T04:19:13.993397+0000","last_active":"2023-05-10T04:19:15.202916+0000","last_peered":"2023-05-10T04:19:15.202916+0000","last_clean":"2023-05-10T04:19:15.202916+0000","last_became_active":"2023-05-10T04:19:13.992829+0000","last_became_peered":"2023-05-10T04:19:13.992829+0000","last_unstale":"2023-05-10T04:19:15.202916+0000","last_undegraded":"2023-05-10T04:19:15.202916+0000","last_fullsized":"2023-05-10T04:19:15.202916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:20:16.772499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,5],"acting":[3,2,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469100+0000","last_change":"2023-05-10T04:19:09.473096+0000","last_active":"2023-05-10T04:19:14.469100+0000","last_peered":"2023-05-10T04:19:14.469100+0000","last_clean":"2023-05-10T04:19:14.469100+0000","last_became_active":"2023-05-10T04:19:09.472782+0000","last_became_peered":"2023-05-10T04:19:09.472782+0000","last_unstale":"2023-05-10T04:19:14.469100+0000","last_undegraded":"2023-05-10T04:19:14.469100+0000","last_fullsized":"2023-05-10T04:19:14.469100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:55:45.107377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628277+0000","last_change":"2023-05-10T04:19:09.976127+0000","last_active":"2023-05-10T04:19:14.628277+0000","last_peered":"2023-05-10T04:19:14.628277+0000","last_clean":"2023-05-10T04:19:14.628277+0000","last_became_active":"2023-05-10T04:19:09.975290+0000","last_became_peered":"2023-05-10T04:19:09.975290+0000","last_unstale":"2023-05-10T04:19:14.628277+0000","last_undegraded":"2023-05-10T04:19:14.628277+0000","last_fullsized":"2023-05-10T04:19:14.628277+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:16.352843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468740+0000","last_change":"2023-05-10T04:19:13.993845+0000","last_active":"2023-05-10T04:19:14.468740+0000","last_peered":"2023-05-10T04:19:14.468740+0000","last_clean":"2023-05-10T04:19:14.468740+0000","last_became_active":"2023-05-10T04:19:13.993409+0000","last_became_peered":"2023-05-10T04:19:13.993409+0000","last_unstale":"2023-05-10T04:19:14.468740+0000","last_undegraded":"2023-05-10T04:19:14.468740+0000","last_fullsized":"2023-05-10T04:19:14.468740+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:43:57.821791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,3,1],"acting":[4,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578256+0000","last_change":"2023-05-10T04:19:04.607342+0000","last_active":"2023-05-10T04:19:14.578256+0000","last_peered":"2023-05-10T04:19:14.578256+0000","last_clean":"2023-05-10T04:19:14.578256+0000","last_became_active":"2023-05-10T04:19:04.606956+0000","last_became_peered":"2023-05-10T04:19:04.606956+0000","last_unstale":"2023-05-10T04:19:14.578256+0000","last_undegraded":"2023-05-10T04:19:14.578256+0000","last_fullsized":"2023-05-10T04:19:14.578256+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:51.656021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203073+0000","last_change":"2023-05-10T04:19:09.480586+0000","last_active":"2023-05-10T04:19:15.203073+0000","last_peered":"2023-05-10T04:19:15.203073+0000","last_clean":"2023-05-10T04:19:15.203073+0000","last_became_active":"2023-05-10T04:19:09.480088+0000","last_became_peered":"2023-05-10T04:19:09.480088+0000","last_unstale":"2023-05-10T04:19:15.203073+0000","last_undegraded":"2023-05-10T04:19:15.203073+0000","last_fullsized":"2023-05-10T04:19:15.203073+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:07:58.355490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469903+0000","last_change":"2023-05-10T04:19:09.961077+0000","last_active":"2023-05-10T04:19:14.469903+0000","last_peered":"2023-05-10T04:19:14.469903+0000","last_clean":"2023-05-10T04:19:14.469903+0000","last_became_active":"2023-05-10T04:19:09.960790+0000","last_became_peered":"2023-05-10T04:19:09.960790+0000","last_unstale":"2023-05-10T04:19:14.469903+0000","last_undegraded":"2023-05-10T04:19:14.469903+0000","last_fullsized":"2023-05-10T04:19:14.469903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:23:27.108834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628434+0000","last_change":"2023-05-10T04:19:13.996996+0000","last_active":"2023-05-10T04:19:14.628434+0000","last_peered":"2023-05-10T04:19:14.628434+0000","last_clean":"2023-05-10T04:19:14.628434+0000","last_became_active":"2023-05-10T04:19:13.996598+0000","last_became_peered":"2023-05-10T04:19:13.996598+0000","last_unstale":"2023-05-10T04:19:14.628434+0000","last_undegraded":"2023-05-10T04:19:14.628434+0000","last_fullsized":"2023-05-10T04:19:14.628434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:28.777158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,3,1],"acting":[7,4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204389+0000","last_change":"2023-05-10T04:19:04.607370+0000","last_active":"2023-05-10T04:19:15.204389+0000","last_peered":"2023-05-10T04:19:15.204389+0000","last_clean":"2023-05-10T04:19:15.204389+0000","last_became_active":"2023-05-10T04:19:04.606959+0000","last_became_peered":"2023-05-10T04:19:04.606959+0000","last_unstale":"2023-05-10T04:19:15.204389+0000","last_undegraded":"2023-05-10T04:19:15.204389+0000","last_fullsized":"2023-05-10T04:19:15.204389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:46:45.282015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468586+0000","last_change":"2023-05-10T04:19:09.485273+0000","last_active":"2023-05-10T04:19:14.468586+0000","last_peered":"2023-05-10T04:19:14.468586+0000","last_clean":"2023-05-10T04:19:14.468586+0000","last_became_active":"2023-05-10T04:19:09.484339+0000","last_became_peered":"2023-05-10T04:19:09.484339+0000","last_unstale":"2023-05-10T04:19:14.468586+0000","last_undegraded":"2023-05-10T04:19:14.468586+0000","last_fullsized":"2023-05-10T04:19:14.468586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:22:54.728492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468949+0000","last_change":"2023-05-10T04:19:09.972782+0000","last_active":"2023-05-10T04:19:14.468949+0000","last_peered":"2023-05-10T04:19:14.468949+0000","last_clean":"2023-05-10T04:19:14.468949+0000","last_became_active":"2023-05-10T04:19:09.972529+0000","last_became_peered":"2023-05-10T04:19:09.972529+0000","last_unstale":"2023-05-10T04:19:14.468949+0000","last_undegraded":"2023-05-10T04:19:14.468949+0000","last_fullsized":"2023-05-10T04:19:14.468949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:58:35.622573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628526+0000","last_change":"2023-05-10T04:19:13.998192+0000","last_active":"2023-05-10T04:19:14.628526+0000","last_peered":"2023-05-10T04:19:14.628526+0000","last_clean":"2023-05-10T04:19:14.628526+0000","last_became_active":"2023-05-10T04:19:13.997769+0000","last_became_peered":"2023-05-10T04:19:13.997769+0000","last_unstale":"2023-05-10T04:19:14.628526+0000","last_undegraded":"2023-05-10T04:19:14.628526+0000","last_fullsized":"2023-05-10T04:19:14.628526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:19:46.263150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4,1],"acting":[7,0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.627832+0000","last_change":"2023-05-10T04:19:04.443832+0000","last_active":"2023-05-10T04:19:14.627832+0000","last_peered":"2023-05-10T04:19:14.627832+0000","last_clean":"2023-05-10T04:19:14.627832+0000","last_became_active":"2023-05-10T04:19:04.443487+0000","last_became_peered":"2023-05-10T04:19:04.443487+0000","last_unstale":"2023-05-10T04:19:14.627832+0000","last_undegraded":"2023-05-10T04:19:14.627832+0000","last_fullsized":"2023-05-10T04:19:14.627832+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:15:00.148812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577489+0000","last_change":"2023-05-10T04:19:09.485735+0000","last_active":"2023-05-10T04:19:14.577489+0000","last_peered":"2023-05-10T04:19:14.577489+0000","last_clean":"2023-05-10T04:19:14.577489+0000","last_became_active":"2023-05-10T04:19:09.485425+0000","last_became_peered":"2023-05-10T04:19:09.485425+0000","last_unstale":"2023-05-10T04:19:14.577489+0000","last_undegraded":"2023-05-10T04:19:14.577489+0000","last_fullsized":"2023-05-10T04:19:14.577489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:07.819601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469043+0000","last_change":"2023-05-10T04:19:09.977673+0000","last_active":"2023-05-10T04:19:14.469043+0000","last_peered":"2023-05-10T04:19:14.469043+0000","last_clean":"2023-05-10T04:19:14.469043+0000","last_became_active":"2023-05-10T04:19:09.977396+0000","last_became_peered":"2023-05-10T04:19:09.977396+0000","last_unstale":"2023-05-10T04:19:14.469043+0000","last_undegraded":"2023-05-10T04:19:14.469043+0000","last_fullsized":"2023-05-10T04:19:14.469043+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:19.596953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468711+0000","last_change":"2023-05-10T04:19:13.997725+0000","last_active":"2023-05-10T04:19:14.468711+0000","last_peered":"2023-05-10T04:19:14.468711+0000","last_clean":"2023-05-10T04:19:14.468711+0000","last_became_active":"2023-05-10T04:19:13.997358+0000","last_became_peered":"2023-05-10T04:19:13.997358+0000","last_unstale":"2023-05-10T04:19:14.468711+0000","last_undegraded":"2023-05-10T04:19:14.468711+0000","last_fullsized":"2023-05-10T04:19:14.468711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:28.777158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202014+0000","last_change":"2023-05-10T04:19:04.443331+0000","last_active":"2023-05-10T04:19:15.202014+0000","last_peered":"2023-05-10T04:19:15.202014+0000","last_clean":"2023-05-10T04:19:15.202014+0000","last_became_active":"2023-05-10T04:19:04.443060+0000","last_became_peered":"2023-05-10T04:19:04.443060+0000","last_unstale":"2023-05-10T04:19:15.202014+0000","last_undegraded":"2023-05-10T04:19:15.202014+0000","last_fullsized":"2023-05-10T04:19:15.202014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:57:20.264880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":181,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203569+0000","last_change":"2023-05-10T04:18:57.192195+0000","last_active":"2023-05-10T04:19:15.203569+0000","last_peered":"2023-05-10T04:19:15.203569+0000","last_clean":"2023-05-10T04:19:15.203569+0000","last_became_active":"2023-05-10T04:18:57.191298+0000","last_became_peered":"2023-05-10T04:18:57.191298+0000","last_unstale":"2023-05-10T04:19:15.203569+0000","last_undegraded":"2023-05-10T04:19:15.203569+0000","last_fullsized":"2023-05-10T04:19:15.203569+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_clean_scrub_stamp":"2023-05-10T04:18:56.172967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:05:30.415630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469650+0000","last_change":"2023-05-10T04:19:09.473780+0000","last_active":"2023-05-10T04:19:14.469650+0000","last_peered":"2023-05-10T04:19:14.469650+0000","last_clean":"2023-05-10T04:19:14.469650+0000","last_became_active":"2023-05-10T04:19:09.473417+0000","last_became_peered":"2023-05-10T04:19:09.473417+0000","last_unstale":"2023-05-10T04:19:14.469650+0000","last_undegraded":"2023-05-10T04:19:14.469650+0000","last_fullsized":"2023-05-10T04:19:14.469650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:35:58.690053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202817+0000","last_change":"2023-05-10T04:19:09.980022+0000","last_active":"2023-05-10T04:19:15.202817+0000","last_peered":"2023-05-10T04:19:15.202817+0000","last_clean":"2023-05-10T04:19:15.202817+0000","last_became_active":"2023-05-10T04:19:09.979557+0000","last_became_peered":"2023-05-10T04:19:09.979557+0000","last_unstale":"2023-05-10T04:19:15.202817+0000","last_undegraded":"2023-05-10T04:19:15.202817+0000","last_fullsized":"2023-05-10T04:19:15.202817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:27:31.317037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202554+0000","last_change":"2023-05-10T04:19:13.990077+0000","last_active":"2023-05-10T04:19:15.202554+0000","last_peered":"2023-05-10T04:19:15.202554+0000","last_clean":"2023-05-10T04:19:15.202554+0000","last_became_active":"2023-05-10T04:19:13.989665+0000","last_became_peered":"2023-05-10T04:19:13.989665+0000","last_unstale":"2023-05-10T04:19:15.202554+0000","last_undegraded":"2023-05-10T04:19:15.202554+0000","last_fullsized":"2023-05-10T04:19:15.202554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:56:23.432293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,0],"acting":[3,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201872+0000","last_change":"2023-05-10T04:19:04.443785+0000","last_active":"2023-05-10T04:19:15.201872+0000","last_peered":"2023-05-10T04:19:15.201872+0000","last_clean":"2023-05-10T04:19:15.201872+0000","last_became_active":"2023-05-10T04:19:04.443499+0000","last_became_peered":"2023-05-10T04:19:04.443499+0000","last_unstale":"2023-05-10T04:19:15.201872+0000","last_undegraded":"2023-05-10T04:19:15.201872+0000","last_fullsized":"2023-05-10T04:19:15.201872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:36:06.817648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468318+0000","last_change":"2023-05-10T04:19:09.480112+0000","last_active":"2023-05-10T04:19:14.468318+0000","last_peered":"2023-05-10T04:19:14.468318+0000","last_clean":"2023-05-10T04:19:14.468318+0000","last_became_active":"2023-05-10T04:19:09.479809+0000","last_became_peered":"2023-05-10T04:19:09.479809+0000","last_unstale":"2023-05-10T04:19:14.468318+0000","last_undegraded":"2023-05-10T04:19:14.468318+0000","last_fullsized":"2023-05-10T04:19:14.468318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:01.327876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578367+0000","last_change":"2023-05-10T04:19:09.982844+0000","last_active":"2023-05-10T04:19:14.578367+0000","last_peered":"2023-05-10T04:19:14.578367+0000","last_clean":"2023-05-10T04:19:14.578367+0000","last_became_active":"2023-05-10T04:19:09.982169+0000","last_became_peered":"2023-05-10T04:19:09.982169+0000","last_unstale":"2023-05-10T04:19:14.578367+0000","last_undegraded":"2023-05-10T04:19:14.578367+0000","last_fullsized":"2023-05-10T04:19:14.578367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:15:37.641989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468590+0000","last_change":"2023-05-10T04:19:13.996191+0000","last_active":"2023-05-10T04:19:14.468590+0000","last_peered":"2023-05-10T04:19:14.468590+0000","last_clean":"2023-05-10T04:19:14.468590+0000","last_became_active":"2023-05-10T04:19:13.995821+0000","last_became_peered":"2023-05-10T04:19:13.995821+0000","last_unstale":"2023-05-10T04:19:14.468590+0000","last_undegraded":"2023-05-10T04:19:14.468590+0000","last_fullsized":"2023-05-10T04:19:14.468590+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:13:19.853603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2,5],"acting":[0,7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202501+0000","last_change":"2023-05-10T04:19:04.442968+0000","last_active":"2023-05-10T04:19:15.202501+0000","last_peered":"2023-05-10T04:19:15.202501+0000","last_clean":"2023-05-10T04:19:15.202501+0000","last_became_active":"2023-05-10T04:19:04.442633+0000","last_became_peered":"2023-05-10T04:19:04.442633+0000","last_unstale":"2023-05-10T04:19:15.202501+0000","last_undegraded":"2023-05-10T04:19:15.202501+0000","last_fullsized":"2023-05-10T04:19:15.202501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:25:07.501670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469097+0000","last_change":"2023-05-10T04:19:09.484103+0000","last_active":"2023-05-10T04:19:14.469097+0000","last_peered":"2023-05-10T04:19:14.469097+0000","last_clean":"2023-05-10T04:19:14.469097+0000","last_became_active":"2023-05-10T04:19:09.483770+0000","last_became_peered":"2023-05-10T04:19:09.483770+0000","last_unstale":"2023-05-10T04:19:14.469097+0000","last_undegraded":"2023-05-10T04:19:14.469097+0000","last_fullsized":"2023-05-10T04:19:14.469097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:53:17.665016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469128+0000","last_change":"2023-05-10T04:19:09.971611+0000","last_active":"2023-05-10T04:19:14.469128+0000","last_peered":"2023-05-10T04:19:14.469128+0000","last_clean":"2023-05-10T04:19:14.469128+0000","last_became_active":"2023-05-10T04:19:09.971338+0000","last_became_peered":"2023-05-10T04:19:09.971338+0000","last_unstale":"2023-05-10T04:19:14.469128+0000","last_undegraded":"2023-05-10T04:19:14.469128+0000","last_fullsized":"2023-05-10T04:19:14.469128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:54:23.670496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202060+0000","last_change":"2023-05-10T04:19:13.990413+0000","last_active":"2023-05-10T04:19:15.202060+0000","last_peered":"2023-05-10T04:19:15.202060+0000","last_clean":"2023-05-10T04:19:15.202060+0000","last_became_active":"2023-05-10T04:19:13.988555+0000","last_became_peered":"2023-05-10T04:19:13.988555+0000","last_unstale":"2023-05-10T04:19:15.202060+0000","last_undegraded":"2023-05-10T04:19:15.202060+0000","last_fullsized":"2023-05-10T04:19:15.202060+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:44:59.851980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,2],"acting":[3,7,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470404+0000","last_change":"2023-05-10T04:19:09.480141+0000","last_active":"2023-05-10T04:19:14.470404+0000","last_peered":"2023-05-10T04:19:14.470404+0000","last_clean":"2023-05-10T04:19:14.470404+0000","last_became_active":"2023-05-10T04:19:09.479868+0000","last_became_peered":"2023-05-10T04:19:09.479868+0000","last_unstale":"2023-05-10T04:19:14.470404+0000","last_undegraded":"2023-05-10T04:19:14.470404+0000","last_fullsized":"2023-05-10T04:19:14.470404+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:40:32.714684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470401+0000","last_change":"2023-05-10T04:19:04.440282+0000","last_active":"2023-05-10T04:19:14.470401+0000","last_peered":"2023-05-10T04:19:14.470401+0000","last_clean":"2023-05-10T04:19:14.470401+0000","last_became_active":"2023-05-10T04:19:04.439945+0000","last_became_peered":"2023-05-10T04:19:04.439945+0000","last_unstale":"2023-05-10T04:19:14.470401+0000","last_undegraded":"2023-05-10T04:19:14.470401+0000","last_fullsized":"2023-05-10T04:19:14.470401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:08:26.159897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468913+0000","last_change":"2023-05-10T04:19:09.983026+0000","last_active":"2023-05-10T04:19:14.468913+0000","last_peered":"2023-05-10T04:19:14.468913+0000","last_clean":"2023-05-10T04:19:14.468913+0000","last_became_active":"2023-05-10T04:19:09.982665+0000","last_became_peered":"2023-05-10T04:19:09.982665+0000","last_unstale":"2023-05-10T04:19:14.468913+0000","last_undegraded":"2023-05-10T04:19:14.468913+0000","last_fullsized":"2023-05-10T04:19:14.468913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:36:35.332796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469350+0000","last_change":"2023-05-10T04:19:14.006885+0000","last_active":"2023-05-10T04:19:14.469350+0000","last_peered":"2023-05-10T04:19:14.469350+0000","last_clean":"2023-05-10T04:19:14.469350+0000","last_became_active":"2023-05-10T04:19:14.006506+0000","last_became_peered":"2023-05-10T04:19:14.006506+0000","last_unstale":"2023-05-10T04:19:14.469350+0000","last_undegraded":"2023-05-10T04:19:14.469350+0000","last_fullsized":"2023-05-10T04:19:14.469350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:31:03.826068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2,6],"acting":[4,7,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202770+0000","last_change":"2023-05-10T04:19:04.444610+0000","last_active":"2023-05-10T04:19:15.202770+0000","last_peered":"2023-05-10T04:19:15.202770+0000","last_clean":"2023-05-10T04:19:15.202770+0000","last_became_active":"2023-05-10T04:19:04.444273+0000","last_became_peered":"2023-05-10T04:19:04.444273+0000","last_unstale":"2023-05-10T04:19:15.202770+0000","last_undegraded":"2023-05-10T04:19:15.202770+0000","last_fullsized":"2023-05-10T04:19:15.202770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:16:40.114985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"28'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.470258+0000","last_change":"2023-05-10T04:19:09.477274+0000","last_active":"2023-05-10T04:19:14.470258+0000","last_peered":"2023-05-10T04:19:14.470258+0000","last_clean":"2023-05-10T04:19:14.470258+0000","last_became_active":"2023-05-10T04:19:09.476956+0000","last_became_peered":"2023-05-10T04:19:09.476956+0000","last_unstale":"2023-05-10T04:19:14.470258+0000","last_undegraded":"2023-05-10T04:19:14.470258+0000","last_fullsized":"2023-05-10T04:19:14.470258+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:24:59.737968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202341+0000","last_change":"2023-05-10T04:19:09.959284+0000","last_active":"2023-05-10T04:19:15.202341+0000","last_peered":"2023-05-10T04:19:15.202341+0000","last_clean":"2023-05-10T04:19:15.202341+0000","last_became_active":"2023-05-10T04:19:09.959030+0000","last_became_peered":"2023-05-10T04:19:09.959030+0000","last_unstale":"2023-05-10T04:19:15.202341+0000","last_undegraded":"2023-05-10T04:19:15.202341+0000","last_fullsized":"2023-05-10T04:19:15.202341+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:04:32.114370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469919+0000","last_change":"2023-05-10T04:19:13.995438+0000","last_active":"2023-05-10T04:19:14.469919+0000","last_peered":"2023-05-10T04:19:14.469919+0000","last_clean":"2023-05-10T04:19:14.469919+0000","last_became_active":"2023-05-10T04:19:13.994966+0000","last_became_peered":"2023-05-10T04:19:13.994966+0000","last_unstale":"2023-05-10T04:19:14.469919+0000","last_undegraded":"2023-05-10T04:19:14.469919+0000","last_fullsized":"2023-05-10T04:19:14.469919+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:05:44.625042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468987+0000","last_change":"2023-05-10T04:19:09.485131+0000","last_active":"2023-05-10T04:19:14.468987+0000","last_peered":"2023-05-10T04:19:14.468987+0000","last_clean":"2023-05-10T04:19:14.468987+0000","last_became_active":"2023-05-10T04:19:09.484754+0000","last_became_peered":"2023-05-10T04:19:09.484754+0000","last_unstale":"2023-05-10T04:19:14.468987+0000","last_undegraded":"2023-05-10T04:19:14.468987+0000","last_fullsized":"2023-05-10T04:19:14.468987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:30:21.704079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469574+0000","last_change":"2023-05-10T04:19:09.970210+0000","last_active":"2023-05-10T04:19:14.469574+0000","last_peered":"2023-05-10T04:19:14.469574+0000","last_clean":"2023-05-10T04:19:14.469574+0000","last_became_active":"2023-05-10T04:19:09.969916+0000","last_became_peered":"2023-05-10T04:19:09.969916+0000","last_unstale":"2023-05-10T04:19:14.469574+0000","last_undegraded":"2023-05-10T04:19:14.469574+0000","last_fullsized":"2023-05-10T04:19:14.469574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:08:49.572839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203900+0000","last_change":"2023-05-10T04:19:14.000125+0000","last_active":"2023-05-10T04:19:15.203900+0000","last_peered":"2023-05-10T04:19:15.203900+0000","last_clean":"2023-05-10T04:19:15.203900+0000","last_became_active":"2023-05-10T04:19:13.998988+0000","last_became_peered":"2023-05-10T04:19:13.998988+0000","last_unstale":"2023-05-10T04:19:15.203900+0000","last_undegraded":"2023-05-10T04:19:15.203900+0000","last_fullsized":"2023-05-10T04:19:15.203900+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:39:35.802978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.204178+0000","last_change":"2023-05-10T04:19:09.488600+0000","last_active":"2023-05-10T04:19:15.204178+0000","last_peered":"2023-05-10T04:19:15.204178+0000","last_clean":"2023-05-10T04:19:15.204178+0000","last_became_active":"2023-05-10T04:19:09.488320+0000","last_became_peered":"2023-05-10T04:19:09.488320+0000","last_unstale":"2023-05-10T04:19:15.204178+0000","last_undegraded":"2023-05-10T04:19:15.204178+0000","last_fullsized":"2023-05-10T04:19:15.204178+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:14:10.406433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202715+0000","last_change":"2023-05-10T04:19:09.986548+0000","last_active":"2023-05-10T04:19:15.202715+0000","last_peered":"2023-05-10T04:19:15.202715+0000","last_clean":"2023-05-10T04:19:15.202715+0000","last_became_active":"2023-05-10T04:19:09.986228+0000","last_became_peered":"2023-05-10T04:19:09.986228+0000","last_unstale":"2023-05-10T04:19:15.202715+0000","last_undegraded":"2023-05-10T04:19:15.202715+0000","last_fullsized":"2023-05-10T04:19:15.202715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:14:03.210099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202625+0000","last_change":"2023-05-10T04:19:13.997285+0000","last_active":"2023-05-10T04:19:15.202625+0000","last_peered":"2023-05-10T04:19:15.202625+0000","last_clean":"2023-05-10T04:19:15.202625+0000","last_became_active":"2023-05-10T04:19:13.996851+0000","last_became_peered":"2023-05-10T04:19:13.996851+0000","last_unstale":"2023-05-10T04:19:15.202625+0000","last_undegraded":"2023-05-10T04:19:15.202625+0000","last_fullsized":"2023-05-10T04:19:15.202625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:07:05.585266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,3,4],"acting":[2,7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.202534+0000","last_change":"2023-05-10T04:19:09.485989+0000","last_active":"2023-05-10T04:19:15.202534+0000","last_peered":"2023-05-10T04:19:15.202534+0000","last_clean":"2023-05-10T04:19:15.202534+0000","last_became_active":"2023-05-10T04:19:09.485739+0000","last_became_peered":"2023-05-10T04:19:09.485739+0000","last_unstale":"2023-05-10T04:19:15.202534+0000","last_undegraded":"2023-05-10T04:19:15.202534+0000","last_fullsized":"2023-05-10T04:19:15.202534+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:34.153625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203031+0000","last_change":"2023-05-10T04:19:09.966736+0000","last_active":"2023-05-10T04:19:15.203031+0000","last_peered":"2023-05-10T04:19:15.203031+0000","last_clean":"2023-05-10T04:19:15.203031+0000","last_became_active":"2023-05-10T04:19:09.966474+0000","last_became_peered":"2023-05-10T04:19:09.966474+0000","last_unstale":"2023-05-10T04:19:15.203031+0000","last_undegraded":"2023-05-10T04:19:15.203031+0000","last_fullsized":"2023-05-10T04:19:15.203031+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:19.596953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203129+0000","last_change":"2023-05-10T04:19:13.993407+0000","last_active":"2023-05-10T04:19:15.203129+0000","last_peered":"2023-05-10T04:19:15.203129+0000","last_clean":"2023-05-10T04:19:15.203129+0000","last_became_active":"2023-05-10T04:19:13.992979+0000","last_became_peered":"2023-05-10T04:19:13.992979+0000","last_unstale":"2023-05-10T04:19:15.203129+0000","last_undegraded":"2023-05-10T04:19:15.203129+0000","last_fullsized":"2023-05-10T04:19:15.203129+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:52:23.097714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,7],"acting":[1,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578128+0000","last_change":"2023-05-10T04:19:09.482747+0000","last_active":"2023-05-10T04:19:14.578128+0000","last_peered":"2023-05-10T04:19:14.578128+0000","last_clean":"2023-05-10T04:19:14.578128+0000","last_became_active":"2023-05-10T04:19:09.482405+0000","last_became_peered":"2023-05-10T04:19:09.482405+0000","last_unstale":"2023-05-10T04:19:14.578128+0000","last_undegraded":"2023-05-10T04:19:14.578128+0000","last_fullsized":"2023-05-10T04:19:14.578128+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:14:10.406433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.628203+0000","last_change":"2023-05-10T04:19:09.976125+0000","last_active":"2023-05-10T04:19:14.628203+0000","last_peered":"2023-05-10T04:19:14.628203+0000","last_clean":"2023-05-10T04:19:14.628203+0000","last_became_active":"2023-05-10T04:19:09.975822+0000","last_became_peered":"2023-05-10T04:19:09.975822+0000","last_unstale":"2023-05-10T04:19:14.628203+0000","last_undegraded":"2023-05-10T04:19:14.628203+0000","last_fullsized":"2023-05-10T04:19:14.628203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:13:16.831438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.469659+0000","last_change":"2023-05-10T04:19:13.995689+0000","last_active":"2023-05-10T04:19:14.469659+0000","last_peered":"2023-05-10T04:19:14.469659+0000","last_clean":"2023-05-10T04:19:14.469659+0000","last_became_active":"2023-05-10T04:19:13.995260+0000","last_became_peered":"2023-05-10T04:19:13.995260+0000","last_unstale":"2023-05-10T04:19:14.469659+0000","last_undegraded":"2023-05-10T04:19:14.469659+0000","last_fullsized":"2023-05-10T04:19:14.469659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:12.955615+0000","last_clean_scrub_stamp":"2023-05-10T04:19:12.955615+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:23:01.528439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1,0],"acting":[4,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578389+0000","last_change":"2023-05-10T04:19:09.483097+0000","last_active":"2023-05-10T04:19:14.578389+0000","last_peered":"2023-05-10T04:19:14.578389+0000","last_clean":"2023-05-10T04:19:14.578389+0000","last_became_active":"2023-05-10T04:19:09.482753+0000","last_became_peered":"2023-05-10T04:19:09.482753+0000","last_unstale":"2023-05-10T04:19:14.578389+0000","last_undegraded":"2023-05-10T04:19:14.578389+0000","last_fullsized":"2023-05-10T04:19:14.578389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:08.452545+0000","last_clean_scrub_stamp":"2023-05-10T04:19:08.452545+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:47:36.189819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.201669+0000","last_change":"2023-05-10T04:19:09.965711+0000","last_active":"2023-05-10T04:19:15.201669+0000","last_peered":"2023-05-10T04:19:15.201669+0000","last_clean":"2023-05-10T04:19:15.201669+0000","last_became_active":"2023-05-10T04:19:09.965427+0000","last_became_peered":"2023-05-10T04:19:09.965427+0000","last_unstale":"2023-05-10T04:19:15.201669+0000","last_undegraded":"2023-05-10T04:19:15.201669+0000","last_fullsized":"2023-05-10T04:19:15.201669+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:39:25.276398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:15.203303+0000","last_change":"2023-05-10T04:19:09.977970+0000","last_active":"2023-05-10T04:19:15.203303+0000","last_peered":"2023-05-10T04:19:15.203303+0000","last_clean":"2023-05-10T04:19:15.203303+0000","last_became_active":"2023-05-10T04:19:09.977559+0000","last_became_peered":"2023-05-10T04:19:09.977559+0000","last_unstale":"2023-05-10T04:19:15.203303+0000","last_undegraded":"2023-05-10T04:19:15.203303+0000","last_fullsized":"2023-05-10T04:19:15.203303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:54:23.670496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468413+0000","last_change":"2023-05-10T04:19:09.985063+0000","last_active":"2023-05-10T04:19:14.468413+0000","last_peered":"2023-05-10T04:19:14.468413+0000","last_clean":"2023-05-10T04:19:14.468413+0000","last_became_active":"2023-05-10T04:19:09.984788+0000","last_became_peered":"2023-05-10T04:19:09.984788+0000","last_unstale":"2023-05-10T04:19:14.468413+0000","last_undegraded":"2023-05-10T04:19:14.468413+0000","last_fullsized":"2023-05-10T04:19:14.468413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:13.062393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.468430+0000","last_change":"2023-05-10T04:19:09.969178+0000","last_active":"2023-05-10T04:19:14.468430+0000","last_peered":"2023-05-10T04:19:14.468430+0000","last_clean":"2023-05-10T04:19:14.468430+0000","last_became_active":"2023-05-10T04:19:09.968882+0000","last_became_peered":"2023-05-10T04:19:09.968882+0000","last_unstale":"2023-05-10T04:19:14.468430+0000","last_undegraded":"2023-05-10T04:19:14.468430+0000","last_fullsized":"2023-05-10T04:19:14.468430+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:55.015215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.577956+0000","last_change":"2023-05-10T04:19:09.978972+0000","last_active":"2023-05-10T04:19:14.577956+0000","last_peered":"2023-05-10T04:19:14.577956+0000","last_clean":"2023-05-10T04:19:14.577956+0000","last_became_active":"2023-05-10T04:19:09.978677+0000","last_became_peered":"2023-05-10T04:19:09.978677+0000","last_unstale":"2023-05-10T04:19:14.577956+0000","last_undegraded":"2023-05-10T04:19:14.577956+0000","last_fullsized":"2023-05-10T04:19:14.577956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:04.032181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":17,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-05-10T04:19:14.578091+0000","last_change":"2023-05-10T04:19:09.982469+0000","last_active":"2023-05-10T04:19:14.578091+0000","last_peered":"2023-05-10T04:19:14.578091+0000","last_clean":"2023-05-10T04:19:14.578091+0000","last_became_active":"2023-05-10T04:19:09.982174+0000","last_became_peered":"2023-05-10T04:19:09.982174+0000","last_unstale":"2023-05-10T04:19:14.578091+0000","last_undegraded":"2023-05-10T04:19:14.578091+0000","last_fullsized":"2023-05-10T04:19:14.578091+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:09.454855+0000","last_clean_scrub_stamp":"2023-05-10T04:19:09.454855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:55:21.820447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":16,"seq":68719476747,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]}]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8176,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363664,"statfs":{"total":96636764160,"available":96628391936,"internally_reserved":0,"allocated":303104,"data_stored":124118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9280,"kb_used_data":888,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362560,"statfs":{"total":96636764160,"available":96627261440,"internally_reserved":0,"allocated":909312,"data_stored":715160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72499999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":124264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8188,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363652,"statfs":{"total":96636764160,"available":96628379648,"internally_reserved":0,"allocated":315392,"data_stored":127912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8380000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6230000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.617}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.532}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.5069999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.746}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8260,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363580,"statfs":{"total":96636764160,"available":96628305920,"internally_reserved":0,"allocated":323584,"data_stored":128016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69599999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9272,"kb_used_data":880,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362568,"statfs":{"total":96636764160,"available":96627269632,"internally_reserved":0,"allocated":901120,"data_stored":715068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.43099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8180,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":7872,"kb_avail":94363660,"statfs":{"total":96636764160,"available":96628387840,"internally_reserved":0,"allocated":307200,"data_stored":124208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8060928},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T04:19:36.976 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-10T04:19:36.977 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-10T04:19:36.977 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-10T04:19:36.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-10T04:19:37.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.187+0000 7f951d1ff700 1 Processor -- start 2023-05-10T04:19:37.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.187+0000 7f951d1ff700 1 -- start start 2023-05-10T04:19:37.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f951d1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95180b87a0 0x7f95180cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f951d1ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95181601e0 0x7f9518160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f951d1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95180cdc60 con 0x7f9518160b70 2023-05-10T04:19:37.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f951d1ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95180d02d0 con 0x7f95181601e0 2023-05-10T04:19:37.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f951d1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95180d0cb0 con 0x7f95180b87a0 2023-05-10T04:19:37.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f950ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95181601e0 0x7f9518160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f950ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95181601e0 0x7f9518160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48356/0 (socket says 172.21.15.132:48356) 2023-05-10T04:19:37.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f950ffff700 1 -- 172.21.15.132:0/1730893138 learned_addr learned my addr 172.21.15.132:0/1730893138 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:37.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.188+0000 7f951759e700 1 --1- 172.21.15.132:0/1730893138 >> v1:172.21.15.132:6789/0 conn(0x7f9518160b70 0x7f95180d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50810/0 (socket says 172.21.15.132:50810) 2023-05-10T04:19:37.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f9516d9d700 1 --2- 172.21.15.132:0/1730893138 >> v2:172.21.15.154:3300/0 conn(0x7f95180b87a0 0x7f95180cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f950ffff700 1 -- 172.21.15.132:0/1730893138 >> v2:172.21.15.154:3300/0 conn(0x7f95180b87a0 msgr2=0x7f95180cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:37.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f950ffff700 1 --2- 172.21.15.132:0/1730893138 >> v2:172.21.15.154:3300/0 conn(0x7f95180b87a0 0x7f95180cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f950ffff700 1 -- 172.21.15.132:0/1730893138 >> v1:172.21.15.132:6789/0 conn(0x7f9518160b70 legacy=0x7f95180d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f950ffff700 1 -- 172.21.15.132:0/1730893138 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180cd6a0 con 0x7f95181601e0 2023-05-10T04:19:37.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f951659c700 1 -- 172.21.15.132:0/1730893138 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1210601079 0 0) 0x7f95180cdc60 con 0x7f9518160b70 2023-05-10T04:19:37.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f950ffff700 1 --2- 172.21.15.132:0/1730893138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f9518160630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95180b4ac0 tx=0x7f9500009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d437930bc85dd4e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:37.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f951659c700 1 -- 172.21.15.132:0/1730893138 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950000b860 con 0x7f95181601e0 2023-05-10T04:19:37.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f951659c700 1 -- 172.21.15.132:0/1730893138 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950000b9c0 con 0x7f95181601e0 2023-05-10T04:19:37.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.189+0000 7f951659c700 1 -- 172.21.15.132:0/1730893138 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950000bd50 con 0x7f95181601e0 2023-05-10T04:19:37.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.190+0000 7f951d1ff700 1 -- 172.21.15.132:0/1730893138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 msgr2=0x7f9518160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.190+0000 7f951d1ff700 1 --2- 172.21.15.132:0/1730893138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f9518160630 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f95180b4ac0 tx=0x7f9500009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:37.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.190+0000 7f951d1ff700 1 -- 172.21.15.132:0/1730893138 shutdown_connections 2023-05-10T04:19:37.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.190+0000 7f951d1ff700 1 --2- 172.21.15.132:0/1730893138 >> v2:172.21.15.154:3300/0 conn(0x7f95180b87a0 0x7f95180cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.190+0000 7f951d1ff700 1 --2- 172.21.15.132:0/1730893138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f9518160630 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.190+0000 7f951d1ff700 1 -- 172.21.15.132:0/1730893138 >> 172.21.15.132:0/1730893138 conn(0x7f9518071b10 msgr2=0x7f9518071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:37.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.190+0000 7f951d1ff700 1 -- 172.21.15.132:0/1730893138 shutdown_connections 2023-05-10T04:19:37.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.190+0000 7f951d1ff700 1 -- 172.21.15.132:0/1730893138 wait complete. 2023-05-10T04:19:37.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.192+0000 7f951d1ff700 1 Processor -- start 2023-05-10T04:19:37.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.192+0000 7f951d1ff700 1 -- start start 2023-05-10T04:19:37.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f951d1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95180b87a0 0x7f951815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f951d1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f95180b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f951d1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9518160b70 0x7f951815f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f951d1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951815fa80 con 0x7f95181601e0 2023-05-10T04:19:37.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f951d1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951815c1b0 con 0x7f95180b87a0 2023-05-10T04:19:37.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f951d1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951815cd30 con 0x7f9518160b70 2023-05-10T04:19:37.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f950ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f95180b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f950ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f95180b1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48368/0 (socket says 172.21.15.132:48368) 2023-05-10T04:19:37.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f9516d9d700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95180b87a0 0x7f951815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f950ffff700 1 -- 172.21.15.132:0/3581162834 learned_addr learned my addr 172.21.15.132:0/3581162834 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f951759e700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9518160b70 0x7f951815f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f950ffff700 1 -- 172.21.15.132:0/3581162834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9518160b70 msgr2=0x7f951815f540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f950ffff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9518160b70 0x7f951815f540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f950ffff700 1 -- 172.21.15.132:0/3581162834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95180b87a0 msgr2=0x7f951815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f950ffff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95180b87a0 0x7f951815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.193+0000 7f950ffff700 1 -- 172.21.15.132:0/3581162834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500009550 con 0x7f95181601e0 2023-05-10T04:19:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.194+0000 7f950ffff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f95180b1580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9500009c40 tx=0x7f9500004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.194+0000 7f950f7fe700 1 -- 172.21.15.132:0/3581162834 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9500004300 con 0x7f95181601e0 2023-05-10T04:19:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.194+0000 7f950f7fe700 1 -- 172.21.15.132:0/3581162834 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950001f070 con 0x7f95181601e0 2023-05-10T04:19:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.194+0000 7f950f7fe700 1 -- 172.21.15.132:0/3581162834 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95000036a0 con 0x7f95181601e0 2023-05-10T04:19:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.194+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9518160f90 con 0x7f95181601e0 2023-05-10T04:19:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.194+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95180cd980 con 0x7f95181601e0 2023-05-10T04:19:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.195+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95180d2110 con 0x7f95181601e0 2023-05-10T04:19:37.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.196+0000 7f950f7fe700 1 -- 172.21.15.132:0/3581162834 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9500021030 con 0x7f95181601e0 2023-05-10T04:19:37.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.196+0000 7f950f7fe700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94f806ace0 0x7f94f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.197+0000 7f950f7fe700 1 -- 172.21.15.132:0/3581162834 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f950008aac0 con 0x7f95181601e0 2023-05-10T04:19:37.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.197+0000 7f9516d9d700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94f806ace0 0x7f94f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.197+0000 7f9516d9d700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94f806ace0 0x7f94f806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9508006b20 tx=0x7f9508008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.201+0000 7f950f7fe700 1 -- 172.21.15.132:0/3581162834 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9500055a30 con 0x7f95181601e0 2023-05-10T04:19:37.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.440+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f951815cea0 con 0x7f95181601e0 2023-05-10T04:19:37.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.440+0000 7f950f7fe700 1 -- 172.21.15.132:0/3581162834 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f9500059050 con 0x7f95181601e0 2023-05-10T04:19:37.444 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:37.444 INFO:teuthology.orchestra.run.smithi132.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-10T04:19:37.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94f806ace0 msgr2=0x7f94f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94f806ace0 0x7f94f806d190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9508006b20 tx=0x7f9508008040 comp rx=0 tx=0).stop 2023-05-10T04:19:37.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 msgr2=0x7f95180b1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f95180b1580 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9500009c40 tx=0x7f9500004750 comp rx=0 tx=0).stop 2023-05-10T04:19:37.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 shutdown_connections 2023-05-10T04:19:37.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f94f806ace0 0x7f94f806d190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9518160b70 0x7f951815f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95180b87a0 0x7f951815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 --2- 172.21.15.132:0/3581162834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95181601e0 0x7f95180b1580 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 >> 172.21.15.132:0/3581162834 conn(0x7f9518071b10 msgr2=0x7f9518071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:37.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 shutdown_connections 2023-05-10T04:19:37.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.443+0000 7f951d1ff700 1 -- 172.21.15.132:0/3581162834 wait complete. 2023-05-10T04:19:37.463 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-10T04:19:37.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:37.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.645+0000 7fa24f7ff700 1 Processor -- start 2023-05-10T04:19:37.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.645+0000 7fa24f7ff700 1 -- start start 2023-05-10T04:19:37.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.646+0000 7fa24f7ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2480ccf00 0x7fa248071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24f7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24815d690 0x7fa2480cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24f7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2480cd810 con 0x7fa24806eb70 2023-05-10T04:19:37.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24f7ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa24806a470 con 0x7fa2480ccf00 2023-05-10T04:19:37.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24f7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa248071a30 con 0x7fa24815d690 2023-05-10T04:19:37.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24d59b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2480ccf00 0x7fa248071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24d59b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2480ccf00 0x7fa248071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48370/0 (socket says 172.21.15.132:48370) 2023-05-10T04:19:37.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24d59b700 1 -- 172.21.15.132:0/1962065237 learned_addr learned my addr 172.21.15.132:0/1962065237 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:37.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24cd9a700 1 --2- 172.21.15.132:0/1962065237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24815d690 0x7fa2480cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24d59b700 1 -- 172.21.15.132:0/1962065237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24815d690 msgr2=0x7fa2480cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:37.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24d59b700 1 --2- 172.21.15.132:0/1962065237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24815d690 0x7fa2480cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24d59b700 1 -- 172.21.15.132:0/1962065237 >> v1:172.21.15.132:6789/0 conn(0x7fa24806eb70 legacy=0x7fa24806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.647+0000 7fa24d59b700 1 -- 172.21.15.132:0/1962065237 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248071d10 con 0x7fa2480ccf00 2023-05-10T04:19:37.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24d59b700 1 --2- 172.21.15.132:0/1962065237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2480ccf00 0x7fa248071450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2440098f0 tx=0x7fa244009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309a1e25e9fade23 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:37.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa23ffff700 1 -- 172.21.15.132:0/1962065237 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244011830 con 0x7fa2480ccf00 2023-05-10T04:19:37.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa23ffff700 1 -- 172.21.15.132:0/1962065237 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa244011990 con 0x7fa2480ccf00 2023-05-10T04:19:37.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa23ffff700 1 -- 172.21.15.132:0/1962065237 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa244011d20 con 0x7fa2480ccf00 2023-05-10T04:19:37.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24f7ff700 1 -- 172.21.15.132:0/1962065237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2480ccf00 msgr2=0x7fa248071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/1962065237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2480ccf00 0x7fa248071450 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2440098f0 tx=0x7fa244009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:37.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24f7ff700 1 -- 172.21.15.132:0/1962065237 shutdown_connections 2023-05-10T04:19:37.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/1962065237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2480ccf00 0x7fa248071450 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/1962065237 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa24815d690 0x7fa2480cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24f7ff700 1 -- 172.21.15.132:0/1962065237 >> 172.21.15.132:0/1962065237 conn(0x7fa2480cf330 msgr2=0x7fa2480cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:37.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24f7ff700 1 -- 172.21.15.132:0/1962065237 shutdown_connections 2023-05-10T04:19:37.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.648+0000 7fa24f7ff700 1 -- 172.21.15.132:0/1962065237 wait complete. 2023-05-10T04:19:37.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.650+0000 7fa24f7ff700 1 Processor -- start 2023-05-10T04:19:37.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.650+0000 7fa24f7ff700 1 -- start start 2023-05-10T04:19:37.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24f7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24806eb70 0x7fa248150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24f7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2480ccf00 0x7fa2480b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24f7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa24815d690 0x7fa2480b36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24f7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480aed90 con 0x7fa24806eb70 2023-05-10T04:19:37.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24f7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480b3c00 con 0x7fa24815d690 2023-05-10T04:19:37.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24f7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2480aef70 con 0x7fa2480ccf00 2023-05-10T04:19:37.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24d59b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24806eb70 0x7fa248150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24d59b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24806eb70 0x7fa248150b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48376/0 (socket says 172.21.15.132:48376) 2023-05-10T04:19:37.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.651+0000 7fa24d59b700 1 -- 172.21.15.132:0/653357432 learned_addr learned my addr 172.21.15.132:0/653357432 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:37.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa24d59b700 1 -- 172.21.15.132:0/653357432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2480ccf00 msgr2=0x7fa2480b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa24d59b700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2480ccf00 0x7fa2480b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa24d59b700 1 -- 172.21.15.132:0/653357432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa24815d690 msgr2=0x7fa2480b36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa24d59b700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa24815d690 0x7fa2480b36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa24d59b700 1 -- 172.21.15.132:0/653357432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009550 con 0x7fa24806eb70 2023-05-10T04:19:37.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa24d59b700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24806eb70 0x7fa248150b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa244000c00 tx=0x7fa244004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:37.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa23dffb700 1 -- 172.21.15.132:0/653357432 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440045b0 con 0x7fa24806eb70 2023-05-10T04:19:37.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa23dffb700 1 -- 172.21.15.132:0/653357432 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24401f070 con 0x7fa24806eb70 2023-05-10T04:19:37.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa23dffb700 1 -- 172.21.15.132:0/653357432 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2440038a0 con 0x7fa24806eb70 2023-05-10T04:19:37.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2480722d0 con 0x7fa24806eb70 2023-05-10T04:19:37.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.652+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248071ff0 con 0x7fa24806eb70 2023-05-10T04:19:37.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.653+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa24815db00 con 0x7fa24806eb70 2023-05-10T04:19:37.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.654+0000 7fa23dffb700 1 -- 172.21.15.132:0/653357432 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa244021030 con 0x7fa24806eb70 2023-05-10T04:19:37.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.655+0000 7fa23dffb700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22c06ace0 0x7fa22c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:37.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.655+0000 7fa23dffb700 1 -- 172.21.15.132:0/653357432 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa24408ad60 con 0x7fa24806eb70 2023-05-10T04:19:37.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.655+0000 7fa24cd9a700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22c06ace0 0x7fa22c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:37.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.656+0000 7fa24cd9a700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22c06ace0 0x7fa22c06d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa238009470 tx=0x7fa2380093c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:37.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.660+0000 7fa23dffb700 1 -- 172.21.15.132:0/653357432 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa244055cd0 con 0x7fa24806eb70 2023-05-10T04:19:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.858+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa248074430 con 0x7fa24806eb70 2023-05-10T04:19:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.859+0000 7fa23dffb700 1 -- 172.21.15.132:0/653357432 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fa2440592f0 con 0x7fa24806eb70 2023-05-10T04:19:37.861 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:37.862 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:37.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22c06ace0 msgr2=0x7fa22c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22c06ace0 0x7fa22c06d190 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa238009470 tx=0x7fa2380093c0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24806eb70 msgr2=0x7fa248150b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:37.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24806eb70 0x7fa248150b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa244000c00 tx=0x7fa244004750 comp rx=0 tx=0).stop 2023-05-10T04:19:37.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 shutdown_connections 2023-05-10T04:19:37.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa22c06ace0 0x7fa22c06d190 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa24815d690 0x7fa2480b36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa24806eb70 0x7fa248150b90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 --2- 172.21.15.132:0/653357432 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa2480ccf00 0x7fa2480b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 >> 172.21.15.132:0/653357432 conn(0x7fa2480cf330 msgr2=0x7fa24815cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 shutdown_connections 2023-05-10T04:19:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:37.861+0000 7fa24f7ff700 1 -- 172.21.15.132:0/653357432 wait complete. 2023-05-10T04:19:37.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:19:37.882 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:19:38.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.072+0000 7f453bdff700 1 Processor -- start 2023-05-10T04:19:38.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.072+0000 7f453bdff700 1 -- start start 2023-05-10T04:19:38.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f453bdff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45340b87a0 0x7f45340cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f453bdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f45341601e0 0x7f4534160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f453bdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45340cdc60 con 0x7f4534160b70 2023-05-10T04:19:38.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f453bdff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340d02d0 con 0x7f45340b87a0 2023-05-10T04:19:38.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f453bdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45340d0cb0 con 0x7f45341601e0 2023-05-10T04:19:38.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f4539b9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45340b87a0 0x7f45340cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f4539b9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45340b87a0 0x7f45340cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48390/0 (socket says 172.21.15.132:48390) 2023-05-10T04:19:38.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f4539b9b700 1 -- 172.21.15.132:0/3536464946 learned_addr learned my addr 172.21.15.132:0/3536464946 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:38.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.073+0000 7f453939a700 1 --2- 172.21.15.132:0/3536464946 >> v2:172.21.15.154:3300/0 conn(0x7f45341601e0 0x7f4534160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.074+0000 7f4539b9b700 1 -- 172.21.15.132:0/3536464946 >> v2:172.21.15.154:3300/0 conn(0x7f45341601e0 msgr2=0x7f4534160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:38.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.074+0000 7f4539b9b700 1 --2- 172.21.15.132:0/3536464946 >> v2:172.21.15.154:3300/0 conn(0x7f45341601e0 0x7f4534160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.074+0000 7f4539b9b700 1 -- 172.21.15.132:0/3536464946 >> v1:172.21.15.154:6789/0 conn(0x7f4534160b70 legacy=0x7f45340d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:38.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.074+0000 7f4539b9b700 1 -- 172.21.15.132:0/3536464946 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45340cd6a0 con 0x7f45340b87a0 2023-05-10T04:19:38.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.074+0000 7f4539b9b700 1 --2- 172.21.15.132:0/3536464946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45340b87a0 0x7f45340cfbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f45340b8f60 tx=0x7f4530009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92eb242ccbb500b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.074+0000 7f4538b99700 1 -- 172.21.15.132:0/3536464946 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453000b860 con 0x7f45340b87a0 2023-05-10T04:19:38.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.074+0000 7f4538b99700 1 -- 172.21.15.132:0/3536464946 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453000b9c0 con 0x7f45340b87a0 2023-05-10T04:19:38.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.074+0000 7f4538b99700 1 -- 172.21.15.132:0/3536464946 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453000bd50 con 0x7f45340b87a0 2023-05-10T04:19:38.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.075+0000 7f453bdff700 1 -- 172.21.15.132:0/3536464946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45340b87a0 msgr2=0x7f45340cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.075+0000 7f453bdff700 1 --2- 172.21.15.132:0/3536464946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45340b87a0 0x7f45340cfbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f45340b8f60 tx=0x7f4530009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:38.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.075+0000 7f453bdff700 1 -- 172.21.15.132:0/3536464946 shutdown_connections 2023-05-10T04:19:38.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.075+0000 7f453bdff700 1 --2- 172.21.15.132:0/3536464946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45340b87a0 0x7f45340cfbf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.075+0000 7f453bdff700 1 --2- 172.21.15.132:0/3536464946 >> v2:172.21.15.154:3300/0 conn(0x7f45341601e0 0x7f4534160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.075+0000 7f453bdff700 1 -- 172.21.15.132:0/3536464946 >> 172.21.15.132:0/3536464946 conn(0x7f4534071b10 msgr2=0x7f4534071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:38.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.075+0000 7f453bdff700 1 -- 172.21.15.132:0/3536464946 shutdown_connections 2023-05-10T04:19:38.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.075+0000 7f453bdff700 1 -- 172.21.15.132:0/3536464946 wait complete. 2023-05-10T04:19:38.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.077+0000 7f453bdff700 1 Processor -- start 2023-05-10T04:19:38.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.077+0000 7f453bdff700 1 -- start start 2023-05-10T04:19:38.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453bdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45340b87a0 0x7f45340cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453bdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45341601e0 0x7f45341502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453bdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4534160b70 0x7f45340c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453bdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340c75f0 con 0x7f4534160b70 2023-05-10T04:19:38.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453bdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45340c8430 con 0x7f45341601e0 2023-05-10T04:19:38.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453bdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45340c7820 con 0x7f45340b87a0 2023-05-10T04:19:38.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f4539b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45340b87a0 0x7f45340cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453a39c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4534160b70 0x7f45340c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453939a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45341601e0 0x7f45341502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f4539b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45340b87a0 0x7f45340cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:58908/0 (socket says 172.21.15.132:58908) 2023-05-10T04:19:38.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453939a700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45341601e0 0x7f45341502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:45250/0 (socket says 172.21.15.132:45250) 2023-05-10T04:19:38.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f4539b9b700 1 -- 172.21.15.132:0/854091969 learned_addr learned my addr 172.21.15.132:0/854091969 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:38.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453a39c700 1 -- 172.21.15.132:0/854091969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45340b87a0 msgr2=0x7f45340cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.078+0000 7f453a39c700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45340b87a0 0x7f45340cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f453a39c700 1 -- 172.21.15.132:0/854091969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45341601e0 msgr2=0x7f45341502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f453a39c700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45341601e0 0x7f45341502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f453a39c700 1 -- 172.21.15.132:0/854091969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4530009550 con 0x7f4534160b70 2023-05-10T04:19:38.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f453a39c700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4534160b70 0x7f45340c88c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f452c00cae0 tx=0x7f452c00cdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f452a7fc700 1 -- 172.21.15.132:0/854091969 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c003c00 con 0x7f4534160b70 2023-05-10T04:19:38.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f452a7fc700 1 -- 172.21.15.132:0/854091969 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c003d60 con 0x7f4534160b70 2023-05-10T04:19:38.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4534160f90 con 0x7f4534160b70 2023-05-10T04:19:38.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f452a7fc700 1 -- 172.21.15.132:0/854091969 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00aa20 con 0x7f4534160b70 2023-05-10T04:19:38.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.079+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45340cd980 con 0x7f4534160b70 2023-05-10T04:19:38.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.080+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45340d2110 con 0x7f4534160b70 2023-05-10T04:19:38.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.081+0000 7f452a7fc700 1 -- 172.21.15.132:0/854091969 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f452c00ab80 con 0x7f4534160b70 2023-05-10T04:19:38.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.082+0000 7f452a7fc700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f451806ace0 0x7f451806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.083+0000 7f452a7fc700 1 -- 172.21.15.132:0/854091969 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f452c089650 con 0x7f4534160b70 2023-05-10T04:19:38.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.083+0000 7f4539b9b700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f451806ace0 0x7f451806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.083+0000 7f4539b9b700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f451806ace0 0x7f451806d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4530009130 tx=0x7f4530008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.087+0000 7f452a7fc700 1 -- 172.21.15.132:0/854091969 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f452c054370 con 0x7f4534160b70 2023-05-10T04:19:38.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.281+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4534074430 con 0x7f4534160b70 2023-05-10T04:19:38.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.281+0000 7f452a7fc700 1 -- 172.21.15.132:0/854091969 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f452c057990 con 0x7f4534160b70 2023-05-10T04:19:38.284 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:19:38.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f451806ace0 msgr2=0x7f451806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f451806ace0 0x7f451806d190 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4530009130 tx=0x7f4530008030 comp rx=0 tx=0).stop 2023-05-10T04:19:38.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4534160b70 msgr2=0x7f45340c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4534160b70 0x7f45340c88c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f452c00cae0 tx=0x7f452c00cdf0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 shutdown_connections 2023-05-10T04:19:38.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f451806ace0 0x7f451806d190 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4534160b70 0x7f45340c88c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f45340b87a0 0x7f45340cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 --2- 172.21.15.132:0/854091969 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f45341601e0 0x7f45341502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 >> 172.21.15.132:0/854091969 conn(0x7f4534071b10 msgr2=0x7f45340b7910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:38.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 shutdown_connections 2023-05-10T04:19:38.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.284+0000 7f453bdff700 1 -- 172.21.15.132:0/854091969 wait complete. 2023-05-10T04:19:38.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:19:38.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.487+0000 7fa0645ff700 1 Processor -- start 2023-05-10T04:19:38.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.487+0000 7fa0645ff700 1 -- start start 2023-05-10T04:19:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.488+0000 7fa0645ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c0b87a0 0x7fa05c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.488+0000 7fa0645ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa05c160d40 0x7fa05c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.488+0000 7fa0645ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c0cdc60 con 0x7fa05c1601e0 2023-05-10T04:19:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.488+0000 7fa0645ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05c0d02d0 con 0x7fa05c160d40 2023-05-10T04:19:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.488+0000 7fa0645ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0d0cb0 con 0x7fa05c0b87a0 2023-05-10T04:19:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa062b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa05c160d40 0x7fa05c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa06239b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c0b87a0 0x7fa05c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa062b9c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa05c160d40 0x7fa05c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:45264/0 (socket says 172.21.15.132:45264) 2023-05-10T04:19:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa061b9a700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fa05c1601e0 0x7fa05c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:44234/0 (socket says 172.21.15.132:44234) 2023-05-10T04:19:38.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa062b9c700 1 -- 172.21.15.132:0/699758400 learned_addr learned my addr 172.21.15.132:0/699758400 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:38.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa06239b700 1 -- 172.21.15.132:0/699758400 >> v2:172.21.15.154:3300/0 conn(0x7fa05c160d40 msgr2=0x7fa05c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:38.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa06239b700 1 --2- 172.21.15.132:0/699758400 >> v2:172.21.15.154:3300/0 conn(0x7fa05c160d40 0x7fa05c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa06239b700 1 -- 172.21.15.132:0/699758400 >> v1:172.21.15.154:6789/0 conn(0x7fa05c1601e0 legacy=0x7fa05c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa06239b700 1 -- 172.21.15.132:0/699758400 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c0cd6a0 con 0x7fa05c0b87a0 2023-05-10T04:19:38.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.489+0000 7fa061399700 1 -- 172.21.15.132:0/699758400 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2654330392 0 0) 0x7fa05c0cdc60 con 0x7fa05c1601e0 2023-05-10T04:19:38.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.490+0000 7fa06239b700 1 --2- 172.21.15.132:0/699758400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c0b87a0 0x7fa05c0cfbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa058009840 tx=0x7fa058009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db016f868a7f8183 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.490+0000 7fa061399700 1 -- 172.21.15.132:0/699758400 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058011830 con 0x7fa05c0b87a0 2023-05-10T04:19:38.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.490+0000 7fa061399700 1 -- 172.21.15.132:0/699758400 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa058011990 con 0x7fa05c0b87a0 2023-05-10T04:19:38.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.490+0000 7fa061399700 1 -- 172.21.15.132:0/699758400 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058011d20 con 0x7fa05c0b87a0 2023-05-10T04:19:38.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.490+0000 7fa0645ff700 1 -- 172.21.15.132:0/699758400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c0b87a0 msgr2=0x7fa05c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.490+0000 7fa0645ff700 1 --2- 172.21.15.132:0/699758400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c0b87a0 0x7fa05c0cfbf0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa058009840 tx=0x7fa058009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:38.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.490+0000 7fa0645ff700 1 -- 172.21.15.132:0/699758400 shutdown_connections 2023-05-10T04:19:38.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.490+0000 7fa0645ff700 1 --2- 172.21.15.132:0/699758400 >> v2:172.21.15.154:3300/0 conn(0x7fa05c160d40 0x7fa05c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.491+0000 7fa0645ff700 1 --2- 172.21.15.132:0/699758400 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c0b87a0 0x7fa05c0cfbf0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.491+0000 7fa0645ff700 1 -- 172.21.15.132:0/699758400 >> 172.21.15.132:0/699758400 conn(0x7fa05c071b10 msgr2=0x7fa05c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:38.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.491+0000 7fa0645ff700 1 -- 172.21.15.132:0/699758400 shutdown_connections 2023-05-10T04:19:38.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.491+0000 7fa0645ff700 1 -- 172.21.15.132:0/699758400 wait complete. 2023-05-10T04:19:38.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.492+0000 7fa0645ff700 1 Processor -- start 2023-05-10T04:19:38.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.492+0000 7fa0645ff700 1 -- start start 2023-05-10T04:19:38.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa0645ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa05c0b87a0 0x7fa05c154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa0645ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c1601e0 0x7fa05c0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa0645ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa05c160d40 0x7fa05c0b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa0645ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0cad30 con 0x7fa05c0b87a0 2023-05-10T04:19:38.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa0645ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0ca120 con 0x7fa05c160d40 2023-05-10T04:19:38.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa0645ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0ca400 con 0x7fa05c1601e0 2023-05-10T04:19:38.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa06239b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa05c0b87a0 0x7fa05c154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa06239b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa05c0b87a0 0x7fa05c154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48410/0 (socket says 172.21.15.132:48410) 2023-05-10T04:19:38.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.493+0000 7fa06239b700 1 -- 172.21.15.132:0/3200251084 learned_addr learned my addr 172.21.15.132:0/3200251084 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:38.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa06239b700 1 -- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c1601e0 msgr2=0x7fa05c0b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa061b9a700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c1601e0 0x7fa05c0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa06239b700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c1601e0 0x7fa05c0b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa062b9c700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa05c160d40 0x7fa05c0b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa06239b700 1 -- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa05c160d40 msgr2=0x7fa05c0b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa06239b700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa05c160d40 0x7fa05c0b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa06239b700 1 -- 172.21.15.132:0/3200251084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0580094a0 con 0x7fa05c0b87a0 2023-05-10T04:19:38.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa061b9a700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c1601e0 0x7fa05c0b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:38.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa062b9c700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa05c160d40 0x7fa05c0b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:38.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa06239b700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa05c0b87a0 0x7fa05c154810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa058009fd0 tx=0x7fa058004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa052ffd700 1 -- 172.21.15.132:0/3200251084 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0580036a0 con 0x7fa05c0b87a0 2023-05-10T04:19:38.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa052ffd700 1 -- 172.21.15.132:0/3200251084 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05801f070 con 0x7fa05c0b87a0 2023-05-10T04:19:38.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c0d1640 con 0x7fa05c0b87a0 2023-05-10T04:19:38.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.494+0000 7fa052ffd700 1 -- 172.21.15.132:0/3200251084 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa058003a60 con 0x7fa05c0b87a0 2023-05-10T04:19:38.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.495+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c0cd980 con 0x7fa05c0b87a0 2023-05-10T04:19:38.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.496+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c0d17d0 con 0x7fa05c0b87a0 2023-05-10T04:19:38.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.496+0000 7fa052ffd700 1 -- 172.21.15.132:0/3200251084 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa058003bc0 con 0x7fa05c0b87a0 2023-05-10T04:19:38.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.497+0000 7fa052ffd700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.497+0000 7fa052ffd700 1 -- 172.21.15.132:0/3200251084 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa058021070 con 0x7fa05c0b87a0 2023-05-10T04:19:38.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.497+0000 7fa061b9a700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.498+0000 7fa061b9a700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa04006ace0 0x7fa04006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0d37f0 tx=0x7fa04c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.501+0000 7fa052ffd700 1 -- 172.21.15.132:0/3200251084 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa058055e80 con 0x7fa05c0b87a0 2023-05-10T04:19:38.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.697+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa05c074430 con 0x7fa05c0b87a0 2023-05-10T04:19:38.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.698+0000 7fa052ffd700 1 -- 172.21.15.132:0/3200251084 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa0580594a0 con 0x7fa05c0b87a0 2023-05-10T04:19:38.700 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:19:38.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa04006ace0 msgr2=0x7fa04006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa04006ace0 0x7fa04006d190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0d37f0 tx=0x7fa04c009040 comp rx=0 tx=0).stop 2023-05-10T04:19:38.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa05c0b87a0 msgr2=0x7fa05c154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa05c0b87a0 0x7fa05c154810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa058009fd0 tx=0x7fa058004750 comp rx=0 tx=0).stop 2023-05-10T04:19:38.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 shutdown_connections 2023-05-10T04:19:38.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa04006ace0 0x7fa04006d190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa05c160d40 0x7fa05c0b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa05c0b87a0 0x7fa05c154810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 --2- 172.21.15.132:0/3200251084 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa05c1601e0 0x7fa05c0b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 >> 172.21.15.132:0/3200251084 conn(0x7fa05c071b10 msgr2=0x7fa05c15acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:38.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 shutdown_connections 2023-05-10T04:19:38.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.700+0000 7fa0645ff700 1 -- 172.21.15.132:0/3200251084 wait complete. 2023-05-10T04:19:38.720 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:19:38.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.902+0000 7ffa7efff700 1 Processor -- start 2023-05-10T04:19:38.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.902+0000 7ffa7efff700 1 -- start start 2023-05-10T04:19:38.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa7efff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 0x7ffa780cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa7efff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa780b26f0 con 0x7ffa7806b4f0 2023-05-10T04:19:38.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa7efff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa780cf890 con 0x7ffa780cbf90 2023-05-10T04:19:38.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa7efff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780cfb60 con 0x7ffa780d0130 2023-05-10T04:19:38.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa7cd9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffa7806b4f0 0x7ffa7806b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50840/0 (socket says 172.21.15.132:50840) 2023-05-10T04:19:38.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa7cd9b700 1 -- 172.21.15.132:0/2810797614 learned_addr learned my addr 172.21.15.132:0/2810797614 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:38.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa77fff700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 0x7ffa780cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 450912064 0 0) 0x7ffa780b26f0 con 0x7ffa7806b4f0 2023-05-10T04:19:38.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.904+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa680035b0 con 0x7ffa7806b4f0 2023-05-10T04:19:38.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966127978 0 0) 0x7ffa780cf890 con 0x7ffa780cbf90 2023-05-10T04:19:38.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa780b26f0 con 0x7ffa780cbf90 2023-05-10T04:19:38.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1659421280 0 0) 0x7ffa680035b0 con 0x7ffa7806b4f0 2023-05-10T04:19:38.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 msgr2=0x7ffa780cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:38.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 0x7ffa780cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 >> v1:172.21.15.154:6789/0 conn(0x7ffa780cbf90 legacy=0x7ffa780cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780cfe40 con 0x7ffa7806b4f0 2023-05-10T04:19:38.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7ffa6c001670 con 0x7ffa7806b4f0 2023-05-10T04:19:38.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa77fff700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 0x7ffa780cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:38.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 >> v1:172.21.15.132:6789/0 conn(0x7ffa7806b4f0 legacy=0x7ffa7806b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 0x7ffa68003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa68004150 0x7ffa68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa68005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780cfb60 con 0x7ffa68004d90 2023-05-10T04:19:38.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800bba0 con 0x7ffa68004150 2023-05-10T04:19:38.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa6800bd60 con 0x7ffa780d0130 2023-05-10T04:19:38.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa7d59c700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa68005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa77fff700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa68004150 0x7ffa68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.905+0000 7ffa7cd9b700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 0x7ffa68003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa7d59c700 1 -- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 msgr2=0x7ffa68003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:38.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa7d59c700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa780d0130 0x7ffa68003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa7d59c700 1 -- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa68004150 msgr2=0x7ffa68004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:38.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa7d59c700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa68004150 0x7ffa68004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa7d59c700 1 -- 172.21.15.132:0/2810797614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640094a0 con 0x7ffa68004d90 2023-05-10T04:19:38.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa7d59c700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa68005200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000c2f0 tx=0x7ffa68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0018dd50c35482 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70001f30 con 0x7ffa68004d90 2023-05-10T04:19:38.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa7000ce90 con 0x7ffa68004d90 2023-05-10T04:19:38.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.906+0000 7ffa777fe700 1 -- 172.21.15.132:0/2810797614 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa70003c40 con 0x7ffa68004d90 2023-05-10T04:19:38.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.907+0000 7ffa7efff700 1 -- 172.21.15.132:0/2810797614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 msgr2=0x7ffa68005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.907+0000 7ffa7efff700 1 --2- 172.21.15.132:0/2810797614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa68005200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa7000c2f0 tx=0x7ffa68005880 comp rx=0 tx=0).stop 2023-05-10T04:19:38.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.907+0000 7ffa7d59c700 1 -- 172.21.15.132:0/2810797614 reap_dead start 2023-05-10T04:19:38.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.907+0000 7ffa7efff700 1 -- 172.21.15.132:0/2810797614 shutdown_connections 2023-05-10T04:19:38.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.907+0000 7ffa7efff700 1 -- 172.21.15.132:0/2810797614 >> 172.21.15.132:0/2810797614 conn(0x7ffa7809a090 msgr2=0x7ffa780d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:38.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.907+0000 7ffa7efff700 1 -- 172.21.15.132:0/2810797614 shutdown_connections 2023-05-10T04:19:38.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.907+0000 7ffa7efff700 1 -- 172.21.15.132:0/2810797614 wait complete. 2023-05-10T04:19:38.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.908+0000 7ffa7efff700 1 Processor -- start 2023-05-10T04:19:38.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.909+0000 7ffa7efff700 1 -- start start 2023-05-10T04:19:38.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.909+0000 7ffa7efff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa781f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.909+0000 7ffa7efff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa781f19a0 0x7ffa780ca010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.909+0000 7ffa7efff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa781f1e10 0x7ffa780ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.909+0000 7ffa7efff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c5d20 con 0x7ffa68004d90 2023-05-10T04:19:38.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.909+0000 7ffa7efff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c6000 con 0x7ffa781f1e10 2023-05-10T04:19:38.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.909+0000 7ffa7efff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa780c62e0 con 0x7ffa781f19a0 2023-05-10T04:19:38.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa781f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa781f56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48424/0 (socket says 172.21.15.132:48424) 2023-05-10T04:19:38.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 -- 172.21.15.132:0/2663502482 learned_addr learned my addr 172.21.15.132:0/2663502482 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:38.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa77fff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa781f19a0 0x7ffa780ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7d59c700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa781f1e10 0x7ffa780ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 -- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa781f19a0 msgr2=0x7ffa780ca010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa781f19a0 0x7ffa780ca010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 -- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa781f1e10 msgr2=0x7ffa780ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:38.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa781f1e10 0x7ffa780ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:38.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 -- 172.21.15.132:0/2663502482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa780cb790 con 0x7ffa68004d90 2023-05-10T04:19:38.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7d59c700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa781f1e10 0x7ffa780ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:38.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.910+0000 7ffa7cd9b700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa781f56f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c004fa0 tx=0x7ffa6c0073f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.911+0000 7ffa757fa700 1 -- 172.21.15.132:0/2663502482 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c011580 con 0x7ffa68004d90 2023-05-10T04:19:38.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.911+0000 7ffa757fa700 1 -- 172.21.15.132:0/2663502482 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c0116e0 con 0x7ffa68004d90 2023-05-10T04:19:38.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.911+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa780cb4b0 con 0x7ffa68004d90 2023-05-10T04:19:38.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.911+0000 7ffa757fa700 1 -- 172.21.15.132:0/2663502482 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c011a90 con 0x7ffa68004d90 2023-05-10T04:19:38.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.911+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa780cba70 con 0x7ffa68004d90 2023-05-10T04:19:38.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.912+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa780c7b30 con 0x7ffa68004d90 2023-05-10T04:19:38.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.913+0000 7ffa757fa700 1 -- 172.21.15.132:0/2663502482 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ffa6c011bf0 con 0x7ffa68004d90 2023-05-10T04:19:38.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.914+0000 7ffa757fa700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffa5c06ace0 0x7ffa5c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:38.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.914+0000 7ffa757fa700 1 -- 172.21.15.132:0/2663502482 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffa6c0896f0 con 0x7ffa68004d90 2023-05-10T04:19:38.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.914+0000 7ffa77fff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffa5c06ace0 0x7ffa5c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:38.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.915+0000 7ffa77fff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffa5c06ace0 0x7ffa5c06d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffa780c6b60 tx=0x7ffa64008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:38.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:38.918+0000 7ffa757fa700 1 -- 172.21.15.132:0/2663502482 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ffa6c058000 con 0x7ffa68004d90 2023-05-10T04:19:39.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.113+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa78070ab0 con 0x7ffa68004d90 2023-05-10T04:19:39.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.113+0000 7ffa757fa700 1 -- 172.21.15.132:0/2663502482 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa6c057b90 con 0x7ffa68004d90 2023-05-10T04:19:39.116 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:19:39.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffa5c06ace0 msgr2=0x7ffa5c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffa5c06ace0 0x7ffa5c06d190 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffa780c6b60 tx=0x7ffa64008040 comp rx=0 tx=0).stop 2023-05-10T04:19:39.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 msgr2=0x7ffa781f56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa781f56f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c004fa0 tx=0x7ffa6c0073f0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 shutdown_connections 2023-05-10T04:19:39.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ffa5c06ace0 0x7ffa5c06d190 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ffa781f1e10 0x7ffa780ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa68004d90 0x7ffa781f56f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 --2- 172.21.15.132:0/2663502482 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ffa781f19a0 0x7ffa780ca010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 >> 172.21.15.132:0/2663502482 conn(0x7ffa7809a090 msgr2=0x7ffa7806b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:39.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 shutdown_connections 2023-05-10T04:19:39.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.116+0000 7ffa7efff700 1 -- 172.21.15.132:0/2663502482 wait complete. 2023-05-10T04:19:39.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:19:39.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.318+0000 7f44359ff700 1 Processor -- start 2023-05-10T04:19:39.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.319+0000 7f44359ff700 1 -- start start 2023-05-10T04:19:39.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f44359ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300cfbf0 0x7f44301608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f44359ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44300d1100 0x7f44300d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f44359ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44300d0020 con 0x7f44300b87a0 2023-05-10T04:19:39.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f44359ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44300d02d0 con 0x7f44300d1100 2023-05-10T04:19:39.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f44359ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44300d0cb0 con 0x7f44300cfbf0 2023-05-10T04:19:39.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44300d1100 0x7f44300d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442effd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f44300b87a0 0x7f44301601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50852/0 (socket says 172.21.15.132:50852) 2023-05-10T04:19:39.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44300d1100 0x7f44300d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48428/0 (socket says 172.21.15.132:48428) 2023-05-10T04:19:39.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442effd700 1 -- 172.21.15.132:0/4248240822 learned_addr learned my addr 172.21.15.132:0/4248240822 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:39.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442e7fc700 1 --2- 172.21.15.132:0/4248240822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300cfbf0 0x7f44301608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442f7fe700 1 -- 172.21.15.132:0/4248240822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300cfbf0 msgr2=0x7f44301608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:39.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442f7fe700 1 --2- 172.21.15.132:0/4248240822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300cfbf0 0x7f44301608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442f7fe700 1 -- 172.21.15.132:0/4248240822 >> v1:172.21.15.132:6789/0 conn(0x7f44300b87a0 legacy=0x7f44301601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.320+0000 7f442f7fe700 1 -- 172.21.15.132:0/4248240822 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44300cdc60 con 0x7f44300d1100 2023-05-10T04:19:39.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.321+0000 7f442f7fe700 1 --2- 172.21.15.132:0/4248240822 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300d1100 0x7f44300d1580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4428009d90 tx=0x7f442800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baf0a896afd8cd98 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:39.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.321+0000 7f442dffb700 1 -- 172.21.15.132:0/4248240822 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442800e070 con 0x7f44300d1100 2023-05-10T04:19:39.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.321+0000 7f442dffb700 1 -- 172.21.15.132:0/4248240822 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442800bb20 con 0x7f44300d1100 2023-05-10T04:19:39.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.321+0000 7f442dffb700 1 -- 172.21.15.132:0/4248240822 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428012430 con 0x7f44300d1100 2023-05-10T04:19:39.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.321+0000 7f44359ff700 1 -- 172.21.15.132:0/4248240822 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300d1100 msgr2=0x7f44300d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.321+0000 7f44359ff700 1 --2- 172.21.15.132:0/4248240822 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300d1100 0x7f44300d1580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4428009d90 tx=0x7f442800b330 comp rx=0 tx=0).stop 2023-05-10T04:19:39.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.322+0000 7f44359ff700 1 -- 172.21.15.132:0/4248240822 shutdown_connections 2023-05-10T04:19:39.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.322+0000 7f44359ff700 1 --2- 172.21.15.132:0/4248240822 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300d1100 0x7f44300d1580 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.322+0000 7f44359ff700 1 --2- 172.21.15.132:0/4248240822 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300cfbf0 0x7f44301608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.322+0000 7f44359ff700 1 -- 172.21.15.132:0/4248240822 >> 172.21.15.132:0/4248240822 conn(0x7f4430071b10 msgr2=0x7f4430071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:39.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.322+0000 7f44359ff700 1 -- 172.21.15.132:0/4248240822 shutdown_connections 2023-05-10T04:19:39.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.322+0000 7f44359ff700 1 -- 172.21.15.132:0/4248240822 wait complete. 2023-05-10T04:19:39.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.323+0000 7f44359ff700 1 Processor -- start 2023-05-10T04:19:39.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.323+0000 7f44359ff700 1 -- start start 2023-05-10T04:19:39.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.324+0000 7f44359ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44300b87a0 0x7f44300c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.324+0000 7f44359ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300cfbf0 0x7f44300c8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.324+0000 7f44359ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300d1100 0x7f4430144960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.324+0000 7f44359ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4430144ea0 con 0x7f44300cfbf0 2023-05-10T04:19:39.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.324+0000 7f44359ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44300c7080 con 0x7f44300b87a0 2023-05-10T04:19:39.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.324+0000 7f44359ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44300c7360 con 0x7f44300d1100 2023-05-10T04:19:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300cfbf0 0x7f44300c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300cfbf0 0x7f44300c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48436/0 (socket says 172.21.15.132:48436) 2023-05-10T04:19:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 -- 172.21.15.132:0/3774727055 learned_addr learned my addr 172.21.15.132:0/3774727055 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442f7fe700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300d1100 0x7f4430144960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442effd700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44300b87a0 0x7f44300c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 -- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300d1100 msgr2=0x7f4430144960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300d1100 0x7f4430144960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 -- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44300b87a0 msgr2=0x7f44300c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44300b87a0 0x7f44300c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 -- 172.21.15.132:0/3774727055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4428009a70 con 0x7f44300cfbf0 2023-05-10T04:19:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442effd700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44300b87a0 0x7f44300c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442f7fe700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300d1100 0x7f4430144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.325+0000 7f442e7fc700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300cfbf0 0x7f44300c8120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f442400e9b0 tx=0x7f442400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.326+0000 7f4417fff700 1 -- 172.21.15.132:0/3774727055 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4424009710 con 0x7f44300cfbf0 2023-05-10T04:19:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.326+0000 7f4417fff700 1 -- 172.21.15.132:0/3774727055 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f442400c850 con 0x7f44300cfbf0 2023-05-10T04:19:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.326+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44300cd980 con 0x7f44300cfbf0 2023-05-10T04:19:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.326+0000 7f4417fff700 1 -- 172.21.15.132:0/3774727055 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f442400cbc0 con 0x7f44300cfbf0 2023-05-10T04:19:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.326+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44300cd6a0 con 0x7f44300cfbf0 2023-05-10T04:19:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.327+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4430160e30 con 0x7f44300cfbf0 2023-05-10T04:19:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.328+0000 7f4417fff700 1 -- 172.21.15.132:0/3774727055 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f442400cd20 con 0x7f44300cfbf0 2023-05-10T04:19:39.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.328+0000 7f4417fff700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f441c06ace0 0x7f441c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.329+0000 7f4417fff700 1 -- 172.21.15.132:0/3774727055 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4424089920 con 0x7f44300cfbf0 2023-05-10T04:19:39.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.329+0000 7f442effd700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f441c06ace0 0x7f441c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.329+0000 7f442effd700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f441c06ace0 0x7f441c06d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4420005910 tx=0x7f4420009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:39.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.333+0000 7f4417fff700 1 -- 172.21.15.132:0/3774727055 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f44240580d0 con 0x7f44300cfbf0 2023-05-10T04:19:39.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.533+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4430074430 con 0x7f44300cfbf0 2023-05-10T04:19:39.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.533+0000 7f4417fff700 1 -- 172.21.15.132:0/3774727055 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4424057c60 con 0x7f44300cfbf0 2023-05-10T04:19:39.535 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:19:39.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.535+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f441c06ace0 msgr2=0x7f441c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.535+0000 7f44359ff700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f441c06ace0 0x7f441c06d190 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4420005910 tx=0x7f4420009040 comp rx=0 tx=0).stop 2023-05-10T04:19:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.535+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300cfbf0 msgr2=0x7f44300c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.535+0000 7f44359ff700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300cfbf0 0x7f44300c8120 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f442400e9b0 tx=0x7f442400ed70 comp rx=0 tx=0).stop 2023-05-10T04:19:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.536+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 shutdown_connections 2023-05-10T04:19:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.536+0000 7f44359ff700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f441c06ace0 0x7f441c06d190 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.536+0000 7f44359ff700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44300d1100 0x7f4430144960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.536+0000 7f44359ff700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44300b87a0 0x7f44300c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.536+0000 7f44359ff700 1 --2- 172.21.15.132:0/3774727055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44300cfbf0 0x7f44300c8120 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.536+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 >> 172.21.15.132:0/3774727055 conn(0x7f4430071b10 msgr2=0x7f44300b3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:39.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.536+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 shutdown_connections 2023-05-10T04:19:39.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.536+0000 7f44359ff700 1 -- 172.21.15.132:0/3774727055 wait complete. 2023-05-10T04:19:39.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:19:39.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.740+0000 7f3ccc9ff700 1 Processor -- start 2023-05-10T04:19:39.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.740+0000 7f3ccc9ff700 1 -- start start 2023-05-10T04:19:39.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.741+0000 7f3ccc9ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cc80cfbf0 0x7f3cc81608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.741+0000 7f3ccc9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80d1100 0x7f3cc80d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.741+0000 7f3ccc9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc80d0020 con 0x7f3cc80b87a0 2023-05-10T04:19:39.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.741+0000 7f3ccc9ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc80d02d0 con 0x7f3cc80cfbf0 2023-05-10T04:19:39.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.741+0000 7f3ccc9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80d0cb0 con 0x7f3cc80d1100 2023-05-10T04:19:39.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cbffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cc80cfbf0 0x7f3cc81608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cbffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cc80cfbf0 0x7f3cc81608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48444/0 (socket says 172.21.15.132:48444) 2023-05-10T04:19:39.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cbffff700 1 -- 172.21.15.132:0/1423792186 learned_addr learned my addr 172.21.15.132:0/1423792186 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:39.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cc659c700 1 --1- 172.21.15.132:0/1423792186 >> v1:172.21.15.132:6789/0 conn(0x7f3cc80b87a0 0x7f3cc81601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50860/0 (socket says 172.21.15.132:50860) 2023-05-10T04:19:39.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cc6d9d700 1 --2- 172.21.15.132:0/1423792186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80d1100 0x7f3cc80d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cbffff700 1 -- 172.21.15.132:0/1423792186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80d1100 msgr2=0x7f3cc80d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:39.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cbffff700 1 --2- 172.21.15.132:0/1423792186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80d1100 0x7f3cc80d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cbffff700 1 -- 172.21.15.132:0/1423792186 >> v1:172.21.15.132:6789/0 conn(0x7f3cc80b87a0 legacy=0x7f3cc81601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cbffff700 1 -- 172.21.15.132:0/1423792186 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc80cdc60 con 0x7f3cc80cfbf0 2023-05-10T04:19:39.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cc5d9b700 1 -- 172.21.15.132:0/1423792186 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1049149282 0 0) 0x7f3cc80d0020 con 0x7f3cc80b87a0 2023-05-10T04:19:39.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.742+0000 7f3cbffff700 1 --2- 172.21.15.132:0/1423792186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80cfbf0 0x7f3cc81608f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00098f0 tx=0x7f3cb0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4afe8c6fefa892d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:39.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3cc5d9b700 1 -- 172.21.15.132:0/1423792186 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000b8a0 con 0x7f3cc80cfbf0 2023-05-10T04:19:39.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3cc5d9b700 1 -- 172.21.15.132:0/1423792186 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000ba00 con 0x7f3cc80cfbf0 2023-05-10T04:19:39.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3cc5d9b700 1 -- 172.21.15.132:0/1423792186 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000bd90 con 0x7f3cc80cfbf0 2023-05-10T04:19:39.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1423792186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80cfbf0 msgr2=0x7f3cc81608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1423792186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80cfbf0 0x7f3cc81608f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3cb00098f0 tx=0x7f3cb0009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:39.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1423792186 shutdown_connections 2023-05-10T04:19:39.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1423792186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80d1100 0x7f3cc80d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1423792186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80cfbf0 0x7f3cc81608f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1423792186 >> 172.21.15.132:0/1423792186 conn(0x7f3cc8071b10 msgr2=0x7f3cc8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:39.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1423792186 shutdown_connections 2023-05-10T04:19:39.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.743+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1423792186 wait complete. 2023-05-10T04:19:39.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.745+0000 7f3ccc9ff700 1 Processor -- start 2023-05-10T04:19:39.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.745+0000 7f3ccc9ff700 1 -- start start 2023-05-10T04:19:39.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3ccc9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc80b87a0 0x7f3cc814ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3ccc9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80cfbf0 0x7f3cc8150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3ccc9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80d1100 0x7f3cc815dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3ccc9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80c8990 con 0x7f3cc80d1100 2023-05-10T04:19:39.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3ccc9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc8151450 con 0x7f3cc80b87a0 2023-05-10T04:19:39.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3ccc9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80c8060 con 0x7f3cc80cfbf0 2023-05-10T04:19:39.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3cc6d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80d1100 0x7f3cc815dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3cc6d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80d1100 0x7f3cc815dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48458/0 (socket says 172.21.15.132:48458) 2023-05-10T04:19:39.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3cc6d9d700 1 -- 172.21.15.132:0/1852905092 learned_addr learned my addr 172.21.15.132:0/1852905092 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:39.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3cbffff700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80cfbf0 0x7f3cc8150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.746+0000 7f3cc659c700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc80b87a0 0x7f3cc814ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cc6d9d700 1 -- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80cfbf0 msgr2=0x7f3cc8150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cc6d9d700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80cfbf0 0x7f3cc8150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cc6d9d700 1 -- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc80b87a0 msgr2=0x7f3cc814ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cc6d9d700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc80b87a0 0x7f3cc814ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cc6d9d700 1 -- 172.21.15.132:0/1852905092 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cb0009550 con 0x7f3cc80d1100 2023-05-10T04:19:39.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cc659c700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc80b87a0 0x7f3cc814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:39.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cc6d9d700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80d1100 0x7f3cc815dae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007e60 tx=0x7f3cc000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:39.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cbeffd700 1 -- 172.21.15.132:0/1852905092 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc000ede0 con 0x7f3cc80d1100 2023-05-10T04:19:39.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cbeffd700 1 -- 172.21.15.132:0/1852905092 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc0014420 con 0x7f3cc80d1100 2023-05-10T04:19:39.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc80cd980 con 0x7f3cc80d1100 2023-05-10T04:19:39.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3cbeffd700 1 -- 172.21.15.132:0/1852905092 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc00147d0 con 0x7f3cc80d1100 2023-05-10T04:19:39.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.747+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc80cd6a0 con 0x7f3cc80d1100 2023-05-10T04:19:39.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.748+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc8160e30 con 0x7f3cc80d1100 2023-05-10T04:19:39.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.749+0000 7f3cbeffd700 1 -- 172.21.15.132:0/1852905092 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3cc0014930 con 0x7f3cc80d1100 2023-05-10T04:19:39.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.750+0000 7f3cbeffd700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ca806ad10 0x7f3ca806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:39.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.750+0000 7f3cbeffd700 1 -- 172.21.15.132:0/1852905092 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3cc0089f40 con 0x7f3cc80d1100 2023-05-10T04:19:39.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.750+0000 7f3cc659c700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ca806ad10 0x7f3ca806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:39.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.751+0000 7f3cc659c700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ca806ad10 0x7f3ca806d1c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8000f60 tx=0x7f3cb8007ca0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:39.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.754+0000 7f3cbeffd700 1 -- 172.21.15.132:0/1852905092 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3cc0054bd0 con 0x7f3cc80d1100 2023-05-10T04:19:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.948+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3cc8074430 con 0x7f3cc80d1100 2023-05-10T04:19:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.948+0000 7f3cbeffd700 1 -- 172.21.15.132:0/1852905092 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3cc00581f0 con 0x7f3cc80d1100 2023-05-10T04:19:39.951 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:19:39.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ca806ad10 msgr2=0x7f3ca806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ca806ad10 0x7f3ca806d1c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8000f60 tx=0x7f3cb8007ca0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80d1100 msgr2=0x7f3cc815dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:39.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80d1100 0x7f3cc815dae0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0007e60 tx=0x7f3cc000e3c0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 shutdown_connections 2023-05-10T04:19:39.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3ca806ad10 0x7f3ca806d1c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cc80d1100 0x7f3cc815dae0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3cc80b87a0 0x7f3cc814ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 --2- 172.21.15.132:0/1852905092 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3cc80cfbf0 0x7f3cc8150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:39.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 >> 172.21.15.132:0/1852905092 conn(0x7f3cc8071b10 msgr2=0x7f3cc80b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:39.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 shutdown_connections 2023-05-10T04:19:39.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:39.951+0000 7f3ccc9ff700 1 -- 172.21.15.132:0/1852905092 wait complete. 2023-05-10T04:19:39.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:19:40.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.152+0000 7f717e9ff700 1 Processor -- start 2023-05-10T04:19:40.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.152+0000 7f717e9ff700 1 -- start start 2023-05-10T04:19:40.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.153+0000 7f717e9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780b87a0 0x7f71780cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.153+0000 7f717e9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71780cdc60 con 0x7f7178160d40 2023-05-10T04:19:40.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.153+0000 7f717e9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71780cd6a0 con 0x7f71781601e0 2023-05-10T04:19:40.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.153+0000 7f717e9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71780d02d0 con 0x7f71780b87a0 2023-05-10T04:19:40.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.153+0000 7f717cf9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7178160d40 0x7f71780d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50872/0 (socket says 172.21.15.132:50872) 2023-05-10T04:19:40.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.153+0000 7f717cf9c700 1 -- 172.21.15.132:0/4160715454 learned_addr learned my addr 172.21.15.132:0/4160715454 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:40.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.153+0000 7f7177fff700 1 --2- 172.21.15.132:0/4160715454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780b87a0 0x7f71780cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7176ffd700 1 -- 172.21.15.132:0/4160715454 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4224760622 0 0) 0x7f71780cdc60 con 0x7f7178160d40 2023-05-10T04:19:40.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7176ffd700 1 -- 172.21.15.132:0/4160715454 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71600035b0 con 0x7f7178160d40 2023-05-10T04:19:40.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7176ffd700 1 -- 172.21.15.132:0/4160715454 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1780168439 0 0) 0x7f71780cd6a0 con 0x7f71781601e0 2023-05-10T04:19:40.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7176ffd700 1 -- 172.21.15.132:0/4160715454 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71780cdc60 con 0x7f71781601e0 2023-05-10T04:19:40.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7177fff700 1 -- 172.21.15.132:0/4160715454 >> v1:172.21.15.154:6789/0 conn(0x7f71781601e0 legacy=0x7f7178160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7177fff700 1 -- 172.21.15.132:0/4160715454 >> v1:172.21.15.132:6789/0 conn(0x7f7178160d40 legacy=0x7f71780d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7177fff700 1 -- 172.21.15.132:0/4160715454 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71780cd980 con 0x7f71780b87a0 2023-05-10T04:19:40.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7177fff700 1 --2- 172.21.15.132:0/4160715454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780b87a0 0x7f71780cfbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7168009870 tx=0x7f7168009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=412a225a65c34574 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:40.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7176ffd700 1 -- 172.21.15.132:0/4160715454 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168011830 con 0x7f71780b87a0 2023-05-10T04:19:40.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7176ffd700 1 -- 172.21.15.132:0/4160715454 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7168011990 con 0x7f71780b87a0 2023-05-10T04:19:40.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.154+0000 7f7176ffd700 1 -- 172.21.15.132:0/4160715454 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168011d20 con 0x7f71780b87a0 2023-05-10T04:19:40.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.155+0000 7f717e9ff700 1 -- 172.21.15.132:0/4160715454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780b87a0 msgr2=0x7f71780cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.155+0000 7f717e9ff700 1 --2- 172.21.15.132:0/4160715454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780b87a0 0x7f71780cfbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7168009870 tx=0x7f7168009b80 comp rx=0 tx=0).stop 2023-05-10T04:19:40.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.155+0000 7f717e9ff700 1 -- 172.21.15.132:0/4160715454 shutdown_connections 2023-05-10T04:19:40.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.155+0000 7f717e9ff700 1 --2- 172.21.15.132:0/4160715454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71780b87a0 0x7f71780cfbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.155+0000 7f717e9ff700 1 -- 172.21.15.132:0/4160715454 >> 172.21.15.132:0/4160715454 conn(0x7f7178071b10 msgr2=0x7f7178071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:40.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.155+0000 7f717e9ff700 1 -- 172.21.15.132:0/4160715454 shutdown_connections 2023-05-10T04:19:40.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.155+0000 7f717e9ff700 1 -- 172.21.15.132:0/4160715454 wait complete. 2023-05-10T04:19:40.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.157+0000 7f717e9ff700 1 Processor -- start 2023-05-10T04:19:40.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.157+0000 7f717e9ff700 1 -- start start 2023-05-10T04:19:40.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f717e9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71780b87a0 0x7f71780c8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f717e9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71781601e0 0x7f717815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f717e9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7178160d40 0x7f71780c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f717e9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717815cce0 con 0x7f71780b87a0 2023-05-10T04:19:40.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f717e9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717815cf30 con 0x7f71781601e0 2023-05-10T04:19:40.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f717e9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717815d210 con 0x7f7178160d40 2023-05-10T04:19:40.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f7177fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71780b87a0 0x7f71780c8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f7177fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71780b87a0 0x7f71780c8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48460/0 (socket says 172.21.15.132:48460) 2023-05-10T04:19:40.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f7177fff700 1 -- 172.21.15.132:0/4063654745 learned_addr learned my addr 172.21.15.132:0/4063654745 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:40.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f71777fe700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71781601e0 0x7f717815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f717cf9c700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7178160d40 0x7f71780c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f7177fff700 1 -- 172.21.15.132:0/4063654745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7178160d40 msgr2=0x7f71780c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f7177fff700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7178160d40 0x7f71780c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f7177fff700 1 -- 172.21.15.132:0/4063654745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71781601e0 msgr2=0x7f717815dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f7177fff700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71781601e0 0x7f717815dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.158+0000 7f7177fff700 1 -- 172.21.15.132:0/4063654745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680094a0 con 0x7f71780b87a0 2023-05-10T04:19:40.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.159+0000 7f7177fff700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71780b87a0 0x7f71780c8b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f71680090b0 tx=0x7f7168004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:40.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.159+0000 7f7174ff9700 1 -- 172.21.15.132:0/4063654745 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716801a6e0 con 0x7f71780b87a0 2023-05-10T04:19:40.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.159+0000 7f7174ff9700 1 -- 172.21.15.132:0/4063654745 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f716801a840 con 0x7f71780b87a0 2023-05-10T04:19:40.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.159+0000 7f7174ff9700 1 -- 172.21.15.132:0/4063654745 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f716801abb0 con 0x7f71780b87a0 2023-05-10T04:19:40.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.159+0000 7f717e9ff700 1 -- 172.21.15.132:0/4063654745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71780d19a0 con 0x7f71780b87a0 2023-05-10T04:19:40.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.159+0000 7f717e9ff700 1 -- 172.21.15.132:0/4063654745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71780d1810 con 0x7f71780b87a0 2023-05-10T04:19:40.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.160+0000 7f715e7fc700 1 -- 172.21.15.132:0/4063654745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71500052f0 con 0x7f71780b87a0 2023-05-10T04:19:40.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.161+0000 7f7174ff9700 1 -- 172.21.15.132:0/4063654745 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7168022070 con 0x7f71780b87a0 2023-05-10T04:19:40.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.162+0000 7f7174ff9700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f716406ace0 0x7f716406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.162+0000 7f7174ff9700 1 -- 172.21.15.132:0/4063654745 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f716808a320 con 0x7f71780b87a0 2023-05-10T04:19:40.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.162+0000 7f71777fe700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f716406ace0 0x7f716406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.162+0000 7f71777fe700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f716406ace0 0x7f716406d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71780c9cf0 tx=0x7f716c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:40.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.166+0000 7f7174ff9700 1 -- 172.21.15.132:0/4063654745 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7168055180 con 0x7f71780b87a0 2023-05-10T04:19:40.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.405+0000 7f715e7fc700 1 -- 172.21.15.132:0/4063654745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7150005b20 con 0x7f71780b87a0 2023-05-10T04:19:40.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.405+0000 7f7174ff9700 1 -- 172.21.15.132:0/4063654745 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f71680587a0 con 0x7f71780b87a0 2023-05-10T04:19:40.407 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:40.408 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:31.478753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-10T04:19:40.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 -- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f716406ace0 msgr2=0x7f716406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f716406ace0 0x7f716406d190 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f71780c9cf0 tx=0x7f716c009040 comp rx=0 tx=0).stop 2023-05-10T04:19:40.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 -- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71780b87a0 msgr2=0x7f71780c8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71780b87a0 0x7f71780c8b10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f71680090b0 tx=0x7f7168004750 comp rx=0 tx=0).stop 2023-05-10T04:19:40.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 -- 172.21.15.132:0/4063654745 shutdown_connections 2023-05-10T04:19:40.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f716406ace0 0x7f716406d190 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7178160d40 0x7f71780c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71780b87a0 0x7f71780c8b10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 --2- 172.21.15.132:0/4063654745 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71781601e0 0x7f717815dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 -- 172.21.15.132:0/4063654745 >> 172.21.15.132:0/4063654745 conn(0x7f7178071b10 msgr2=0x7f717815c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:40.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.407+0000 7f715e7fc700 1 -- 172.21.15.132:0/4063654745 shutdown_connections 2023-05-10T04:19:40.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.408+0000 7f715e7fc700 1 -- 172.21.15.132:0/4063654745 wait complete. 2023-05-10T04:19:40.412 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2023-05-10T04:19:40.427 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:40.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.609+0000 7fb583bff700 1 Processor -- start 2023-05-10T04:19:40.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.610+0000 7fb583bff700 1 -- start start 2023-05-10T04:19:40.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb583bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb57c0b87a0 0x7fb57c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb583bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c160d40 0x7fb57c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb583bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c0cdc60 con 0x7fb57c1601e0 2023-05-10T04:19:40.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb583bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c0d02d0 con 0x7fb57c0b87a0 2023-05-10T04:19:40.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb583bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c0d0cb0 con 0x7fb57c160d40 2023-05-10T04:19:40.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb58199b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb57c0b87a0 0x7fb57c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb58199b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb57c0b87a0 0x7fb57c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48462/0 (socket says 172.21.15.132:48462) 2023-05-10T04:19:40.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb58199b700 1 -- 172.21.15.132:0/4181531946 learned_addr learned my addr 172.21.15.132:0/4181531946 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb58219c700 1 --2- 172.21.15.132:0/4181531946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c160d40 0x7fb57c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb58199b700 1 -- 172.21.15.132:0/4181531946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c160d40 msgr2=0x7fb57c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb58199b700 1 --2- 172.21.15.132:0/4181531946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c160d40 0x7fb57c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb58199b700 1 -- 172.21.15.132:0/4181531946 >> v1:172.21.15.132:6789/0 conn(0x7fb57c1601e0 legacy=0x7fb57c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.611+0000 7fb58199b700 1 -- 172.21.15.132:0/4181531946 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c0cd6a0 con 0x7fb57c0b87a0 2023-05-10T04:19:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb58199b700 1 --2- 172.21.15.132:0/4181531946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c0b87a0 0x7fb57c0cfbf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098f0 tx=0x7fb578009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30d930f642d70029 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb580999700 1 -- 172.21.15.132:0/4181531946 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57800b8a0 con 0x7fb57c0b87a0 2023-05-10T04:19:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb580999700 1 -- 172.21.15.132:0/4181531946 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57800ba00 con 0x7fb57c0b87a0 2023-05-10T04:19:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb580999700 1 -- 172.21.15.132:0/4181531946 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57800bd90 con 0x7fb57c0b87a0 2023-05-10T04:19:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb583bff700 1 -- 172.21.15.132:0/4181531946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c0b87a0 msgr2=0x7fb57c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb583bff700 1 --2- 172.21.15.132:0/4181531946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c0b87a0 0x7fb57c0cfbf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5780098f0 tx=0x7fb578009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb583bff700 1 -- 172.21.15.132:0/4181531946 shutdown_connections 2023-05-10T04:19:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb583bff700 1 --2- 172.21.15.132:0/4181531946 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c160d40 0x7fb57c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb583bff700 1 --2- 172.21.15.132:0/4181531946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c0b87a0 0x7fb57c0cfbf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.612+0000 7fb583bff700 1 -- 172.21.15.132:0/4181531946 >> 172.21.15.132:0/4181531946 conn(0x7fb57c071b10 msgr2=0x7fb57c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.613+0000 7fb583bff700 1 -- 172.21.15.132:0/4181531946 shutdown_connections 2023-05-10T04:19:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.613+0000 7fb583bff700 1 -- 172.21.15.132:0/4181531946 wait complete. 2023-05-10T04:19:40.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.614+0000 7fb583bff700 1 Processor -- start 2023-05-10T04:19:40.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.614+0000 7fb583bff700 1 -- start start 2023-05-10T04:19:40.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.615+0000 7fb583bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c0b87a0 0x7fb57c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.615+0000 7fb583bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c1601e0 0x7fb57c0b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.615+0000 7fb583bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57c160d40 0x7fb57c0b78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.615+0000 7fb583bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c151740 con 0x7fb57c1601e0 2023-05-10T04:19:40.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.615+0000 7fb583bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1f29c0 con 0x7fb57c160d40 2023-05-10T04:19:40.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.615+0000 7fb583bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c1f2ca0 con 0x7fb57c0b87a0 2023-05-10T04:19:40.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c1601e0 0x7fb57c0b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c1601e0 0x7fb57c0b73b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48466/0 (socket says 172.21.15.132:48466) 2023-05-10T04:19:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 -- 172.21.15.132:0/555962944 learned_addr learned my addr 172.21.15.132:0/555962944 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58199b700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c0b87a0 0x7fb57c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58219c700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57c160d40 0x7fb57c0b78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 -- 172.21.15.132:0/555962944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c0b87a0 msgr2=0x7fb57c151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c0b87a0 0x7fb57c151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 -- 172.21.15.132:0/555962944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57c160d40 msgr2=0x7fb57c0b78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57c160d40 0x7fb57c0b78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 -- 172.21.15.132:0/555962944 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb578009550 con 0x7fb57c1601e0 2023-05-10T04:19:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.616+0000 7fb58119a700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c1601e0 0x7fb57c0b73b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c4e0 tx=0x7fb56c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.617+0000 7fb5727fc700 1 -- 172.21.15.132:0/555962944 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0052d0 con 0x7fb57c1601e0 2023-05-10T04:19:40.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.617+0000 7fb5727fc700 1 -- 172.21.15.132:0/555962944 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c005430 con 0x7fb57c1601e0 2023-05-10T04:19:40.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.617+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c0d1640 con 0x7fb57c1601e0 2023-05-10T04:19:40.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.617+0000 7fb5727fc700 1 -- 172.21.15.132:0/555962944 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0038c0 con 0x7fb57c1601e0 2023-05-10T04:19:40.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.617+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c0cd980 con 0x7fb57c1601e0 2023-05-10T04:19:40.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.618+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c0d17d0 con 0x7fb57c1601e0 2023-05-10T04:19:40.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.619+0000 7fb5727fc700 1 -- 172.21.15.132:0/555962944 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb56c003a20 con 0x7fb57c1601e0 2023-05-10T04:19:40.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.620+0000 7fb5727fc700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb56006ace0 0x7fb56006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:40.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.620+0000 7fb5727fc700 1 -- 172.21.15.132:0/555962944 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb56c088b70 con 0x7fb57c1601e0 2023-05-10T04:19:40.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.621+0000 7fb58199b700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb56006ace0 0x7fb56006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:40.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.621+0000 7fb58199b700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb56006ace0 0x7fb56006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb578009c40 tx=0x7fb578008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:40.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.625+0000 7fb5727fc700 1 -- 172.21.15.132:0/555962944 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb56c053890 con 0x7fb57c1601e0 2023-05-10T04:19:40.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.822+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb57c074430 con 0x7fb57c1601e0 2023-05-10T04:19:40.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.823+0000 7fb5727fc700 1 -- 172.21.15.132:0/555962944 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fb56c056eb0 con 0x7fb57c1601e0 2023-05-10T04:19:40.826 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:40.826 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:40.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb56006ace0 msgr2=0x7fb56006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb56006ace0 0x7fb56006d190 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb578009c40 tx=0x7fb578008030 comp rx=0 tx=0).stop 2023-05-10T04:19:40.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c1601e0 msgr2=0x7fb57c0b73b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:40.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c1601e0 0x7fb57c0b73b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00c4e0 tx=0x7fb56c00c7f0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 shutdown_connections 2023-05-10T04:19:40.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb56006ace0 0x7fb56006d190 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb57c160d40 0x7fb57c0b78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb57c0b87a0 0x7fb57c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 --2- 172.21.15.132:0/555962944 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb57c1601e0 0x7fb57c0b73b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:40.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 >> 172.21.15.132:0/555962944 conn(0x7fb57c071b10 msgr2=0x7fb57c0cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:40.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 shutdown_connections 2023-05-10T04:19:40.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:40.826+0000 7fb583bff700 1 -- 172.21.15.132:0/555962944 wait complete. 2023-05-10T04:19:40.846 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:19:40.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:19:41.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.029+0000 7f87661ff700 1 Processor -- start 2023-05-10T04:19:41.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.030+0000 7f87661ff700 1 -- start start 2023-05-10T04:19:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f87661ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87600b87a0 0x7f87600cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f87661ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f87601601e0 0x7f8760160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f87661ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8760160b70 0x7f87600d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f87661ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87600d02d0 con 0x7f87600b87a0 2023-05-10T04:19:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f87661ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87600d0cb0 con 0x7f87601601e0 2023-05-10T04:19:41.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f87661ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600b2730 con 0x7f8760160b70 2023-05-10T04:19:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f875f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87600b87a0 0x7f87600cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f875f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87600b87a0 0x7f87600cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48474/0 (socket says 172.21.15.132:48474) 2023-05-10T04:19:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f875f7fe700 1 -- 172.21.15.132:0/166460244 learned_addr learned my addr 172.21.15.132:0/166460244 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f875ffff700 1 --2- 172.21.15.132:0/166460244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8760160b70 0x7f87600d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f8757fff700 1 --2- 172.21.15.132:0/166460244 >> v2:172.21.15.154:3300/0 conn(0x7f87601601e0 0x7f8760160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f875f7fe700 1 -- 172.21.15.132:0/166460244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8760160b70 msgr2=0x7f87600d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.031+0000 7f875f7fe700 1 --2- 172.21.15.132:0/166460244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8760160b70 0x7f87600d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.032+0000 7f875f7fe700 1 -- 172.21.15.132:0/166460244 >> v2:172.21.15.154:3300/0 conn(0x7f87601601e0 msgr2=0x7f8760160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.032+0000 7f875f7fe700 1 --2- 172.21.15.132:0/166460244 >> v2:172.21.15.154:3300/0 conn(0x7f87601601e0 0x7f8760160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.032+0000 7f875f7fe700 1 -- 172.21.15.132:0/166460244 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87600cdc60 con 0x7f87600b87a0 2023-05-10T04:19:41.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.032+0000 7f875f7fe700 1 --2- 172.21.15.132:0/166460244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f87600cfbf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f87600b8f60 tx=0x7f8750009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe2b305f9259d28 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.032+0000 7f875effd700 1 -- 172.21.15.132:0/166460244 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750011830 con 0x7f87600b87a0 2023-05-10T04:19:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.032+0000 7f875effd700 1 -- 172.21.15.132:0/166460244 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750011990 con 0x7f87600b87a0 2023-05-10T04:19:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.032+0000 7f875effd700 1 -- 172.21.15.132:0/166460244 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750011d20 con 0x7f87600b87a0 2023-05-10T04:19:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 -- 172.21.15.132:0/166460244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 msgr2=0x7f87600cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 --2- 172.21.15.132:0/166460244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f87600cfbf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f87600b8f60 tx=0x7f8750009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 -- 172.21.15.132:0/166460244 shutdown_connections 2023-05-10T04:19:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 --2- 172.21.15.132:0/166460244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8760160b70 0x7f87600d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 --2- 172.21.15.132:0/166460244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f87600cfbf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 --2- 172.21.15.132:0/166460244 >> v2:172.21.15.154:3300/0 conn(0x7f87601601e0 0x7f8760160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 -- 172.21.15.132:0/166460244 >> 172.21.15.132:0/166460244 conn(0x7f8760071b10 msgr2=0x7f8760071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 -- 172.21.15.132:0/166460244 shutdown_connections 2023-05-10T04:19:41.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.033+0000 7f87661ff700 1 -- 172.21.15.132:0/166460244 wait complete. 2023-05-10T04:19:41.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.034+0000 7f87661ff700 1 Processor -- start 2023-05-10T04:19:41.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.035+0000 7f87661ff700 1 -- start start 2023-05-10T04:19:41.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.035+0000 7f87661ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f8760155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.035+0000 7f87661ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87601601e0 0x7f87600b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.035+0000 7f87661ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8760160b70 0x7f8760150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.035+0000 7f87661ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760157290 con 0x7f87600b87a0 2023-05-10T04:19:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.035+0000 7f87661ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760156610 con 0x7f8760160b70 2023-05-10T04:19:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.035+0000 7f87661ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87601568f0 con 0x7f87601601e0 2023-05-10T04:19:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f8760155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f8760155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48476/0 (socket says 172.21.15.132:48476) 2023-05-10T04:19:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 -- 172.21.15.132:0/1073389528 learned_addr learned my addr 172.21.15.132:0/1073389528 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875ffff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8760160b70 0x7f8760150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f8757fff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87601601e0 0x7f87600b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 -- 172.21.15.132:0/1073389528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87601601e0 msgr2=0x7f87600b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87601601e0 0x7f87600b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 -- 172.21.15.132:0/1073389528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8760160b70 msgr2=0x7f8760150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8760160b70 0x7f8760150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 -- 172.21.15.132:0/1073389528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8750009550 con 0x7f87600b87a0 2023-05-10T04:19:41.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875f7fe700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f8760155dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8750000c00 tx=0x7f8750004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875cff9700 1 -- 172.21.15.132:0/1073389528 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750004300 con 0x7f87600b87a0 2023-05-10T04:19:41.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875cff9700 1 -- 172.21.15.132:0/1073389528 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f875001f070 con 0x7f87600b87a0 2023-05-10T04:19:41.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87600cd6a0 con 0x7f87600b87a0 2023-05-10T04:19:41.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.036+0000 7f875cff9700 1 -- 172.21.15.132:0/1073389528 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87500036a0 con 0x7f87600b87a0 2023-05-10T04:19:41.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.037+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8760160fd0 con 0x7f87600b87a0 2023-05-10T04:19:41.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.038+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87600cd980 con 0x7f87600b87a0 2023-05-10T04:19:41.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.038+0000 7f875cff9700 1 -- 172.21.15.132:0/1073389528 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8750021030 con 0x7f87600b87a0 2023-05-10T04:19:41.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.039+0000 7f875cff9700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874006ace0 0x7f874006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.039+0000 7f875cff9700 1 -- 172.21.15.132:0/1073389528 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f875008aa50 con 0x7f87600b87a0 2023-05-10T04:19:41.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.039+0000 7f8757fff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874006ace0 0x7f874006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.040+0000 7f8757fff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874006ace0 0x7f874006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f876015fd70 tx=0x7f8748008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.043+0000 7f875cff9700 1 -- 172.21.15.132:0/1073389528 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8750055920 con 0x7f87600b87a0 2023-05-10T04:19:41.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.238+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8760074430 con 0x7f87600b87a0 2023-05-10T04:19:41.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.239+0000 7f875cff9700 1 -- 172.21.15.132:0/1073389528 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8750015020 con 0x7f87600b87a0 2023-05-10T04:19:41.241 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:19:41.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874006ace0 msgr2=0x7f874006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874006ace0 0x7f874006d190 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f876015fd70 tx=0x7f8748008040 comp rx=0 tx=0).stop 2023-05-10T04:19:41.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 msgr2=0x7f8760155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f8760155dc0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8750000c00 tx=0x7f8750004750 comp rx=0 tx=0).stop 2023-05-10T04:19:41.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 shutdown_connections 2023-05-10T04:19:41.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f874006ace0 0x7f874006d190 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8760160b70 0x7f8760150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600b87a0 0x7f8760155dc0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 --2- 172.21.15.132:0/1073389528 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f87601601e0 0x7f87600b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 >> 172.21.15.132:0/1073389528 conn(0x7f8760071b10 msgr2=0x7f876015a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:41.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.241+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 shutdown_connections 2023-05-10T04:19:41.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.242+0000 7f87661ff700 1 -- 172.21.15.132:0/1073389528 wait complete. 2023-05-10T04:19:41.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:19:41.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.446+0000 7f2676fff700 1 Processor -- start 2023-05-10T04:19:41.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.446+0000 7f2676fff700 1 -- start start 2023-05-10T04:19:41.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2676fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26700b87a0 0x7f26700cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2676fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f26701601e0 0x7f2670160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2676fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 0x7f26700d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2676fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26700d02d0 con 0x7f26700b87a0 2023-05-10T04:19:41.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2676fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26700d0cb0 con 0x7f26701601e0 2023-05-10T04:19:41.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2676fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26700b2730 con 0x7f2670160b70 2023-05-10T04:19:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2674d9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26700b87a0 0x7f26700cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2674d9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26700b87a0 0x7f26700cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48486/0 (socket says 172.21.15.132:48486) 2023-05-10T04:19:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.447+0000 7f2674d9b700 1 -- 172.21.15.132:0/972277689 learned_addr learned my addr 172.21.15.132:0/972277689 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f267559c700 1 --2- 172.21.15.132:0/972277689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 0x7f26700d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f266ffff700 1 --2- 172.21.15.132:0/972277689 >> v2:172.21.15.154:3300/0 conn(0x7f26701601e0 0x7f2670160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f2674d9b700 1 -- 172.21.15.132:0/972277689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 msgr2=0x7f26700d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:41.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f2674d9b700 1 --2- 172.21.15.132:0/972277689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 0x7f26700d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f2674d9b700 1 -- 172.21.15.132:0/972277689 >> v2:172.21.15.154:3300/0 conn(0x7f26701601e0 msgr2=0x7f2670160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:41.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f2674d9b700 1 --2- 172.21.15.132:0/972277689 >> v2:172.21.15.154:3300/0 conn(0x7f26701601e0 0x7f2670160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f2674d9b700 1 -- 172.21.15.132:0/972277689 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26700cdc60 con 0x7f26700b87a0 2023-05-10T04:19:41.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f2674d9b700 1 --2- 172.21.15.132:0/972277689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f26700cfbf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f26700b8f60 tx=0x7f2664009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd498d089abaa8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f266f7fe700 1 -- 172.21.15.132:0/972277689 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664011830 con 0x7f26700b87a0 2023-05-10T04:19:41.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f266f7fe700 1 -- 172.21.15.132:0/972277689 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664011990 con 0x7f26700b87a0 2023-05-10T04:19:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.448+0000 7f266f7fe700 1 -- 172.21.15.132:0/972277689 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664011d20 con 0x7f26700b87a0 2023-05-10T04:19:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 -- 172.21.15.132:0/972277689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 msgr2=0x7f26700cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 --2- 172.21.15.132:0/972277689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f26700cfbf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f26700b8f60 tx=0x7f2664009bd0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 -- 172.21.15.132:0/972277689 shutdown_connections 2023-05-10T04:19:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 --2- 172.21.15.132:0/972277689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 0x7f26700d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 --2- 172.21.15.132:0/972277689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f26700cfbf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 --2- 172.21.15.132:0/972277689 >> v2:172.21.15.154:3300/0 conn(0x7f26701601e0 0x7f2670160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 -- 172.21.15.132:0/972277689 >> 172.21.15.132:0/972277689 conn(0x7f2670071b10 msgr2=0x7f2670071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 -- 172.21.15.132:0/972277689 shutdown_connections 2023-05-10T04:19:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.449+0000 7f2676fff700 1 -- 172.21.15.132:0/972277689 wait complete. 2023-05-10T04:19:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.451+0000 7f2676fff700 1 Processor -- start 2023-05-10T04:19:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.451+0000 7f2676fff700 1 -- start start 2023-05-10T04:19:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2676fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f2670155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2676fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26701601e0 0x7f26700b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2676fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 0x7f2670150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2676fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670157290 con 0x7f26700b87a0 2023-05-10T04:19:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2676fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2670156610 con 0x7f26701601e0 2023-05-10T04:19:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2676fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26701568f0 con 0x7f2670160b70 2023-05-10T04:19:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2674d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f2670155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2674d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f2670155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48502/0 (socket says 172.21.15.132:48502) 2023-05-10T04:19:41.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2674d9b700 1 -- 172.21.15.132:0/270169508 learned_addr learned my addr 172.21.15.132:0/270169508 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f267559c700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 0x7f2670150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f266ffff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26701601e0 0x7f26700b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2674d9b700 1 -- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 msgr2=0x7f2670150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2674d9b700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 0x7f2670150a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2674d9b700 1 -- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26701601e0 msgr2=0x7f26700b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2674d9b700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26701601e0 0x7f26700b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f2674d9b700 1 -- 172.21.15.132:0/270169508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2664009550 con 0x7f26700b87a0 2023-05-10T04:19:41.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.452+0000 7f266ffff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26701601e0 0x7f26700b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:41.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.453+0000 7f2674d9b700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f2670155dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2664000c00 tx=0x7f2664004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.453+0000 7f266d7fa700 1 -- 172.21.15.132:0/270169508 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2664004300 con 0x7f26700b87a0 2023-05-10T04:19:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.453+0000 7f266d7fa700 1 -- 172.21.15.132:0/270169508 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266401f070 con 0x7f26700b87a0 2023-05-10T04:19:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.453+0000 7f266d7fa700 1 -- 172.21.15.132:0/270169508 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26640036a0 con 0x7f26700b87a0 2023-05-10T04:19:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.453+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26700cd6a0 con 0x7f26700b87a0 2023-05-10T04:19:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.453+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2670160fd0 con 0x7f26700b87a0 2023-05-10T04:19:41.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.454+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26700cd980 con 0x7f26700b87a0 2023-05-10T04:19:41.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.455+0000 7f266d7fa700 1 -- 172.21.15.132:0/270169508 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2664021030 con 0x7f26700b87a0 2023-05-10T04:19:41.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.456+0000 7f266d7fa700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f265406ace0 0x7f265406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.456+0000 7f266d7fa700 1 -- 172.21.15.132:0/270169508 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f266408aa00 con 0x7f26700b87a0 2023-05-10T04:19:41.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.456+0000 7f266ffff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f265406ace0 0x7f265406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.457+0000 7f266ffff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f265406ace0 0x7f265406d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f267015fd70 tx=0x7f265c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.460+0000 7f266d7fa700 1 -- 172.21.15.132:0/270169508 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2664055970 con 0x7f26700b87a0 2023-05-10T04:19:41.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.660+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2670074430 con 0x7f26700b87a0 2023-05-10T04:19:41.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.660+0000 7f266d7fa700 1 -- 172.21.15.132:0/270169508 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2664015020 con 0x7f26700b87a0 2023-05-10T04:19:41.663 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:19:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f265406ace0 msgr2=0x7f265406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f265406ace0 0x7f265406d190 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f267015fd70 tx=0x7f265c008040 comp rx=0 tx=0).stop 2023-05-10T04:19:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 msgr2=0x7f2670155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f2670155dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2664000c00 tx=0x7f2664004750 comp rx=0 tx=0).stop 2023-05-10T04:19:41.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 shutdown_connections 2023-05-10T04:19:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f265406ace0 0x7f265406d190 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2670160b70 0x7f2670150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26700b87a0 0x7f2670155dc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 --2- 172.21.15.132:0/270169508 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f26701601e0 0x7f26700b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 >> 172.21.15.132:0/270169508 conn(0x7f2670071b10 msgr2=0x7f267015a070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:41.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 shutdown_connections 2023-05-10T04:19:41.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.663+0000 7f2676fff700 1 -- 172.21.15.132:0/270169508 wait complete. 2023-05-10T04:19:41.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:19:41.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.867+0000 7fa61f5ff700 1 Processor -- start 2023-05-10T04:19:41.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.867+0000 7fa61f5ff700 1 -- start start 2023-05-10T04:19:41.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61f5ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6180cfbf0 0x7fa6181608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61f5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa6180d1100 0x7fa6180d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61f5ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6180d0020 con 0x7fa6180b87a0 2023-05-10T04:19:41.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61f5ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6180d02d0 con 0x7fa6180cfbf0 2023-05-10T04:19:41.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61f5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6180d0cb0 con 0x7fa6180d1100 2023-05-10T04:19:41.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61cb9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6180cfbf0 0x7fa6181608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61cb9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6180cfbf0 0x7fa6181608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48508/0 (socket says 172.21.15.132:48508) 2023-05-10T04:19:41.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61cb9a700 1 -- 172.21.15.132:0/3646003947 learned_addr learned my addr 172.21.15.132:0/3646003947 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:41.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.868+0000 7fa61d39b700 1 --1- 172.21.15.132:0/3646003947 >> v1:172.21.15.132:6789/0 conn(0x7fa6180b87a0 0x7fa6181601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50890/0 (socket says 172.21.15.132:50890) 2023-05-10T04:19:41.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.869+0000 7fa61cb9a700 1 -- 172.21.15.132:0/3646003947 >> v2:172.21.15.154:3300/0 conn(0x7fa6180d1100 msgr2=0x7fa6180d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:41.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.869+0000 7fa61cb9a700 1 --2- 172.21.15.132:0/3646003947 >> v2:172.21.15.154:3300/0 conn(0x7fa6180d1100 0x7fa6180d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.869+0000 7fa61cb9a700 1 -- 172.21.15.132:0/3646003947 >> v1:172.21.15.132:6789/0 conn(0x7fa6180b87a0 legacy=0x7fa6181601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.869+0000 7fa61cb9a700 1 -- 172.21.15.132:0/3646003947 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6180cdc60 con 0x7fa6180cfbf0 2023-05-10T04:19:41.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.869+0000 7fa61cb9a700 1 --2- 172.21.15.132:0/3646003947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180cfbf0 0x7fa6181608f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa6180d0820 tx=0x7fa608009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c0e4815cb0acfa server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.869+0000 7fa60ffff700 1 -- 172.21.15.132:0/3646003947 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800b860 con 0x7fa6180cfbf0 2023-05-10T04:19:41.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.869+0000 7fa60ffff700 1 -- 172.21.15.132:0/3646003947 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa60800b9c0 con 0x7fa6180cfbf0 2023-05-10T04:19:41.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.869+0000 7fa60ffff700 1 -- 172.21.15.132:0/3646003947 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa60800bd50 con 0x7fa6180cfbf0 2023-05-10T04:19:41.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.870+0000 7fa61f5ff700 1 -- 172.21.15.132:0/3646003947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180cfbf0 msgr2=0x7fa6181608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.870+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/3646003947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180cfbf0 0x7fa6181608f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fa6180d0820 tx=0x7fa608009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:41.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.870+0000 7fa61f5ff700 1 -- 172.21.15.132:0/3646003947 shutdown_connections 2023-05-10T04:19:41.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.870+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/3646003947 >> v2:172.21.15.154:3300/0 conn(0x7fa6180d1100 0x7fa6180d1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.870+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/3646003947 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180cfbf0 0x7fa6181608f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.870+0000 7fa61f5ff700 1 -- 172.21.15.132:0/3646003947 >> 172.21.15.132:0/3646003947 conn(0x7fa618071b10 msgr2=0x7fa618071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:41.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.870+0000 7fa61f5ff700 1 -- 172.21.15.132:0/3646003947 shutdown_connections 2023-05-10T04:19:41.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.870+0000 7fa61f5ff700 1 -- 172.21.15.132:0/3646003947 wait complete. 2023-05-10T04:19:41.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.872+0000 7fa61f5ff700 1 Processor -- start 2023-05-10T04:19:41.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.872+0000 7fa61f5ff700 1 -- start start 2023-05-10T04:19:41.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61f5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6180b87a0 0x7fa618151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61f5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6180cfbf0 0x7fa61815afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61f5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180d1100 0x7fa61815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61f5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180d18a0 con 0x7fa6180d1100 2023-05-10T04:19:41.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61f5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180d1b80 con 0x7fa6180b87a0 2023-05-10T04:19:41.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61f5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180d1e60 con 0x7fa6180cfbf0 2023-05-10T04:19:41.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61db9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180d1100 0x7fa61815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61db9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180d1100 0x7fa61815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48520/0 (socket says 172.21.15.132:48520) 2023-05-10T04:19:41.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61db9c700 1 -- 172.21.15.132:0/16348152 learned_addr learned my addr 172.21.15.132:0/16348152 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:41.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61cb9a700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6180cfbf0 0x7fa61815afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61d39b700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6180b87a0 0x7fa618151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61db9c700 1 -- 172.21.15.132:0/16348152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6180cfbf0 msgr2=0x7fa61815afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61db9c700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6180cfbf0 0x7fa61815afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61db9c700 1 -- 172.21.15.132:0/16348152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6180b87a0 msgr2=0x7fa618151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:41.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61db9c700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6180b87a0 0x7fa618151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:41.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.873+0000 7fa61db9c700 1 -- 172.21.15.132:0/16348152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa608009550 con 0x7fa6180d1100 2023-05-10T04:19:41.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.874+0000 7fa61db9c700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180d1100 0x7fa61815b4e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa61000b970 tx=0x7fa61000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.874+0000 7fa60dffb700 1 -- 172.21.15.132:0/16348152 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000d860 con 0x7fa6180d1100 2023-05-10T04:19:41.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.874+0000 7fa60dffb700 1 -- 172.21.15.132:0/16348152 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61000d9e0 con 0x7fa6180d1100 2023-05-10T04:19:41.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.874+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6180cd980 con 0x7fa6180d1100 2023-05-10T04:19:41.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.874+0000 7fa60dffb700 1 -- 172.21.15.132:0/16348152 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61000dd90 con 0x7fa6180d1100 2023-05-10T04:19:41.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.874+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6180cd6a0 con 0x7fa6180d1100 2023-05-10T04:19:41.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.875+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa618160e30 con 0x7fa6180d1100 2023-05-10T04:19:41.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.876+0000 7fa60dffb700 1 -- 172.21.15.132:0/16348152 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa61000e430 con 0x7fa6180d1100 2023-05-10T04:19:41.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.877+0000 7fa60dffb700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa5fc06ace0 0x7fa5fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:41.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.877+0000 7fa60dffb700 1 -- 172.21.15.132:0/16348152 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa610006e40 con 0x7fa6180d1100 2023-05-10T04:19:41.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.877+0000 7fa61d39b700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa5fc06ace0 0x7fa5fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:41.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.878+0000 7fa61d39b700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa5fc06ace0 0x7fa5fc06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa614000f60 tx=0x7fa614007ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:41.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:41.881+0000 7fa60dffb700 1 -- 172.21.15.132:0/16348152 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa610054680 con 0x7fa6180d1100 2023-05-10T04:19:42.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.082+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6180b52f0 con 0x7fa6180d1100 2023-05-10T04:19:42.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.082+0000 7fa60dffb700 1 -- 172.21.15.132:0/16348152 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa610057ca0 con 0x7fa6180d1100 2023-05-10T04:19:42.085 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:19:42.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa5fc06ace0 msgr2=0x7fa5fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa5fc06ace0 0x7fa5fc06d190 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa614000f60 tx=0x7fa614007ed0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180d1100 msgr2=0x7fa61815b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180d1100 0x7fa61815b4e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa61000b970 tx=0x7fa61000bc80 comp rx=0 tx=0).stop 2023-05-10T04:19:42.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 shutdown_connections 2023-05-10T04:19:42.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa5fc06ace0 0x7fa5fc06d190 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6180d1100 0x7fa61815b4e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa6180b87a0 0x7fa618151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 --2- 172.21.15.132:0/16348152 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa6180cfbf0 0x7fa61815afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 >> 172.21.15.132:0/16348152 conn(0x7fa618071b10 msgr2=0x7fa6180b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:42.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 shutdown_connections 2023-05-10T04:19:42.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.085+0000 7fa61f5ff700 1 -- 172.21.15.132:0/16348152 wait complete. 2023-05-10T04:19:42.104 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:19:42.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.288+0000 7fe95e5ff700 1 Processor -- start 2023-05-10T04:19:42.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.288+0000 7fe95e5ff700 1 -- start start 2023-05-10T04:19:42.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.289+0000 7fe95e5ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe9580cd760 0x7fe9580cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.289+0000 7fe95e5ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9580cc9e0 con 0x7fe9580adf70 2023-05-10T04:19:42.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.289+0000 7fe95e5ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95815de20 con 0x7fe95815cf10 2023-05-10T04:19:42.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.289+0000 7fe95e5ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9580cd580 con 0x7fe9580cd760 2023-05-10T04:19:42.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.289+0000 7fe9577fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe9580adf70 0x7fe9580cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:50904/0 (socket says 172.21.15.132:50904) 2023-05-10T04:19:42.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.289+0000 7fe9577fe700 1 -- 172.21.15.132:0/305298095 learned_addr learned my addr 172.21.15.132:0/305298095 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:42.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe957fff700 1 --2- 172.21.15.132:0/305298095 >> v2:172.21.15.154:3300/0 conn(0x7fe9580cd760 0x7fe9580cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786770988 0 0) 0x7fe9580cc9e0 con 0x7fe9580adf70 2023-05-10T04:19:42.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9400035b0 con 0x7fe9580adf70 2023-05-10T04:19:42.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 641432735 0 0) 0x7fe9400035b0 con 0x7fe9580adf70 2023-05-10T04:19:42.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 >> v2:172.21.15.154:3300/0 conn(0x7fe9580cd760 msgr2=0x7fe9580cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:42.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 --2- 172.21.15.132:0/305298095 >> v2:172.21.15.154:3300/0 conn(0x7fe9580cd760 0x7fe9580cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 >> v1:172.21.15.154:6789/0 conn(0x7fe95815cf10 legacy=0x7fe95806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9580ce070 con 0x7fe9580adf70 2023-05-10T04:19:42.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fe94c0017f0 con 0x7fe9580adf70 2023-05-10T04:19:42.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 >> v1:172.21.15.132:6789/0 conn(0x7fe9580adf70 legacy=0x7fe9580cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940003a50 0x7fe940003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe940004850 0x7fe940004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940005200 0x7fe94000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9580cd580 con 0x7fe940005200 2023-05-10T04:19:42.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94000c0e0 con 0x7fe940004850 2023-05-10T04:19:42.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.290+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe94000c2a0 con 0x7fe940003a50 2023-05-10T04:19:42.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe95cb9c700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940005200 0x7fe94000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe957fff700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940003a50 0x7fe940003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe9577fe700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe940004850 0x7fe940004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe95cb9c700 1 -- 172.21.15.132:0/305298095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940003a50 msgr2=0x7fe940003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:42.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe95cb9c700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940003a50 0x7fe940003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe95cb9c700 1 -- 172.21.15.132:0/305298095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe940004850 msgr2=0x7fe940004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:42.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe95cb9c700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe940004850 0x7fe940004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe95cb9c700 1 -- 172.21.15.132:0/305298095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9400035b0 con 0x7fe940005200 2023-05-10T04:19:42.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe95cb9c700 1 -- 172.21.15.132:0/305298095 reap_dead start 2023-05-10T04:19:42.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.291+0000 7fe95cb9c700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940005200 0x7fe94000ba10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe950001ed0 tx=0x7fe940005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ac468317e4305b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:42.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95000cc70 con 0x7fe940005200 2023-05-10T04:19:42.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95000cdd0 con 0x7fe940005200 2023-05-10T04:19:42.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe956ffd700 1 -- 172.21.15.132:0/305298095 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950003c00 con 0x7fe940005200 2023-05-10T04:19:42.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe95e5ff700 1 -- 172.21.15.132:0/305298095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940005200 msgr2=0x7fe94000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe95e5ff700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940005200 0x7fe94000ba10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fe950001ed0 tx=0x7fe940005880 comp rx=0 tx=0).stop 2023-05-10T04:19:42.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe95e5ff700 1 -- 172.21.15.132:0/305298095 shutdown_connections 2023-05-10T04:19:42.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe95e5ff700 1 --2- 172.21.15.132:0/305298095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940005200 0x7fe94000ba10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe95e5ff700 1 -- 172.21.15.132:0/305298095 >> 172.21.15.132:0/305298095 conn(0x7fe9580cf720 msgr2=0x7fe9580cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:42.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe95e5ff700 1 -- 172.21.15.132:0/305298095 shutdown_connections 2023-05-10T04:19:42.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.292+0000 7fe95e5ff700 1 -- 172.21.15.132:0/305298095 wait complete. 2023-05-10T04:19:42.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.294+0000 7fe95e5ff700 1 Processor -- start 2023-05-10T04:19:42.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.295+0000 7fe95e5ff700 1 -- start start 2023-05-10T04:19:42.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe95e5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940005200 0x7fe95814b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe95e5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95814bfb0 0x7fe95806d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe95e5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9580b3b20 0x7fe9580b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe95e5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95814bdc0 con 0x7fe95814bfb0 2023-05-10T04:19:42.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe95e5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95806e510 con 0x7fe9580b3b20 2023-05-10T04:19:42.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe95e5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9581e4760 con 0x7fe940005200 2023-05-10T04:19:42.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe9577fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95814bfb0 0x7fe95806d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe9577fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95814bfb0 0x7fe95806d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48538/0 (socket says 172.21.15.132:48538) 2023-05-10T04:19:42.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe9577fe700 1 -- 172.21.15.132:0/995883888 learned_addr learned my addr 172.21.15.132:0/995883888 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:42.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe95cb9c700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9580b3b20 0x7fe9580b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.296+0000 7fe957fff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940005200 0x7fe95814b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe9577fe700 1 -- 172.21.15.132:0/995883888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940005200 msgr2=0x7fe95814b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe9577fe700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940005200 0x7fe95814b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe9577fe700 1 -- 172.21.15.132:0/995883888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9580b3b20 msgr2=0x7fe9580b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe9577fe700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9580b3b20 0x7fe9580b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe9577fe700 1 -- 172.21.15.132:0/995883888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95815db40 con 0x7fe95814bfb0 2023-05-10T04:19:42.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe9577fe700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95814bfb0 0x7fe95806d7a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe94c006f20 tx=0x7fe94c007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:42.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe954ff9700 1 -- 172.21.15.132:0/995883888 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c012560 con 0x7fe95814bfb0 2023-05-10T04:19:42.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe954ff9700 1 -- 172.21.15.132:0/995883888 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c0126c0 con 0x7fe95814bfb0 2023-05-10T04:19:42.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe954ff9700 1 -- 172.21.15.132:0/995883888 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c012a30 con 0x7fe95814bfb0 2023-05-10T04:19:42.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95815d860 con 0x7fe95814bfb0 2023-05-10T04:19:42.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.297+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9580cc670 con 0x7fe95814bfb0 2023-05-10T04:19:42.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.298+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe958071b50 con 0x7fe95814bfb0 2023-05-10T04:19:42.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.299+0000 7fe954ff9700 1 -- 172.21.15.132:0/995883888 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe94c012b90 con 0x7fe95814bfb0 2023-05-10T04:19:42.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.300+0000 7fe954ff9700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe94406ace0 0x7fe94406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.300+0000 7fe954ff9700 1 -- 172.21.15.132:0/995883888 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe94c089790 con 0x7fe95814bfb0 2023-05-10T04:19:42.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.300+0000 7fe957fff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe94406ace0 0x7fe94406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.301+0000 7fe957fff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe94406ace0 0x7fe94406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe948009be0 tx=0x7fe948009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:42.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.304+0000 7fe954ff9700 1 -- 172.21.15.132:0/995883888 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe94c0544b0 con 0x7fe95814bfb0 2023-05-10T04:19:42.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.500+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe9580b4a10 con 0x7fe95814bfb0 2023-05-10T04:19:42.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.501+0000 7fe954ff9700 1 -- 172.21.15.132:0/995883888 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe94c057ad0 con 0x7fe95814bfb0 2023-05-10T04:19:42.503 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:19:42.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe94406ace0 msgr2=0x7fe94406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe94406ace0 0x7fe94406d190 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe948009be0 tx=0x7fe948009210 comp rx=0 tx=0).stop 2023-05-10T04:19:42.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95814bfb0 msgr2=0x7fe95806d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95814bfb0 0x7fe95806d7a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe94c006f20 tx=0x7fe94c007320 comp rx=0 tx=0).stop 2023-05-10T04:19:42.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 shutdown_connections 2023-05-10T04:19:42.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe94406ace0 0x7fe94406d190 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9580b3b20 0x7fe9580b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe940005200 0x7fe95814b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 --2- 172.21.15.132:0/995883888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95814bfb0 0x7fe95806d7a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 >> 172.21.15.132:0/995883888 conn(0x7fe9580cf720 msgr2=0x7fe95806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:42.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 shutdown_connections 2023-05-10T04:19:42.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.503+0000 7fe95e5ff700 1 -- 172.21.15.132:0/995883888 wait complete. 2023-05-10T04:19:42.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:19:42.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.706+0000 7f75dddff700 1 Processor -- start 2023-05-10T04:19:42.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.706+0000 7f75dddff700 1 -- start start 2023-05-10T04:19:42.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.707+0000 7f75dddff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75d80b87a0 0x7f75d80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.707+0000 7f75dddff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f75d81601e0 0x7f75d8160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.707+0000 7f75dddff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75d80cdc60 con 0x7f75d8160b70 2023-05-10T04:19:42.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.707+0000 7f75dddff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d80d02d0 con 0x7f75d80b87a0 2023-05-10T04:19:42.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.707+0000 7f75dddff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75d80d0cb0 con 0x7f75d81601e0 2023-05-10T04:19:42.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d77fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75d80b87a0 0x7f75d80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d77fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75d80b87a0 0x7f75d80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41872/0 (socket says 172.21.15.132:41872) 2023-05-10T04:19:42.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d77fe700 1 -- 172.21.15.132:0/3016725992 learned_addr learned my addr 172.21.15.132:0/3016725992 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:42.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d6ffd700 1 --2- 172.21.15.132:0/3016725992 >> v2:172.21.15.154:3300/0 conn(0x7f75d81601e0 0x7f75d8160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d77fe700 1 -- 172.21.15.132:0/3016725992 >> v2:172.21.15.154:3300/0 conn(0x7f75d81601e0 msgr2=0x7f75d8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d77fe700 1 --2- 172.21.15.132:0/3016725992 >> v2:172.21.15.154:3300/0 conn(0x7f75d81601e0 0x7f75d8160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d77fe700 1 -- 172.21.15.132:0/3016725992 >> v1:172.21.15.154:6789/0 conn(0x7f75d8160b70 legacy=0x7f75d80d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d77fe700 1 -- 172.21.15.132:0/3016725992 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d80cd6a0 con 0x7f75d80b87a0 2023-05-10T04:19:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d6ffd700 1 --2- 172.21.15.132:0/3016725992 >> v2:172.21.15.154:3300/0 conn(0x7f75d81601e0 0x7f75d8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d77fe700 1 --2- 172.21.15.132:0/3016725992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d80b87a0 0x7f75d80cfbf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75d80b8f60 tx=0x7f75c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e78ffb3b9d366f1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:42.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d67fc700 1 -- 172.21.15.132:0/3016725992 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c8004230 con 0x7f75d80b87a0 2023-05-10T04:19:42.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d67fc700 1 -- 172.21.15.132:0/3016725992 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75c8004390 con 0x7f75d80b87a0 2023-05-10T04:19:42.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.708+0000 7f75d67fc700 1 -- 172.21.15.132:0/3016725992 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c80036a0 con 0x7f75d80b87a0 2023-05-10T04:19:42.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.709+0000 7f75dddff700 1 -- 172.21.15.132:0/3016725992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d80b87a0 msgr2=0x7f75d80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.709+0000 7f75dddff700 1 --2- 172.21.15.132:0/3016725992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d80b87a0 0x7f75d80cfbf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75d80b8f60 tx=0x7f75c8009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:42.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.709+0000 7f75dddff700 1 -- 172.21.15.132:0/3016725992 shutdown_connections 2023-05-10T04:19:42.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.709+0000 7f75dddff700 1 --2- 172.21.15.132:0/3016725992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d80b87a0 0x7f75d80cfbf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.709+0000 7f75dddff700 1 --2- 172.21.15.132:0/3016725992 >> v2:172.21.15.154:3300/0 conn(0x7f75d81601e0 0x7f75d8160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.709+0000 7f75dddff700 1 -- 172.21.15.132:0/3016725992 >> 172.21.15.132:0/3016725992 conn(0x7f75d8071b10 msgr2=0x7f75d8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:42.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.709+0000 7f75dddff700 1 -- 172.21.15.132:0/3016725992 shutdown_connections 2023-05-10T04:19:42.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.709+0000 7f75dddff700 1 -- 172.21.15.132:0/3016725992 wait complete. 2023-05-10T04:19:42.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.711+0000 7f75dddff700 1 Processor -- start 2023-05-10T04:19:42.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.711+0000 7f75dddff700 1 -- start start 2023-05-10T04:19:42.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75dddff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d80b87a0 0x7f75d81514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75dddff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d81601e0 0x7f75d815e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75dddff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d8160b70 0x7f75d80cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75dddff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d81f2370 con 0x7f75d8160b70 2023-05-10T04:19:42.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75dddff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d81f2650 con 0x7f75d80b87a0 2023-05-10T04:19:42.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75dddff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d81f2930 con 0x7f75d81601e0 2023-05-10T04:19:42.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75d7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d8160b70 0x7f75d80cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75d7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d8160b70 0x7f75d80cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41880/0 (socket says 172.21.15.132:41880) 2023-05-10T04:19:42.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75d7fff700 1 -- 172.21.15.132:0/3442927414 learned_addr learned my addr 172.21.15.132:0/3442927414 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:42.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75d77fe700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d80b87a0 0x7f75d81514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.712+0000 7f75d6ffd700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d81601e0 0x7f75d815e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75d7fff700 1 -- 172.21.15.132:0/3442927414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d81601e0 msgr2=0x7f75d815e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75d7fff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d81601e0 0x7f75d815e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75d7fff700 1 -- 172.21.15.132:0/3442927414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d80b87a0 msgr2=0x7f75d81514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75d7fff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d80b87a0 0x7f75d81514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75d7fff700 1 -- 172.21.15.132:0/3442927414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8009550 con 0x7f75d8160b70 2023-05-10T04:19:42.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75d7fff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d8160b70 0x7f75d80cf100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f75d000b970 tx=0x7f75d000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:42.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75bffff700 1 -- 172.21.15.132:0/3442927414 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d000d860 con 0x7f75d8160b70 2023-05-10T04:19:42.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75bffff700 1 -- 172.21.15.132:0/3442927414 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d000d9c0 con 0x7f75d8160b70 2023-05-10T04:19:42.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d8160f90 con 0x7f75d8160b70 2023-05-10T04:19:42.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75bffff700 1 -- 172.21.15.132:0/3442927414 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d000dd70 con 0x7f75d8160b70 2023-05-10T04:19:42.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.713+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d80cd980 con 0x7f75d8160b70 2023-05-10T04:19:42.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.714+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d80d2110 con 0x7f75d8160b70 2023-05-10T04:19:42.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.715+0000 7f75bffff700 1 -- 172.21.15.132:0/3442927414 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f75d000e430 con 0x7f75d8160b70 2023-05-10T04:19:42.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.716+0000 7f75bffff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f75c406ace0 0x7f75c406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:42.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.716+0000 7f75bffff700 1 -- 172.21.15.132:0/3442927414 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f75d0089620 con 0x7f75d8160b70 2023-05-10T04:19:42.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.716+0000 7f75d77fe700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f75c406ace0 0x7f75c406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:42.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.717+0000 7f75d77fe700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f75c406ace0 0x7f75c406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009130 tx=0x7f75c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:42.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.721+0000 7f75bffff700 1 -- 172.21.15.132:0/3442927414 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f75d00543f0 con 0x7f75d8160b70 2023-05-10T04:19:42.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.913+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f75d80c9f80 con 0x7f75d8160b70 2023-05-10T04:19:42.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.914+0000 7f75bffff700 1 -- 172.21.15.132:0/3442927414 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f75d80c9f80 con 0x7f75d8160b70 2023-05-10T04:19:42.916 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:19:42.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f75c406ace0 msgr2=0x7f75c406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f75c406ace0 0x7f75c406d190 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009130 tx=0x7f75c8008030 comp rx=0 tx=0).stop 2023-05-10T04:19:42.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d8160b70 msgr2=0x7f75d80cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:42.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d8160b70 0x7f75d80cf100 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f75d000b970 tx=0x7f75d000bc80 comp rx=0 tx=0).stop 2023-05-10T04:19:42.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 shutdown_connections 2023-05-10T04:19:42.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f75c406ace0 0x7f75c406d190 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75d8160b70 0x7f75d80cf100 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f75d80b87a0 0x7f75d81514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 --2- 172.21.15.132:0/3442927414 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f75d81601e0 0x7f75d815e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:42.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 >> 172.21.15.132:0/3442927414 conn(0x7f75d8071b10 msgr2=0x7f75d80b7810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:42.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 shutdown_connections 2023-05-10T04:19:42.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:42.916+0000 7f75dddff700 1 -- 172.21.15.132:0/3442927414 wait complete. 2023-05-10T04:19:42.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:19:43.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.117+0000 7f58d5dff700 1 Processor -- start 2023-05-10T04:19:43.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.117+0000 7f58d5dff700 1 -- start start 2023-05-10T04:19:43.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.118+0000 7f58d5dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 0x7f58d006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.118+0000 7f58d5dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58d0071200 0x7f58d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.118+0000 7f58d5dff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d00cb280 con 0x7f58d006a920 2023-05-10T04:19:43.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.118+0000 7f58d5dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d015a970 con 0x7f58d0071200 2023-05-10T04:19:43.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.118+0000 7f58d5dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d006ad90 con 0x7f58d015a5a0 2023-05-10T04:19:43.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.118+0000 7f58cffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58d0071200 0x7f58d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.118+0000 7f58cffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58d0071200 0x7f58d006d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41884/0 (socket says 172.21.15.132:41884) 2023-05-10T04:19:43.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.118+0000 7f58cffff700 1 -- 172.21.15.132:0/2091408865 learned_addr learned my addr 172.21.15.132:0/2091408865 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58cf7fe700 1 --2- 172.21.15.132:0/2091408865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 0x7f58d006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58cffff700 1 -- 172.21.15.132:0/2091408865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 msgr2=0x7f58d006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58cffff700 1 --2- 172.21.15.132:0/2091408865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 0x7f58d006a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58cffff700 1 -- 172.21.15.132:0/2091408865 >> v1:172.21.15.132:6789/0 conn(0x7f58d006a920 legacy=0x7f58d0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58cffff700 1 -- 172.21.15.132:0/2091408865 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d0071700 con 0x7f58d0071200 2023-05-10T04:19:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58ce7fc700 1 -- 172.21.15.132:0/2091408865 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623272000 0 0) 0x7f58c4001180 con 0x7f58d006a920 2023-05-10T04:19:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58cffff700 1 --2- 172.21.15.132:0/2091408865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d006d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009e50 tx=0x7f58c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52df32e7ab928905 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:43.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58ce7fc700 1 -- 172.21.15.132:0/2091408865 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800e070 con 0x7f58d0071200 2023-05-10T04:19:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58ce7fc700 1 -- 172.21.15.132:0/2091408865 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c800b9c0 con 0x7f58d0071200 2023-05-10T04:19:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.119+0000 7f58ce7fc700 1 -- 172.21.15.132:0/2091408865 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c800bd70 con 0x7f58d0071200 2023-05-10T04:19:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.120+0000 7f58d5dff700 1 -- 172.21.15.132:0/2091408865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 msgr2=0x7f58d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.120+0000 7f58d5dff700 1 --2- 172.21.15.132:0/2091408865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d006d1a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f58c8009e50 tx=0x7f58c800b330 comp rx=0 tx=0).stop 2023-05-10T04:19:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.120+0000 7f58d5dff700 1 -- 172.21.15.132:0/2091408865 shutdown_connections 2023-05-10T04:19:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.120+0000 7f58d5dff700 1 --2- 172.21.15.132:0/2091408865 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 0x7f58d006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.120+0000 7f58d5dff700 1 --2- 172.21.15.132:0/2091408865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d006d1a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.120+0000 7f58d5dff700 1 -- 172.21.15.132:0/2091408865 >> 172.21.15.132:0/2091408865 conn(0x7f58d00cf720 msgr2=0x7f58d00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.120+0000 7f58d5dff700 1 -- 172.21.15.132:0/2091408865 shutdown_connections 2023-05-10T04:19:43.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.120+0000 7f58d5dff700 1 -- 172.21.15.132:0/2091408865 wait complete. 2023-05-10T04:19:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.122+0000 7f58d5dff700 1 Processor -- start 2023-05-10T04:19:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.122+0000 7f58d5dff700 1 -- start start 2023-05-10T04:19:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58d5dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d006a920 0x7f58d015ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58d5dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d01f51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58d5dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 0x7f58d015c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58d5dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d015da40 con 0x7f58d0071200 2023-05-10T04:19:43.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58d5dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d015cec0 con 0x7f58d006a920 2023-05-10T04:19:43.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58d5dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d015d1a0 con 0x7f58d015a5a0 2023-05-10T04:19:43.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58ceffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d01f51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58ceffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d01f51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41900/0 (socket says 172.21.15.132:41900) 2023-05-10T04:19:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58ceffd700 1 -- 172.21.15.132:0/1029559175 learned_addr learned my addr 172.21.15.132:0/1029559175 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58cf7fe700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d006a920 0x7f58d015ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58cffff700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 0x7f58d015c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58ceffd700 1 -- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 msgr2=0x7f58d015c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58ceffd700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 0x7f58d015c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58ceffd700 1 -- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d006a920 msgr2=0x7f58d015ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58ceffd700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d006a920 0x7f58d015ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58ceffd700 1 -- 172.21.15.132:0/1029559175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8009b30 con 0x7f58d0071200 2023-05-10T04:19:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.123+0000 7f58cf7fe700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d006a920 0x7f58d015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:19:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.124+0000 7f58ceffd700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d01f51b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c780 tx=0x7f58c400cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.124+0000 7f58b7fff700 1 -- 172.21.15.132:0/1029559175 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c40054e0 con 0x7f58d0071200 2023-05-10T04:19:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.124+0000 7f58b7fff700 1 -- 172.21.15.132:0/1029559175 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c4003680 con 0x7f58d0071200 2023-05-10T04:19:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.124+0000 7f58b7fff700 1 -- 172.21.15.132:0/1029559175 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4003a30 con 0x7f58d0071200 2023-05-10T04:19:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.124+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d006c6c0 con 0x7f58d0071200 2023-05-10T04:19:43.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.124+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d00719e0 con 0x7f58d0071200 2023-05-10T04:19:43.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.125+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d006c9a0 con 0x7f58d0071200 2023-05-10T04:19:43.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.126+0000 7f58b7fff700 1 -- 172.21.15.132:0/1029559175 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58c4003b90 con 0x7f58d0071200 2023-05-10T04:19:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.127+0000 7f58b7fff700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58bc06ace0 0x7f58bc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.127+0000 7f58b7fff700 1 -- 172.21.15.132:0/1029559175 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f58c4088c60 con 0x7f58d0071200 2023-05-10T04:19:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.127+0000 7f58cf7fe700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58bc06ace0 0x7f58bc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.128+0000 7f58cf7fe700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58bc06ace0 0x7f58bc06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f58c0007a50 tx=0x7f58c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:43.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.131+0000 7f58b7fff700 1 -- 172.21.15.132:0/1029559175 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f58c4053980 con 0x7f58d0071200 2023-05-10T04:19:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.370+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58d0074430 con 0x7f58d0071200 2023-05-10T04:19:43.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.371+0000 7f58b7fff700 1 -- 172.21.15.132:0/1029559175 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f58c4017020 con 0x7f58d0071200 2023-05-10T04:19:43.374 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:43.374 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:31.478753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-10T04:19:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58bc06ace0 msgr2=0x7f58bc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58bc06ace0 0x7f58bc06d190 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f58c0007a50 tx=0x7f58c0008040 comp rx=0 tx=0).stop 2023-05-10T04:19:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 msgr2=0x7f58d01f51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d01f51b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c780 tx=0x7f58c400cb40 comp rx=0 tx=0).stop 2023-05-10T04:19:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 shutdown_connections 2023-05-10T04:19:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58bc06ace0 0x7f58bc06d190 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58d015a5a0 0x7f58d015c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58d006a920 0x7f58d015ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 --2- 172.21.15.132:0/1029559175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58d0071200 0x7f58d01f51b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 >> 172.21.15.132:0/1029559175 conn(0x7f58d00cf720 msgr2=0x7f58d0158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 shutdown_connections 2023-05-10T04:19:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.374+0000 7f58d5dff700 1 -- 172.21.15.132:0/1029559175 wait complete. 2023-05-10T04:19:43.377 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2023-05-10T04:19:43.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:43.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.575+0000 7f8b535ff700 1 Processor -- start 2023-05-10T04:19:43.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.575+0000 7f8b535ff700 1 -- start start 2023-05-10T04:19:43.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.576+0000 7f8b535ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8b4c0b87a0 0x7f8b4c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.576+0000 7f8b535ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8b4c1601e0 0x7f8b4c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.576+0000 7f8b535ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b4c0cdc60 con 0x7f8b4c160b70 2023-05-10T04:19:43.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.576+0000 7f8b535ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0d02d0 con 0x7f8b4c1601e0 2023-05-10T04:19:43.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.576+0000 7f8b535ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b4c0d0cb0 con 0x7f8b4c0b87a0 2023-05-10T04:19:43.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.576+0000 7f8b50b9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8b4c1601e0 0x7f8b4c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b50b9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8b4c1601e0 0x7f8b4c160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41916/0 (socket says 172.21.15.132:41916) 2023-05-10T04:19:43.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b50b9a700 1 -- 172.21.15.132:0/3341753064 learned_addr learned my addr 172.21.15.132:0/3341753064 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:43.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b5139b700 1 --2- 172.21.15.132:0/3341753064 >> v2:172.21.15.154:3300/0 conn(0x7f8b4c0b87a0 0x7f8b4c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b50b9a700 1 -- 172.21.15.132:0/3341753064 >> v2:172.21.15.154:3300/0 conn(0x7f8b4c0b87a0 msgr2=0x7f8b4c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:43.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b50b9a700 1 --2- 172.21.15.132:0/3341753064 >> v2:172.21.15.154:3300/0 conn(0x7f8b4c0b87a0 0x7f8b4c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b50b9a700 1 -- 172.21.15.132:0/3341753064 >> v1:172.21.15.154:6789/0 conn(0x7f8b4c160b70 legacy=0x7f8b4c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b50b9a700 1 -- 172.21.15.132:0/3341753064 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b4c0cd6a0 con 0x7f8b4c1601e0 2023-05-10T04:19:43.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b50b9a700 1 --2- 172.21.15.132:0/3341753064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c1601e0 0x7f8b4c160630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0b4ac0 tx=0x7f8b3c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b49724e58ba8a04 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:43.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b43fff700 1 -- 172.21.15.132:0/3341753064 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c011830 con 0x7f8b4c1601e0 2023-05-10T04:19:43.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b43fff700 1 -- 172.21.15.132:0/3341753064 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b3c011990 con 0x7f8b4c1601e0 2023-05-10T04:19:43.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.577+0000 7f8b43fff700 1 -- 172.21.15.132:0/3341753064 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b3c011d20 con 0x7f8b4c1601e0 2023-05-10T04:19:43.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.578+0000 7f8b535ff700 1 -- 172.21.15.132:0/3341753064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c1601e0 msgr2=0x7f8b4c160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.578+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3341753064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c1601e0 0x7f8b4c160630 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c0b4ac0 tx=0x7f8b3c009c00 comp rx=0 tx=0).stop 2023-05-10T04:19:43.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.578+0000 7f8b535ff700 1 -- 172.21.15.132:0/3341753064 shutdown_connections 2023-05-10T04:19:43.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.578+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3341753064 >> v2:172.21.15.154:3300/0 conn(0x7f8b4c0b87a0 0x7f8b4c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.578+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3341753064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c1601e0 0x7f8b4c160630 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.578+0000 7f8b535ff700 1 -- 172.21.15.132:0/3341753064 >> 172.21.15.132:0/3341753064 conn(0x7f8b4c071b10 msgr2=0x7f8b4c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:43.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.578+0000 7f8b535ff700 1 -- 172.21.15.132:0/3341753064 shutdown_connections 2023-05-10T04:19:43.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.578+0000 7f8b535ff700 1 -- 172.21.15.132:0/3341753064 wait complete. 2023-05-10T04:19:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.580+0000 7f8b535ff700 1 Processor -- start 2023-05-10T04:19:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.580+0000 7f8b535ff700 1 -- start start 2023-05-10T04:19:43.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b535ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b4c0b87a0 0x7f8b4c1516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b535ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b4c1601e0 0x7f8b4c0c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b535ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c160b70 0x7f8b4c0b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b535ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0c8300 con 0x7f8b4c160b70 2023-05-10T04:19:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b535ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c151c00 con 0x7f8b4c1601e0 2023-05-10T04:19:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b535ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4c0c7680 con 0x7f8b4c0b87a0 2023-05-10T04:19:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b51b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c160b70 0x7f8b4c0b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b51b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c160b70 0x7f8b4c0b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41928/0 (socket says 172.21.15.132:41928) 2023-05-10T04:19:43.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b51b9c700 1 -- 172.21.15.132:0/3286239123 learned_addr learned my addr 172.21.15.132:0/3286239123 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b5139b700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b4c0b87a0 0x7f8b4c1516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b50b9a700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b4c1601e0 0x7f8b4c0c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b51b9c700 1 -- 172.21.15.132:0/3286239123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b4c0b87a0 msgr2=0x7f8b4c1516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b51b9c700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b4c0b87a0 0x7f8b4c1516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b51b9c700 1 -- 172.21.15.132:0/3286239123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b4c1601e0 msgr2=0x7f8b4c0c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b51b9c700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b4c1601e0 0x7f8b4c0c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.581+0000 7f8b51b9c700 1 -- 172.21.15.132:0/3286239123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b3c009550 con 0x7f8b4c160b70 2023-05-10T04:19:43.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.582+0000 7f8b51b9c700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c160b70 0x7f8b4c0b3e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400cb50 tx=0x7f8b4400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:43.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.582+0000 7f8b41ffb700 1 -- 172.21.15.132:0/3286239123 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b44003c00 con 0x7f8b4c160b70 2023-05-10T04:19:43.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.582+0000 7f8b41ffb700 1 -- 172.21.15.132:0/3286239123 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b44003d60 con 0x7f8b4c160b70 2023-05-10T04:19:43.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.582+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b4c160f90 con 0x7f8b4c160b70 2023-05-10T04:19:43.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.582+0000 7f8b41ffb700 1 -- 172.21.15.132:0/3286239123 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4400aa20 con 0x7f8b4c160b70 2023-05-10T04:19:43.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.582+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b4c0cd980 con 0x7f8b4c160b70 2023-05-10T04:19:43.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.583+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4c0d2110 con 0x7f8b4c160b70 2023-05-10T04:19:43.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.584+0000 7f8b41ffb700 1 -- 172.21.15.132:0/3286239123 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b4400ab80 con 0x7f8b4c160b70 2023-05-10T04:19:43.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.585+0000 7f8b41ffb700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8b3006ace0 0x7f8b3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.585+0000 7f8b41ffb700 1 -- 172.21.15.132:0/3286239123 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b44089700 con 0x7f8b4c160b70 2023-05-10T04:19:43.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.585+0000 7f8b5139b700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8b3006ace0 0x7f8b3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.586+0000 7f8b5139b700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8b3006ace0 0x7f8b3006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c152210 tx=0x7f8b48009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:43.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.589+0000 7f8b41ffb700 1 -- 172.21.15.132:0/3286239123 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8b440544b0 con 0x7f8b4c160b70 2023-05-10T04:19:43.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.787+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b4c0c8440 con 0x7f8b4c160b70 2023-05-10T04:19:43.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.788+0000 7f8b41ffb700 1 -- 172.21.15.132:0/3286239123 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f8b44057ad0 con 0x7f8b4c160b70 2023-05-10T04:19:43.790 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:43.790 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:43.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8b3006ace0 msgr2=0x7f8b3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8b3006ace0 0x7f8b3006d190 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c152210 tx=0x7f8b48009210 comp rx=0 tx=0).stop 2023-05-10T04:19:43.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c160b70 msgr2=0x7f8b4c0b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c160b70 0x7f8b4c0b3e50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8b4400cb50 tx=0x7f8b4400ce60 comp rx=0 tx=0).stop 2023-05-10T04:19:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 shutdown_connections 2023-05-10T04:19:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8b3006ace0 0x7f8b3006d190 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b4c160b70 0x7f8b4c0b3e50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8b4c0b87a0 0x7f8b4c1516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 --2- 172.21.15.132:0/3286239123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8b4c1601e0 0x7f8b4c0c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 >> 172.21.15.132:0/3286239123 conn(0x7f8b4c071b10 msgr2=0x7f8b4c15b700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.790+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 shutdown_connections 2023-05-10T04:19:43.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.791+0000 7f8b535ff700 1 -- 172.21.15.132:0/3286239123 wait complete. 2023-05-10T04:19:43.810 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:19:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.990+0000 7f8535dff700 1 Processor -- start 2023-05-10T04:19:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.991+0000 7f8535dff700 1 -- start start 2023-05-10T04:19:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f8535dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85300b87a0 0x7f85300cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f8535dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8530160d40 0x7f85300d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f8535dff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85300cdc60 con 0x7f85301601e0 2023-05-10T04:19:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f8535dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300d02d0 con 0x7f85300b87a0 2023-05-10T04:19:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f8535dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85300d0cb0 con 0x7f8530160d40 2023-05-10T04:19:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85300b87a0 0x7f85300cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852effd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f85301601e0 0x7f8530160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52230/0 (socket says 172.21.15.132:52230) 2023-05-10T04:19:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852effd700 1 -- 172.21.15.132:0/3821691998 learned_addr learned my addr 172.21.15.132:0/3821691998 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852ffff700 1 --2- 172.21.15.132:0/3821691998 >> v2:172.21.15.154:3300/0 conn(0x7f8530160d40 0x7f85300d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852f7fe700 1 -- 172.21.15.132:0/3821691998 >> v2:172.21.15.154:3300/0 conn(0x7f8530160d40 msgr2=0x7f85300d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852f7fe700 1 --2- 172.21.15.132:0/3821691998 >> v2:172.21.15.154:3300/0 conn(0x7f8530160d40 0x7f85300d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852f7fe700 1 -- 172.21.15.132:0/3821691998 >> v1:172.21.15.132:6789/0 conn(0x7f85301601e0 legacy=0x7f8530160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852f7fe700 1 -- 172.21.15.132:0/3821691998 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85300cd6a0 con 0x7f85300b87a0 2023-05-10T04:19:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.992+0000 7f852e7fc700 1 -- 172.21.15.132:0/3821691998 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029912292 0 0) 0x7f85300cdc60 con 0x7f85301601e0 2023-05-10T04:19:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.993+0000 7f852f7fe700 1 --2- 172.21.15.132:0/3821691998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85300b87a0 0x7f85300cfbf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f85300d0820 tx=0x7f8520009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cc9f66a0ba9386 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.993+0000 7f852e7fc700 1 -- 172.21.15.132:0/3821691998 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520011830 con 0x7f85300b87a0 2023-05-10T04:19:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.993+0000 7f852e7fc700 1 -- 172.21.15.132:0/3821691998 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8520011990 con 0x7f85300b87a0 2023-05-10T04:19:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.993+0000 7f852e7fc700 1 -- 172.21.15.132:0/3821691998 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520011d20 con 0x7f85300b87a0 2023-05-10T04:19:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.993+0000 7f8535dff700 1 -- 172.21.15.132:0/3821691998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85300b87a0 msgr2=0x7f85300cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.993+0000 7f8535dff700 1 --2- 172.21.15.132:0/3821691998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85300b87a0 0x7f85300cfbf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f85300d0820 tx=0x7f8520009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.994+0000 7f8535dff700 1 -- 172.21.15.132:0/3821691998 shutdown_connections 2023-05-10T04:19:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.994+0000 7f8535dff700 1 --2- 172.21.15.132:0/3821691998 >> v2:172.21.15.154:3300/0 conn(0x7f8530160d40 0x7f85300d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.994+0000 7f8535dff700 1 --2- 172.21.15.132:0/3821691998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85300b87a0 0x7f85300cfbf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.994+0000 7f8535dff700 1 -- 172.21.15.132:0/3821691998 >> 172.21.15.132:0/3821691998 conn(0x7f8530071b10 msgr2=0x7f8530071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.994+0000 7f8535dff700 1 -- 172.21.15.132:0/3821691998 shutdown_connections 2023-05-10T04:19:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.994+0000 7f8535dff700 1 -- 172.21.15.132:0/3821691998 wait complete. 2023-05-10T04:19:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.995+0000 7f8535dff700 1 Processor -- start 2023-05-10T04:19:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.995+0000 7f8535dff700 1 -- start start 2023-05-10T04:19:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.996+0000 7f8535dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85300b87a0 0x7f8530157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.996+0000 7f8535dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85301601e0 0x7f8530159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.996+0000 7f8535dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8530160d40 0x7f853015cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.996+0000 7f8535dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530158240 con 0x7f85301601e0 2023-05-10T04:19:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.996+0000 7f8535dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8530157f60 con 0x7f85300b87a0 2023-05-10T04:19:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.996+0000 7f8535dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853015c0a0 con 0x7f8530160d40 2023-05-10T04:19:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.996+0000 7f852effd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85301601e0 0x7f8530159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852effd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85301601e0 0x7f8530159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41950/0 (socket says 172.21.15.132:41950) 2023-05-10T04:19:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852effd700 1 -- 172.21.15.132:0/3031616444 learned_addr learned my addr 172.21.15.132:0/3031616444 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852f7fe700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85300b87a0 0x7f8530157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852ffff700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8530160d40 0x7f853015cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852effd700 1 -- 172.21.15.132:0/3031616444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8530160d40 msgr2=0x7f853015cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852effd700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8530160d40 0x7f853015cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852effd700 1 -- 172.21.15.132:0/3031616444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85300b87a0 msgr2=0x7f8530157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852effd700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85300b87a0 0x7f8530157710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852effd700 1 -- 172.21.15.132:0/3031616444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85200094a0 con 0x7f85301601e0 2023-05-10T04:19:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f852effd700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85301601e0 0x7f8530159d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f85240011e0 tx=0x7f852400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f8517fff700 1 -- 172.21.15.132:0/3031616444 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524004c80 con 0x7f85301601e0 2023-05-10T04:19:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f8517fff700 1 -- 172.21.15.132:0/3031616444 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8524004e00 con 0x7f85301601e0 2023-05-10T04:19:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85300d1640 con 0x7f85301601e0 2023-05-10T04:19:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.997+0000 7f8517fff700 1 -- 172.21.15.132:0/3031616444 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8524007310 con 0x7f85301601e0 2023-05-10T04:19:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.998+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85300cd980 con 0x7f85301601e0 2023-05-10T04:19:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.999+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85300d17d0 con 0x7f85301601e0 2023-05-10T04:19:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:43.999+0000 7f8517fff700 1 -- 172.21.15.132:0/3031616444 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8524007470 con 0x7f85301601e0 2023-05-10T04:19:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.000+0000 7f8517fff700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f851c06ace0 0x7f851c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.000+0000 7f8517fff700 1 -- 172.21.15.132:0/3031616444 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8524089460 con 0x7f85301601e0 2023-05-10T04:19:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.000+0000 7f852f7fe700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f851c06ace0 0x7f851c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.001+0000 7f852f7fe700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f851c06ace0 0x7f851c06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f85200097c0 tx=0x7f8520008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.004+0000 7f8517fff700 1 -- 172.21.15.132:0/3031616444 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8524054180 con 0x7f85301601e0 2023-05-10T04:19:44.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.243+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8530074430 con 0x7f85301601e0 2023-05-10T04:19:44.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.243+0000 7f8517fff700 1 -- 172.21.15.132:0/3031616444 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f85240577a0 con 0x7f85301601e0 2023-05-10T04:19:44.246 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:44.246 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:31.478753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-10T04:19:44.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f851c06ace0 msgr2=0x7f851c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f851c06ace0 0x7f851c06d190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f85200097c0 tx=0x7f8520008030 comp rx=0 tx=0).stop 2023-05-10T04:19:44.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85301601e0 msgr2=0x7f8530159d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85301601e0 0x7f8530159d00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f85240011e0 tx=0x7f852400ca30 comp rx=0 tx=0).stop 2023-05-10T04:19:44.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 shutdown_connections 2023-05-10T04:19:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f851c06ace0 0x7f851c06d190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8530160d40 0x7f853015cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f85300b87a0 0x7f8530157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 --2- 172.21.15.132:0/3031616444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85301601e0 0x7f8530159d00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 >> 172.21.15.132:0/3031616444 conn(0x7f8530071b10 msgr2=0x7f85300cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 shutdown_connections 2023-05-10T04:19:44.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.246+0000 7f8535dff700 1 -- 172.21.15.132:0/3031616444 wait complete. 2023-05-10T04:19:44.250 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2023-05-10T04:19:44.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T04:19:09.944202+0000', 'modified': '2023-05-10T04:19:31.478753+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4315}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4315': {'gid': 4315, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.154:6835/36374977', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.154:6833', 'nonce': 36374977}, {'type': 'v1', 'addr': '172.21.15.154:6835', 'nonce': 36374977}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-10T04:19:44.668 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T04:19:44.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-05-10T04:19:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.852+0000 7f39ee5ff700 1 Processor -- start 2023-05-10T04:19:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.852+0000 7f39ee5ff700 1 -- start start 2023-05-10T04:19:44.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.853+0000 7f39ee5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e815c590 0x7f39e8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.853+0000 7f39ee5ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39e80cf010 0x7f39e80cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.853+0000 7f39ee5ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e80cd520 con 0x7f39e80cfd80 2023-05-10T04:19:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.853+0000 7f39ee5ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e80d2640 con 0x7f39e80cf010 2023-05-10T04:19:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.853+0000 7f39ee5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e81610d0 con 0x7f39e815c590 2023-05-10T04:19:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e77fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39e80cf010 0x7f39e80cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39ecb9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f39e80cfd80 0x7f39e80d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52238/0 (socket says 172.21.15.132:52238) 2023-05-10T04:19:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39ecb9c700 1 -- 172.21.15.132:0/442321156 learned_addr learned my addr 172.21.15.132:0/442321156 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:44.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e7fff700 1 --2- 172.21.15.132:0/442321156 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e815c590 0x7f39e8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e6ffd700 1 -- 172.21.15.132:0/442321156 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3796242582 0 0) 0x7f39e80cd520 con 0x7f39e80cfd80 2023-05-10T04:19:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e6ffd700 1 -- 172.21.15.132:0/442321156 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39d00035b0 con 0x7f39e80cfd80 2023-05-10T04:19:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e77fe700 1 -- 172.21.15.132:0/442321156 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e815c590 msgr2=0x7f39e8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e77fe700 1 --2- 172.21.15.132:0/442321156 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e815c590 0x7f39e8160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e77fe700 1 -- 172.21.15.132:0/442321156 >> v1:172.21.15.132:6789/0 conn(0x7f39e80cfd80 legacy=0x7f39e80d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e77fe700 1 -- 172.21.15.132:0/442321156 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80d0200 con 0x7f39e80cf010 2023-05-10T04:19:44.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.854+0000 7f39e77fe700 1 --2- 172.21.15.132:0/442321156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e80cf010 0x7f39e80cf840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009840 tx=0x7f39dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08e2711a717f170 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39e6ffd700 1 -- 172.21.15.132:0/442321156 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc011830 con 0x7f39e80cf010 2023-05-10T04:19:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39e6ffd700 1 -- 172.21.15.132:0/442321156 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc011990 con 0x7f39e80cf010 2023-05-10T04:19:44.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39e6ffd700 1 -- 172.21.15.132:0/442321156 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc011d20 con 0x7f39e80cf010 2023-05-10T04:19:44.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39ee5ff700 1 -- 172.21.15.132:0/442321156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e80cf010 msgr2=0x7f39e80cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/442321156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e80cf010 0x7f39e80cf840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f39dc009840 tx=0x7f39dc009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:44.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39ee5ff700 1 -- 172.21.15.132:0/442321156 shutdown_connections 2023-05-10T04:19:44.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/442321156 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e815c590 0x7f39e8160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/442321156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e80cf010 0x7f39e80cf840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39ee5ff700 1 -- 172.21.15.132:0/442321156 >> 172.21.15.132:0/442321156 conn(0x7f39e8071b10 msgr2=0x7f39e8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:44.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39ee5ff700 1 -- 172.21.15.132:0/442321156 shutdown_connections 2023-05-10T04:19:44.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.855+0000 7f39ee5ff700 1 -- 172.21.15.132:0/442321156 wait complete. 2023-05-10T04:19:44.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.857+0000 7f39ee5ff700 1 Processor -- start 2023-05-10T04:19:44.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.857+0000 7f39ee5ff700 1 -- start start 2023-05-10T04:19:44.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ee5ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e80cf010 0x7f39e80b81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ee5ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39e80cfd80 0x7f39e80c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ee5ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e815c590 0x7f39e814b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ee5ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e81566c0 con 0x7f39e815c590 2023-05-10T04:19:44.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ee5ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80c7950 con 0x7f39e80cfd80 2023-05-10T04:19:44.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ee5ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e80c8420 con 0x7f39e80cf010 2023-05-10T04:19:44.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ecb9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e815c590 0x7f39e814b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ecb9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e815c590 0x7f39e814b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41968/0 (socket says 172.21.15.132:41968) 2023-05-10T04:19:44.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.858+0000 7f39ecb9c700 1 -- 172.21.15.132:0/3801454878 learned_addr learned my addr 172.21.15.132:0/3801454878 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:44.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e80cf010 0x7f39e80b81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39e80cfd80 0x7f39e80c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39ecb9c700 1 -- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e80cf010 msgr2=0x7f39e80b81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e80cf010 0x7f39e80b81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39ecb9c700 1 -- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39e80cfd80 msgr2=0x7f39e80c7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39e80cfd80 0x7f39e80c7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39ecb9c700 1 -- 172.21.15.132:0/3801454878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc0094a0 con 0x7f39e815c590 2023-05-10T04:19:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e80cf010 0x7f39e80b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39e80cfd80 0x7f39e80c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e815c590 0x7f39e814b130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f39e000cb40 tx=0x7f39e000cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39e4ff9700 1 -- 172.21.15.132:0/3801454878 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e000ab50 con 0x7f39e815c590 2023-05-10T04:19:44.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39e4ff9700 1 -- 172.21.15.132:0/3801454878 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e000acb0 con 0x7f39e815c590 2023-05-10T04:19:44.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39ee5ff700 1 -- 172.21.15.132:0/3801454878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e80cf560 con 0x7f39e815c590 2023-05-10T04:19:44.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39e4ff9700 1 -- 172.21.15.132:0/3801454878 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0012620 con 0x7f39e815c590 2023-05-10T04:19:44.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.859+0000 7f39ee5ff700 1 -- 172.21.15.132:0/3801454878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e80b23c0 con 0x7f39e815c590 2023-05-10T04:19:44.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.861+0000 7f39e4ff9700 1 -- 172.21.15.132:0/3801454878 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f39e001b3b0 con 0x7f39e815c590 2023-05-10T04:19:44.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.862+0000 7f39e4ff9700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.862+0000 7f39e4ff9700 1 -- 172.21.15.132:0/3801454878 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39e00895f0 con 0x7f39e815c590 2023-05-10T04:19:44.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.862+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.863+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f39d406ace0 0x7f39d406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009ac0 tx=0x7f39d8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.864+0000 7f3a01e95b80 1 Processor -- start 2023-05-10T04:19:44.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.864+0000 7f3a01e95b80 1 -- start start 2023-05-10T04:19:44.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f4946c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946cb4a0 0x55f4946f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f4946f8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4945d3010 con 0x55f4946f7dc0 2023-05-10T04:19:44.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f494625850 con 0x55f4946cb4a0 2023-05-10T04:19:44.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f49461ece0 con 0x55f4946ed210 2023-05-10T04:19:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f39ecb9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f4946f8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f39ecb9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f4946f8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41978/0 (socket says 172.21.15.132:41978) 2023-05-10T04:19:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.865+0000 7f39ecb9c700 1 -- 172.21.15.132:0/2838002929 learned_addr learned my addr 172.21.15.132:0/2838002929 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39e7fff700 1 --2- 172.21.15.132:0/2838002929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f4946c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39ecb9c700 1 -- 172.21.15.132:0/2838002929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 msgr2=0x55f4946c91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/2838002929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f4946c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39ecb9c700 1 -- 172.21.15.132:0/2838002929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946cb4a0 msgr2=0x55f4946f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/2838002929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946cb4a0 0x55f4946f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39ecb9c700 1 -- 172.21.15.132:0/2838002929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f4944a05e0 con 0x55f4946f7dc0 2023-05-10T04:19:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/2838002929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f4946f8230 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f39e005fe80 tx=0x7f39e005c0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed8e4fa27e130dd server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39cdffb700 1 -- 172.21.15.132:0/2838002929 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0056400 con 0x55f4946f7dc0 2023-05-10T04:19:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39cdffb700 1 -- 172.21.15.132:0/2838002929 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e005ff20 con 0x55f4946f7dc0 2023-05-10T04:19:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.866+0000 7f39cdffb700 1 -- 172.21.15.132:0/2838002929 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0089070 con 0x55f4946f7dc0 2023-05-10T04:19:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 -- 172.21.15.132:0/2838002929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 msgr2=0x55f4946f8230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/2838002929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f4946f8230 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f39e005fe80 tx=0x7f39e005c0a0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 -- 172.21.15.132:0/2838002929 shutdown_connections 2023-05-10T04:19:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/2838002929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f4946f8230 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/2838002929 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f4946c91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/2838002929 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946cb4a0 0x55f4946f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 -- 172.21.15.132:0/2838002929 >> 172.21.15.132:0/2838002929 conn(0x55f4946c2ba0 msgr2=0x55f494712dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 -- 172.21.15.132:0/2838002929 shutdown_connections 2023-05-10T04:19:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.867+0000 7f3a01e95b80 1 -- 172.21.15.132:0/2838002929 wait complete. 2023-05-10T04:19:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.868+0000 7f3a01e95b80 1 -- start start 2023-05-10T04:19:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.868+0000 7f3a01e95b80 1 Processor -- start 2023-05-10T04:19:44.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946cb4a0 0x55f494722e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f494721c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 0x55f494716910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4945c0890 con 0x55f4946cb4a0 2023-05-10T04:19:44.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4945c0530 con 0x55f4946f7dc0 2023-05-10T04:19:44.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f4944a28d0 con 0x55f4946ed210 2023-05-10T04:19:44.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f3a01e95b80 10 client.0 _ll_register_callbacks cb 0x55f4945de730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T04:19:44.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946cb4a0 0x55f494722e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f39e7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946cb4a0 0x55f494722e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41982/0 (socket says 172.21.15.132:41982) 2023-05-10T04:19:44.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f39e7fff700 1 -- 172.21.15.132:0/3200242728 learned_addr learned my addr 172.21.15.132:0/3200242728 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:44.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f494721c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 0x55f494716910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.869+0000 7f39e7fff700 1 -- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 msgr2=0x55f494721c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f494721c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39e7fff700 1 -- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 msgr2=0x55f494716910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 0x55f494716910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39e7fff700 1 -- 172.21.15.132:0/3200242728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e80b23c0 con 0x55f4946cb4a0 2023-05-10T04:19:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f494721c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946cb4a0 0x55f494722e20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f39d80156f0 tx=0x7f39d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa6e237da02d8d6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-05-10T04:19:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3200242728 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8004230 con 0x55f4946cb4a0 2023-05-10T04:19:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3200242728 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39d8004390 con 0x55f4946cb4a0 2023-05-10T04:19:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3200242728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f4946c0360 con 0x55f4946cb4a0 2023-05-10T04:19:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3200242728 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39d8015e90 con 0x55f4946cb4a0 2023-05-10T04:19:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f3a01e95b80 10 client.4812 fetch_fsmap learned FSMap version 9 2023-05-10T04:19:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3200242728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55f4945e5140 con 0x55f4946cb4a0 2023-05-10T04:19:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.870+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3200242728 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f4946c0360 con 0x55f4946cb4a0 2023-05-10T04:19:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3200242728 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f39d80036a0 con 0x55f4946cb4a0 2023-05-10T04:19:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f3a01e95b80 10 client.4812 fetch_fsmap finished waiting for FSMap version 9 2023-05-10T04:19:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f3a01e95b80 10 client.4812 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-10T04:19:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f3a01e95b80 20 client.4812 populate_metadata read hostname 'smithi132' 2023-05-10T04:19:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f49470d3a0 0x55f49470d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f3a01e95b80 4 client.4812 mds_command: new command op to 4315 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T04:19:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3200242728 --> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f4945e1050 con 0x55f49470d3a0 2023-05-10T04:19:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f49470d3a0 0x55f49470d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f39c6ffd700 10 client.4812 ms_handle_connect on v2:172.21.15.154:6833/36374977 2023-05-10T04:19:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.871+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f49470d3a0 0x55f49470d770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8a4d5ed99211954 server_cookie=8e8b52587f6b74d7 in_seq=0 out_seq=0 2023-05-10T04:19:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.872+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3200242728 <== mds.0 v2:172.21.15.154:6833/36374977 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f4945e1050 con 0x55f49470d3a0 2023-05-10T04:19:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.872+0000 7f39c6ffd700 10 client.4812 handle_command_reply: tid=0 2023-05-10T04:19:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.872+0000 7f3a01e95b80 1 client.4812 shutdown 2023-05-10T04:19:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.872+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3200242728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946cb4a0 msgr2=0x55f494722e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.872+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946cb4a0 0x55f494722e20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f39d80156f0 tx=0x7f39d80047c0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.872+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3200242728 shutdown_connections 2023-05-10T04:19:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.872+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f49470d3a0 0x55f49470d770 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.873+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 0x55f494716910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.873+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946cb4a0 0x55f494722e20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.873+0000 7f39c6ffd700 0 client.4812 ms_handle_reset on v2:172.21.15.154:6833/36374977 2023-05-10T04:19:44.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.873+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3200242728 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946ed210 0x55f494721c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.873+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3200242728 >> 172.21.15.132:0/3200242728 conn(0x55f4946c2ba0 msgr2=0x55f4946c6d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:44.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.873+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3200242728 shutdown_connections 2023-05-10T04:19:44.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.873+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3200242728 wait complete. 2023-05-10T04:19:44.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.873+0000 7f3a01e95b80 20 client.4812 trim_cache size 0 max 16384 2023-05-10T04:19:44.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.891+0000 7f3a01e95b80 1 Processor -- start 2023-05-10T04:19:44.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.891+0000 7f3a01e95b80 1 -- start start 2023-05-10T04:19:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.891+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 0x55f4946f9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.891+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946ed210 0x55f4947168f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.891+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f494716e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.891+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4946c9d20 con 0x55f4946f7dc0 2023-05-10T04:19:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.891+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4946fbd50 con 0x55f4946ed210 2023-05-10T04:19:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.891+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f49472c070 con 0x55f4946cb4a0 2023-05-10T04:19:44.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f494716e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f494716e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41984/0 (socket says 172.21.15.132:41984) 2023-05-10T04:19:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 -- 172.21.15.132:0/3695107023 learned_addr learned my addr 172.21.15.132:0/3695107023 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 0x55f4946f9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946ed210 0x55f4947168f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 -- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 msgr2=0x55f4946f9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 0x55f4946f9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 -- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946ed210 msgr2=0x55f4947168f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946ed210 0x55f4947168f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 -- 172.21.15.132:0/3695107023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e80d1a70 con 0x55f4946f7dc0 2023-05-10T04:19:44.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946ed210 0x55f4947168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:44.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f494716e30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f39e0001560 tx=0x7f39e0089000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ec2030b0ba5e028 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ce7fc700 1 -- 172.21.15.132:0/3695107023 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0056220 con 0x55f4946f7dc0 2023-05-10T04:19:44.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.892+0000 7f39ce7fc700 1 -- 172.21.15.132:0/3695107023 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e0060090 con 0x55f4946f7dc0 2023-05-10T04:19:44.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f39ce7fc700 1 -- 172.21.15.132:0/3695107023 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e0089070 con 0x55f4946f7dc0 2023-05-10T04:19:44.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3695107023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 msgr2=0x55f494716e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f494716e30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f39e0001560 tx=0x7f39e0089000 comp rx=0 tx=0).stop 2023-05-10T04:19:44.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3695107023 shutdown_connections 2023-05-10T04:19:44.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946f7dc0 0x55f494716e30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 0x55f4946f9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3695107023 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946ed210 0x55f4947168f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3695107023 >> 172.21.15.132:0/3695107023 conn(0x55f4946c2ba0 msgr2=0x55f4946f84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:44.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3695107023 shutdown_connections 2023-05-10T04:19:44.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.893+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3695107023 wait complete. 2023-05-10T04:19:44.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.894+0000 7f3a01e95b80 1 -- start start 2023-05-10T04:19:44.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.894+0000 7f3a01e95b80 1 Processor -- start 2023-05-10T04:19:44.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 0x55f494716880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946ed210 0x55f494716dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f3a01e95b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 0x55f494712ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4946ce150 con 0x55f4946ed210 2023-05-10T04:19:44.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f4946ce640 con 0x55f4946f7dc0 2023-05-10T04:19:44.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f3a01e95b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f49477a570 con 0x55f4946cb4a0 2023-05-10T04:19:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f3a01e95b80 10 client.0 _ll_register_callbacks cb 0x7f39d8010be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T04:19:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39e77fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946ed210 0x55f494716dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39e77fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946ed210 0x55f494716dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42000/0 (socket says 172.21.15.132:42000) 2023-05-10T04:19:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39e77fe700 1 -- 172.21.15.132:0/3418324077 learned_addr learned my addr 172.21.15.132:0/3418324077 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 0x55f494716880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39ecb9c700 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 0x55f494712ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39e77fe700 1 -- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 msgr2=0x55f494716880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 0x55f494716880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39e77fe700 1 -- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 msgr2=0x55f494712ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:44.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.895+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 0x55f494712ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f39e77fe700 1 -- 172.21.15.132:0/3418324077 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e006f040 con 0x55f4946ed210 2023-05-10T04:19:44.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f39e77fe700 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946ed210 0x55f494716dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39e8072710 tx=0x7f39dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f18ce26bea9a8120 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:44.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f39c6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-05-10T04:19:44.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3418324077 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc020040 con 0x55f4946ed210 2023-05-10T04:19:44.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3418324077 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f39dc028bd0 con 0x55f4946ed210 2023-05-10T04:19:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3418324077 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39e005ff20 con 0x55f4946ed210 2023-05-10T04:19:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3418324077 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39dc009300 con 0x55f4946ed210 2023-05-10T04:19:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f3a01e95b80 10 client.4818 fetch_fsmap learned FSMap version 9 2023-05-10T04:19:44.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3418324077 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55f49444cd90 con 0x55f4946ed210 2023-05-10T04:19:44.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3418324077 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39e005ff20 con 0x55f4946ed210 2023-05-10T04:19:44.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.896+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3418324077 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f39dc004040 con 0x55f4946ed210 2023-05-10T04:19:44.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f3a01e95b80 10 client.4818 fetch_fsmap finished waiting for FSMap version 9 2023-05-10T04:19:44.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f3a01e95b80 10 client.4818 resolve_mds: resolved name 'b' to daemon mds.b 2023-05-10T04:19:44.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f3a01e95b80 20 client.4818 populate_metadata read hostname 'smithi132' 2023-05-10T04:19:44.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f494713530 0x55f494714240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:44.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f3a01e95b80 4 client.4818 mds_command: new command op to 4315 tid=0[{"prefix": "status"}] 2023-05-10T04:19:44.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3418324077 --> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f4945ed610 con 0x55f494713530 2023-05-10T04:19:44.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f494713530 0x55f494714240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f39c6ffd700 10 client.4818 ms_handle_connect on v2:172.21.15.154:6833/36374977 2023-05-10T04:19:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.897+0000 7f39e7fff700 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f494713530 0x55f494714240 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5eab0a56e3f2c41 server_cookie=fae7a96712aa8046 in_seq=0 out_seq=0 2023-05-10T04:19:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f39c6ffd700 1 -- 172.21.15.132:0/3418324077 <== mds.0 v2:172.21.15.154:6833/36374977 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55f4945ed610 con 0x55f494713530 2023-05-10T04:19:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f39c6ffd700 10 client.4818 handle_command_reply: tid=0 2023-05-10T04:19:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 client.4818 shutdown 2023-05-10T04:19:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3418324077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946ed210 msgr2=0x55f494716dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946ed210 0x55f494716dc0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f39e8072710 tx=0x7f39dc0047c0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3418324077 shutdown_connections 2023-05-10T04:19:44.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:6833/36374977,v1:172.21.15.154:6835/36374977] conn(0x55f494713530 0x55f494714240 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x55f4946f7dc0 0x55f494712ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f39c6ffd700 0 client.4818 ms_handle_reset on v2:172.21.15.154:6833/36374977 2023-05-10T04:19:44.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x55f4946cb4a0 0x55f494716880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 --2- 172.21.15.132:0/3418324077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55f4946ed210 0x55f494716dc0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3418324077 >> 172.21.15.132:0/3418324077 conn(0x55f4946c2ba0 msgr2=0x55f4946f4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:44.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3418324077 shutdown_connections 2023-05-10T04:19:44.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 1 -- 172.21.15.132:0/3418324077 wait complete. 2023-05-10T04:19:44.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.898+0000 7f3a01e95b80 20 client.4818 trim_cache size 0 max 16384 2023-05-10T04:19:44.909 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-05-10T04:19:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "390ee88e-3ece-4689-996a-1bc273e3e6b7", 2023-05-10T04:19:44.909 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-05-10T04:19:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4315, 2023-05-10T04:19:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-05-10T04:19:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-05-10T04:19:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-05-10T04:19:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 34.950583072999997, 2023-05-10T04:19:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 9, 2023-05-10T04:19:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 28, 2023-05-10T04:19:44.910 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 28, 2023-05-10T04:19:44.911 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 40.277190069 2023-05-10T04:19:44.911 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-05-10T04:19:44.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 -- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f39d406ace0 msgr2=0x7f39d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f39d406ace0 0x7f39d406d190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009ac0 tx=0x7f39d8008040 comp rx=0 tx=0).stop 2023-05-10T04:19:44.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 -- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e815c590 msgr2=0x7f39e814b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:44.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e815c590 0x7f39e814b130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f39e000cb40 tx=0x7f39e000cf00 comp rx=0 tx=0).stop 2023-05-10T04:19:44.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 -- 172.21.15.132:0/3801454878 shutdown_connections 2023-05-10T04:19:44.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f39d406ace0 0x7f39d406d190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39e815c590 0x7f39e814b130 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f39e80cf010 0x7f39e80b81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 --2- 172.21.15.132:0/3801454878 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39e80cfd80 0x7f39e80c7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:44.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 -- 172.21.15.132:0/3801454878 >> 172.21.15.132:0/3801454878 conn(0x7f39e8071b10 msgr2=0x7f39e80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:44.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 -- 172.21.15.132:0/3801454878 shutdown_connections 2023-05-10T04:19:44.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:44.899+0000 7f39ee5ff700 1 -- 172.21.15.132:0/3801454878 wait complete. 2023-05-10T04:19:44.917 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-05-10T04:19:44.928 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-05-10T04:19:44.928 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-05-10T04:19:44.929 INFO:tasks.ceph_fuse:client.0 config is {} 2023-05-10T04:19:44.929 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-10T04:19:44.929 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T04:19:44.929 INFO:tasks.ceph_fuse:client.2 config is {} 2023-05-10T04:19:44.929 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-10T04:19:44.930 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-10T04:19:44.930 INFO:tasks.ceph_fuse:client.1 config is {} 2023-05-10T04:19:44.930 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-10T04:19:44.930 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-10T04:19:44.930 INFO:tasks.ceph_fuse:client.3 config is {} 2023-05-10T04:19:44.931 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-10T04:19:44.931 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-10T04:19:44.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:44.931 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-05-10T04:19:44.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:44.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link delete ceph-brx 2023-05-10T04:19:45.084 INFO:teuthology.orchestra.run.smithi154.stderr:Cannot find device "ceph-brx" 2023-05-10T04:19:45.087 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T04:19:45.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:45.088 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-05-10T04:19:45.127 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-05-10T04:19:45.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:45.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-05-10T04:19:45.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:45.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-05-10T04:19:45.348 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-05-10T04:19:45.349 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-10T04:19:45.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.532+0000 7fe74bdff700 1 Processor -- start 2023-05-10T04:19:45.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.532+0000 7fe74bdff700 1 -- start start 2023-05-10T04:19:45.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.533+0000 7fe74bdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe74415c590 0x7fe744160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.533+0000 7fe74bdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7440cf010 0x7fe7440cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.533+0000 7fe74bdff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7440cfd80 0x7fe7440d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.533+0000 7fe74bdff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7440cd520 con 0x7fe7440cfd80 2023-05-10T04:19:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74bdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7440d2640 con 0x7fe74415c590 2023-05-10T04:19:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74bdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7441610d0 con 0x7fe7440cf010 2023-05-10T04:19:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74a39c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7440cfd80 0x7fe7440d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74a39c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7440cfd80 0x7fe7440d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42010/0 (socket says 172.21.15.132:42010) 2023-05-10T04:19:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74a39c700 1 -- 172.21.15.132:0/3734506349 learned_addr learned my addr 172.21.15.132:0/3734506349 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe749b9b700 1 --2- 172.21.15.132:0/3734506349 >> v2:172.21.15.154:3300/0 conn(0x7fe74415c590 0x7fe744160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74939a700 1 --2- 172.21.15.132:0/3734506349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7440cf010 0x7fe7440cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74a39c700 1 -- 172.21.15.132:0/3734506349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7440cf010 msgr2=0x7fe7440cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74a39c700 1 --2- 172.21.15.132:0/3734506349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7440cf010 0x7fe7440cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74a39c700 1 -- 172.21.15.132:0/3734506349 >> v2:172.21.15.154:3300/0 conn(0x7fe74415c590 msgr2=0x7fe744160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74a39c700 1 --2- 172.21.15.132:0/3734506349 >> v2:172.21.15.154:3300/0 conn(0x7fe74415c590 0x7fe744160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.534+0000 7fe74a39c700 1 -- 172.21.15.132:0/3734506349 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7440d0200 con 0x7fe7440cfd80 2023-05-10T04:19:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74a39c700 1 --2- 172.21.15.132:0/3734506349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 0x7fe7440d0aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7440d0a50 tx=0x7fe73c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1038822a1af1706e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe748b99700 1 -- 172.21.15.132:0/3734506349 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00e070 con 0x7fe7440cfd80 2023-05-10T04:19:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe748b99700 1 -- 172.21.15.132:0/3734506349 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73c00b910 con 0x7fe7440cfd80 2023-05-10T04:19:45.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe748b99700 1 -- 172.21.15.132:0/3734506349 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73c00bcc0 con 0x7fe7440cfd80 2023-05-10T04:19:45.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74bdff700 1 -- 172.21.15.132:0/3734506349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 msgr2=0x7fe7440d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:45.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74bdff700 1 --2- 172.21.15.132:0/3734506349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 0x7fe7440d0aa0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe7440d0a50 tx=0x7fe73c00b330 comp rx=0 tx=0).stop 2023-05-10T04:19:45.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74bdff700 1 -- 172.21.15.132:0/3734506349 shutdown_connections 2023-05-10T04:19:45.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74bdff700 1 --2- 172.21.15.132:0/3734506349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 0x7fe7440d0aa0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74bdff700 1 --2- 172.21.15.132:0/3734506349 >> v2:172.21.15.154:3300/0 conn(0x7fe74415c590 0x7fe744160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74bdff700 1 --2- 172.21.15.132:0/3734506349 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe7440cf010 0x7fe7440cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74bdff700 1 -- 172.21.15.132:0/3734506349 >> 172.21.15.132:0/3734506349 conn(0x7fe744071b10 msgr2=0x7fe744071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:45.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.535+0000 7fe74bdff700 1 -- 172.21.15.132:0/3734506349 shutdown_connections 2023-05-10T04:19:45.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.536+0000 7fe74bdff700 1 -- 172.21.15.132:0/3734506349 wait complete. 2023-05-10T04:19:45.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.537+0000 7fe74bdff700 1 Processor -- start 2023-05-10T04:19:45.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.537+0000 7fe74bdff700 1 -- start start 2023-05-10T04:19:45.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.538+0000 7fe74bdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7440cf010 0x7fe74415ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:45.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.538+0000 7fe74bdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 0x7fe744157dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:45.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.538+0000 7fe74bdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74415c590 0x7fe7440c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:45.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.538+0000 7fe74bdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe744158970 con 0x7fe7440cfd80 2023-05-10T04:19:45.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.538+0000 7fe74bdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b6d50 con 0x7fe7440cf010 2023-05-10T04:19:45.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.538+0000 7fe74bdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7440b6fa0 con 0x7fe74415c590 2023-05-10T04:19:45.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe749b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7440cf010 0x7fe74415ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:45.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe74939a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 0x7fe744157dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:45.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe749b9b700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7440cf010 0x7fe74415ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:40692/0 (socket says 172.21.15.132:40692) 2023-05-10T04:19:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe749b9b700 1 -- 172.21.15.132:0/1987637043 learned_addr learned my addr 172.21.15.132:0/1987637043 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe74a39c700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74415c590 0x7fe7440c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe74939a700 1 -- 172.21.15.132:0/1987637043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74415c590 msgr2=0x7fe7440c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe74939a700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74415c590 0x7fe7440c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe74939a700 1 -- 172.21.15.132:0/1987637043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7440cf010 msgr2=0x7fe74415ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe74939a700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7440cf010 0x7fe74415ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe74939a700 1 -- 172.21.15.132:0/1987637043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73c009b30 con 0x7fe7440cfd80 2023-05-10T04:19:45.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe74939a700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 0x7fe744157dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe73400e900 tx=0x7fe73400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.539+0000 7fe73a7fc700 1 -- 172.21.15.132:0/1987637043 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734013680 con 0x7fe7440cfd80 2023-05-10T04:19:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.540+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7440cf560 con 0x7fe7440cfd80 2023-05-10T04:19:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.540+0000 7fe73a7fc700 1 -- 172.21.15.132:0/1987637043 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7340137e0 con 0x7fe7440cfd80 2023-05-10T04:19:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.540+0000 7fe73a7fc700 1 -- 172.21.15.132:0/1987637043 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734013b50 con 0x7fe7440cfd80 2023-05-10T04:19:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.540+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7440b23c0 con 0x7fe7440cfd80 2023-05-10T04:19:45.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.541+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7440cd770 con 0x7fe7440cfd80 2023-05-10T04:19:45.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.542+0000 7fe73a7fc700 1 -- 172.21.15.132:0/1987637043 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe734013cb0 con 0x7fe7440cfd80 2023-05-10T04:19:45.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.543+0000 7fe73a7fc700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe72806ace0 0x7fe72806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:45.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.543+0000 7fe73a7fc700 1 -- 172.21.15.132:0/1987637043 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe734089a50 con 0x7fe7440cfd80 2023-05-10T04:19:45.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.543+0000 7fe749b9b700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe72806ace0 0x7fe72806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:45.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.544+0000 7fe749b9b700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe72806ace0 0x7fe72806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe740009b80 tx=0x7fe740009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:45.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.547+0000 7fe73a7fc700 1 -- 172.21.15.132:0/1987637043 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe734054790 con 0x7fe7440cfd80 2023-05-10T04:19:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.786+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe744074430 con 0x7fe7440cfd80 2023-05-10T04:19:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.787+0000 7fe73a7fc700 1 -- 172.21.15.132:0/1987637043 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fe734057db0 con 0x7fe7440cfd80 2023-05-10T04:19:45.789 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-10T04:19:45.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe72806ace0 msgr2=0x7fe72806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:45.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe72806ace0 0x7fe72806d190 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe740009b80 tx=0x7fe740009210 comp rx=0 tx=0).stop 2023-05-10T04:19:45.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 msgr2=0x7fe744157dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:45.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 0x7fe744157dc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe73400e900 tx=0x7fe73400ec10 comp rx=0 tx=0).stop 2023-05-10T04:19:45.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 shutdown_connections 2023-05-10T04:19:45.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe72806ace0 0x7fe72806d190 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe74415c590 0x7fe7440c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe7440cf010 0x7fe74415ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 --2- 172.21.15.132:0/1987637043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7440cfd80 0x7fe744157dc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:45.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 >> 172.21.15.132:0/1987637043 conn(0x7fe744071b10 msgr2=0x7fe7440d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:45.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 shutdown_connections 2023-05-10T04:19:45.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:45.789+0000 7fe74bdff700 1 -- 172.21.15.132:0/1987637043 wait complete. 2023-05-10T04:19:45.808 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T04:19:45.808 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T04:19:45.809 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-05-10T04:19:45.809 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T04:19:45.809 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T04:19:45.809 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T04:19:45.809 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T04:19:45.810 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T04:19:45.810 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T04:19:45.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:45.810 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-05-10T04:19:45.849 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:45.850 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-05-10T04:19:45.851 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-05-10T04:19:45.851 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:45.851 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T04:19:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-10T04:19:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42157sec preferred_lft 42157sec 2023-05-10T04:19:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::829d:7347:a1a9:23a0/64 scope link noprefixroute 2023-05-10T04:19:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:45.852 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-10T04:19:45.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:45.853 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:45.853 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:45.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2023-05-10T04:19:45.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2023-05-10T04:19:45.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2023-05-10T04:19:45.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-10T04:19:45.854 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:46.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:46.071 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T04:19:46.130 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-05-10T04:19:46.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:46.133 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-05-10T04:19:46.175 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-05-10T04:19:46.175 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T04:19:46.176 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-10T04:19:46.176 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-10T04:19:46.176 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T04:19:46.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:46.177 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:46.177 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:46.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-10T04:19:46.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-10T04:19:46.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-10T04:19:46.178 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:46.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:46.367 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-05-10T04:19:46.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:46.406 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-05-10T04:19:46.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:46.486 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:46.486 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:46.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T04:19:46.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-10T04:19:46.487 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:46.651 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-10T04:19:46.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:46.652 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:46.652 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:46.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-10T04:19:46.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-10T04:19:46.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-10T04:19:46.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-10T04:19:46.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-10T04:19:46.654 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:46.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:46.873 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:46.873 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:46.873 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-05-10T04:19:46.874 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2023-05-10T04:19:46.874 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:47.038 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-10T04:19:47.038 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:47.038 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-10T04:19:47.077 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-10T04:19:47.078 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:47.078 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-10T04:19:47.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:19:47.257 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:47.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:47.317 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:47.319 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:47.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:47.320 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:19:47.359 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-10T04:19:47.359 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-10T04:19:47.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:19:47.466 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:47.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:47.528 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:47.530 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:47.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:47.531 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:19:47.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-05-10T04:19:47.560+0000 7f84bf0d75c0 -1 init, newargv = 0x564a6eccf2d0 newargc=15 2023-05-10T04:19:47.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[138896]: starting ceph client 2023-05-10T04:19:47.570 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[138896]: starting fuse 2023-05-10T04:19:47.571 INFO:teuthology.orchestra.run.smithi132.stdout:43 2023-05-10T04:19:47.572 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-10T04:19:47.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-10T04:19:47.573 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-05-10T04:19:47.573 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-05-10T04:19:47.573 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-05-10T04:19:47.573 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-05-10T04:19:47.574 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:47.574 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-05-10T04:19:47.574 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-10T04:19:47.574 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-05-10T04:19:47.574 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-10T04:19:47.575 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:47.575 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-05-10T04:19:47.575 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-05-10T04:19:47.575 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-05-10T04:19:47.576 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-05-10T04:19:47.576 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:47.576 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-05-10T04:19:47.576 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-10T04:19:47.576 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-10T04:19:47.577 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-10T04:19:47.577 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-05-10T04:19:47.577 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-05-10T04:19:47.577 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-05-10T04:19:47.578 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-10T04:19:47.579 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:47.579 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-05-10T04:19:47.579 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-05-10T04:19:47.746 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.138896.asok 2023-05-10T04:19:47.924 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.138896.asok 2023-05-10T04:19:47.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:47.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.138896.asok status 2023-05-10T04:19:48.137 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-05-10T04:19:48.137 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-05-10T04:19:48.137 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "2ef5137fbb6e28908d2161218e7b594628c1b6d3", 2023-05-10T04:19:48.137 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.0.0-3851-g2ef5137f (2ef5137fbb6e28908d2161218e7b594628c1b6d3) reef (dev)", 2023-05-10T04:19:48.138 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-05-10T04:19:48.138 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-05-10T04:19:48.138 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-10T04:19:48.138 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "138896", 2023-05-10T04:19:48.138 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-05-10T04:19:48.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:48.138 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-05-10T04:19:48.139 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-05-10T04:19:48.139 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4830, 2023-05-10T04:19:48.139 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-05-10T04:19:48.139 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-05-10T04:19:48.139 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-05-10T04:19:48.139 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 4830 2023-05-10T04:19:48.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:48.139 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-05-10T04:19:48.140 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-05-10T04:19:48.140 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-05-10T04:19:48.140 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3004670989 2023-05-10T04:19:48.140 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:19:48.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:48.140 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-05-10T04:19:48.140 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-05-10T04:19:48.140 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-05-10T04:19:48.141 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3004670989 2023-05-10T04:19:48.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:48.141 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.4830 192.168.0.1:0/3004670989", 2023-05-10T04:19:48.141 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3004670989", 2023-05-10T04:19:48.141 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-05-10T04:19:48.141 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 9, 2023-05-10T04:19:48.141 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 28, 2023-05-10T04:19:48.141 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-05-10T04:19:48.142 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-05-10T04:19:48.142 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-05-10T04:19:48.142 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-05-10T04:19:48.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-10T04:19:48.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.333+0000 7f28f25ff700 1 Processor -- start 2023-05-10T04:19:48.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.333+0000 7f28f25ff700 1 -- start start 2023-05-10T04:19:48.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.334+0000 7f28f25ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28ec0b87a0 0x7f28ec0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:48.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.334+0000 7f28f25ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:48.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.334+0000 7f28f25ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec160ff0 con 0x7f28ec160b70 2023-05-10T04:19:48.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.334+0000 7f28f25ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec0d02d0 con 0x7f28ec0b87a0 2023-05-10T04:19:48.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.334+0000 7f28f25ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0d0cb0 con 0x7f28ec1601e0 2023-05-10T04:19:48.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28eb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28ebfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28ec0b87a0 0x7f28ec0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28eb7fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:52862/0 (socket says 172.21.15.132:52862) 2023-05-10T04:19:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28ebfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f28ec0b87a0 0x7f28ec0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:40708/0 (socket says 172.21.15.132:40708) 2023-05-10T04:19:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28eb7fe700 1 -- 172.21.15.132:0/94340771 learned_addr learned my addr 172.21.15.132:0/94340771 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28f0b9c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f28ec160b70 0x7f28ec0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:46330/0 (socket says 172.21.15.132:46330) 2023-05-10T04:19:48.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28eaffd700 1 -- 172.21.15.132:0/94340771 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898542518 0 0) 0x7f28ec160ff0 con 0x7f28ec160b70 2023-05-10T04:19:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28eaffd700 1 -- 172.21.15.132:0/94340771 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d40035b0 con 0x7f28ec160b70 2023-05-10T04:19:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28ebfff700 1 -- 172.21.15.132:0/94340771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 msgr2=0x7f28ec160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28ebfff700 1 --2- 172.21.15.132:0/94340771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28ebfff700 1 -- 172.21.15.132:0/94340771 >> v1:172.21.15.154:6789/0 conn(0x7f28ec160b70 legacy=0x7f28ec0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28ebfff700 1 -- 172.21.15.132:0/94340771 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0cdc60 con 0x7f28ec0b87a0 2023-05-10T04:19:48.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28eb7fe700 1 --2- 172.21.15.132:0/94340771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.335+0000 7f28ebfff700 1 --2- 172.21.15.132:0/94340771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 0x7f28ec0cfbf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009840 tx=0x7f28dc009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd0754e22491e42f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28eaffd700 1 -- 172.21.15.132:0/94340771 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc011830 con 0x7f28ec0b87a0 2023-05-10T04:19:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28eaffd700 1 -- 172.21.15.132:0/94340771 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc011990 con 0x7f28ec0b87a0 2023-05-10T04:19:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28eaffd700 1 -- 172.21.15.132:0/94340771 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc011d20 con 0x7f28ec0b87a0 2023-05-10T04:19:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28f25ff700 1 -- 172.21.15.132:0/94340771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 msgr2=0x7f28ec0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:48.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28f25ff700 1 --2- 172.21.15.132:0/94340771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 0x7f28ec0cfbf0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f28dc009840 tx=0x7f28dc009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:48.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28f25ff700 1 -- 172.21.15.132:0/94340771 shutdown_connections 2023-05-10T04:19:48.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28f25ff700 1 --2- 172.21.15.132:0/94340771 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 0x7f28ec0cfbf0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28f25ff700 1 --2- 172.21.15.132:0/94340771 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28f25ff700 1 -- 172.21.15.132:0/94340771 >> 172.21.15.132:0/94340771 conn(0x7f28ec071b10 msgr2=0x7f28ec071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:48.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28f25ff700 1 -- 172.21.15.132:0/94340771 shutdown_connections 2023-05-10T04:19:48.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.336+0000 7f28f25ff700 1 -- 172.21.15.132:0/94340771 wait complete. 2023-05-10T04:19:48.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.339+0000 7f28f25ff700 1 Processor -- start 2023-05-10T04:19:48.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.339+0000 7f28f25ff700 1 -- start start 2023-05-10T04:19:48.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f25ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 0x7f28ec1f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:48.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f25ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec1f1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:48.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f25ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28ec160b70 0x7f28ec1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:48.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f25ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0c81c0 con 0x7f28ec160b70 2023-05-10T04:19:48.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f25ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0c8990 con 0x7f28ec0b87a0 2023-05-10T04:19:48.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f25ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec1f6530 con 0x7f28ec1601e0 2023-05-10T04:19:48.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f0b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28ec160b70 0x7f28ec1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:48.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f0b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28ec160b70 0x7f28ec1f2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42026/0 (socket says 172.21.15.132:42026) 2023-05-10T04:19:48.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28f0b9c700 1 -- 172.21.15.132:0/239508055 learned_addr learned my addr 172.21.15.132:0/239508055 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:48.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.340+0000 7f28ebfff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 0x7f28ec1f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:48.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28eb7fe700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec1f1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:48.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28f0b9c700 1 -- 172.21.15.132:0/239508055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 msgr2=0x7f28ec1f1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:48.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28f0b9c700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec1f1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28f0b9c700 1 -- 172.21.15.132:0/239508055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 msgr2=0x7f28ec1f5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:48.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28f0b9c700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 0x7f28ec1f5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28f0b9c700 1 -- 172.21.15.132:0/239508055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e0009550 con 0x7f28ec160b70 2023-05-10T04:19:48.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28f0b9c700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28ec160b70 0x7f28ec1f2a10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f28e400cbc0 tx=0x7f28e400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:48.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28e8ff9700 1 -- 172.21.15.132:0/239508055 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e400aa40 con 0x7f28ec160b70 2023-05-10T04:19:48.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28e8ff9700 1 -- 172.21.15.132:0/239508055 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e400aba0 con 0x7f28ec160b70 2023-05-10T04:19:48.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28dc0094a0 con 0x7f28ec160b70 2023-05-10T04:19:48.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28e8ff9700 1 -- 172.21.15.132:0/239508055 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4007070 con 0x7f28ec160b70 2023-05-10T04:19:48.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.341+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec0cd980 con 0x7f28ec160b70 2023-05-10T04:19:48.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.342+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec0d2110 con 0x7f28ec160b70 2023-05-10T04:19:48.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.343+0000 7f28e8ff9700 1 -- 172.21.15.132:0/239508055 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f28e40071d0 con 0x7f28ec160b70 2023-05-10T04:19:48.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.345+0000 7f28e8ff9700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f28d806ace0 0x7f28d806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:48.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.345+0000 7f28e8ff9700 1 -- 172.21.15.132:0/239508055 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f28e4089640 con 0x7f28ec160b70 2023-05-10T04:19:48.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.345+0000 7f28ebfff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f28d806ace0 0x7f28d806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:48.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.346+0000 7f28ebfff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f28d806ace0 0x7f28d806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28dc000c00 tx=0x7f28dc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:48.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.349+0000 7f28e8ff9700 1 -- 172.21.15.132:0/239508055 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f28e40542d0 con 0x7f28ec160b70 2023-05-10T04:19:48.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.590+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f28ec074430 con 0x7f28ec160b70 2023-05-10T04:19:48.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.590+0000 7f28e8ff9700 1 -- 172.21.15.132:0/239508055 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f28e4017070 con 0x7f28ec160b70 2023-05-10T04:19:48.593 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-10T04:19:48.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.592+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f28d806ace0 msgr2=0x7f28d806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.592+0000 7f28f25ff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f28d806ace0 0x7f28d806d190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f28dc000c00 tx=0x7f28dc008030 comp rx=0 tx=0).stop 2023-05-10T04:19:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.592+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28ec160b70 msgr2=0x7f28ec1f2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.592+0000 7f28f25ff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28ec160b70 0x7f28ec1f2a10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f28e400cbc0 tx=0x7f28e400ced0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.593+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 shutdown_connections 2023-05-10T04:19:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.593+0000 7f28f25ff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f28d806ace0 0x7f28d806d190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.593+0000 7f28f25ff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28ec160b70 0x7f28ec1f2a10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.593+0000 7f28f25ff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f28ec0b87a0 0x7f28ec1f5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.593+0000 7f28f25ff700 1 --2- 172.21.15.132:0/239508055 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f28ec1601e0 0x7f28ec1f1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.593+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 >> 172.21.15.132:0/239508055 conn(0x7f28ec071b10 msgr2=0x7f28ec06bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.593+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 shutdown_connections 2023-05-10T04:19:48.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:48.593+0000 7f28f25ff700 1 -- 172.21.15.132:0/239508055 wait complete. 2023-05-10T04:19:48.612 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T04:19:48.612 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T04:19:48.613 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-05-10T04:19:48.613 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-05-10T04:19:48.613 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-05-10T04:19:48.613 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T04:19:48.613 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T04:19:48.613 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T04:19:48.614 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-05-10T04:19:48.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:48.614 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-05-10T04:19:48.653 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:48.653 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:48.654 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:48.654 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:48.654 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:48.654 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:48.654 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:48.654 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:48.654 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-05-10T04:19:48.655 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:48.655 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:48.655 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-05-10T04:19:48.655 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:48.655 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:48.655 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T04:19:48.655 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:48.655 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-10T04:19:48.656 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42154sec preferred_lft 42154sec 2023-05-10T04:19:48.656 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::829d:7347:a1a9:23a0/64 scope link noprefixroute 2023-05-10T04:19:48.656 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:48.656 INFO:teuthology.orchestra.run.smithi132.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T04:19:48.656 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 2a:41:a2:a8:ee:31 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:48.656 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T04:19:48.656 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:48.657 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::6063:3aff:fec3:e05d/64 scope link 2023-05-10T04:19:48.657 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:48.657 INFO:teuthology.orchestra.run.smithi132.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T04:19:48.657 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 2a:41:a2:a8:ee:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T04:19:48.657 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::2841:a2ff:fea8:ee31/64 scope link tentative 2023-05-10T04:19:48.657 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:48.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:48.658 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T04:19:48.752 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-05-10T04:19:48.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:48.755 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-05-10T04:19:48.796 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-05-10T04:19:48.797 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T04:19:48.797 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-10T04:19:48.797 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-10T04:19:48.797 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T04:19:48.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:48.798 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:48.798 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:48.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-10T04:19:48.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-10T04:19:48.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-10T04:19:48.799 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:48.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:48.989 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-05-10T04:19:49.028 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T04:19:49.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:49.029 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-05-10T04:19:49.106 INFO:teuthology.orchestra.run.smithi132.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-05-10T04:19:49.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:49.107 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:49.107 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:49.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T04:19:49.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-05-10T04:19:49.108 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:49.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:49.272 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-10T04:19:49.333 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:49.334 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:49.334 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:49.334 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:49.334 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:49.334 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:49.334 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T04:19:49.335 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 7e:e3:b8:3f:bc:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-10T04:19:49.335 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-10T04:19:49.335 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:49.335 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::7ce3:b8ff:fe3f:bc00/64 scope link 2023-05-10T04:19:49.335 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:49.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:49.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-05-10T04:19:49.398 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:49.398 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:49.398 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:49.398 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:49.398 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:49.399 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:49.399 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T04:19:49.399 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 7e:e3:b8:3f:bc:00 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-10T04:19:49.399 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-10T04:19:49.399 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:49.399 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::7ce3:b8ff:fe3f:bc00/64 scope link 2023-05-10T04:19:49.399 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:49.401 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-05-10T04:19:49.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:49.401 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:49.402 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:49.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-05-10T04:19:49.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-10T04:19:49.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-05-10T04:19:49.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-05-10T04:19:49.403 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-05-10T04:19:49.403 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:49.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:49.626 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:19:49.626 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:19:49.626 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.1 up 2023-05-10T04:19:49.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.1 master ceph-brx 2023-05-10T04:19:49.627 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:19:49.790 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-05-10T04:19:49.791 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:49.791 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-05-10T04:19:49.829 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-05-10T04:19:49.830 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:49.830 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-05-10T04:19:49.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:19:50.009 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:50.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:50.069 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:50.071 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:50.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:50.072 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:19:50.110 INFO:teuthology.orchestra.run.smithi132.stdout:43 2023-05-10T04:19:50.111 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-05-10T04:19:50.111 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-05-10T04:19:50.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:19:50.216 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:50.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:50.284 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:50.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:50.285 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:19:50.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:2023-05-10T04:19:50.312+0000 7f818f5005c0 -1 init, newargv = 0x555f9bd78490 newargc=15 2023-05-10T04:19:50.315 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:ceph-fuse[139550]: starting ceph client 2023-05-10T04:19:50.324 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:ceph-fuse[139550]: starting fuse 2023-05-10T04:19:50.327 INFO:teuthology.orchestra.run.smithi132.stdout:43 2023-05-10T04:19:50.327 INFO:teuthology.orchestra.run.smithi132.stdout:44 2023-05-10T04:19:50.327 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-05-10T04:19:50.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-10T04:19:50.328 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-05-10T04:19:50.328 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-05-10T04:19:50.328 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-05-10T04:19:50.329 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-05-10T04:19:50.329 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:50.329 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-05-10T04:19:50.329 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-05-10T04:19:50.330 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-05-10T04:19:50.330 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-05-10T04:19:50.330 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:50.330 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-05-10T04:19:50.330 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-05-10T04:19:50.331 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-05-10T04:19:50.331 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-05-10T04:19:50.332 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:50.333 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-05-10T04:19:50.333 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-10T04:19:50.333 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-10T04:19:50.334 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-10T04:19:50.334 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-05-10T04:19:50.334 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-05-10T04:19:50.334 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-05-10T04:19:50.335 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-10T04:19:50.335 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:19:50.335 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.2")) 2023-05-10T04:19:50.335 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-05-10T04:19:50.502 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.2.139550.asok 2023-05-10T04:19:50.680 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.139550.asok 2023-05-10T04:19:50.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:50.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.139550.asok status 2023-05-10T04:19:50.894 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-05-10T04:19:50.894 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-05-10T04:19:50.894 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "2ef5137fbb6e28908d2161218e7b594628c1b6d3", 2023-05-10T04:19:50.894 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.0.0-3851-g2ef5137f (2ef5137fbb6e28908d2161218e7b594628c1b6d3) reef (dev)", 2023-05-10T04:19:50.895 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "2", 2023-05-10T04:19:50.895 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-05-10T04:19:50.895 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-05-10T04:19:50.895 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "139550", 2023-05-10T04:19:50.895 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-05-10T04:19:50.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:50.895 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-05-10T04:19:50.895 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-05-10T04:19:50.896 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4839, 2023-05-10T04:19:50.896 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-05-10T04:19:50.896 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-05-10T04:19:50.896 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-05-10T04:19:50.896 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 4839 2023-05-10T04:19:50.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:50.896 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-05-10T04:19:50.897 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-05-10T04:19:50.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.2:0", 2023-05-10T04:19:50.897 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 115288893 2023-05-10T04:19:50.897 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:19:50.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:50.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-05-10T04:19:50.897 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-05-10T04:19:50.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.2:0", 2023-05-10T04:19:50.898 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 115288893 2023-05-10T04:19:50.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:19:50.898 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.4839 192.168.0.2:0/115288893", 2023-05-10T04:19:50.898 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.2:0/115288893", 2023-05-10T04:19:50.898 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-05-10T04:19:50.898 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 9, 2023-05-10T04:19:50.898 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 28, 2023-05-10T04:19:50.898 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-05-10T04:19:50.899 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-05-10T04:19:50.899 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-05-10T04:19:50.899 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-05-10T04:19:50.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-10T04:19:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.089+0000 7fbebbdff700 1 Processor -- start 2023-05-10T04:19:51.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.089+0000 7fbebbdff700 1 -- start start 2023-05-10T04:19:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.090+0000 7fbebbdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40b87a0 0x7fbeb40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.090+0000 7fbebbdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbeb4160d40 0x7fbeb40d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.090+0000 7fbebbdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb40cdc60 con 0x7fbeb41601e0 2023-05-10T04:19:51.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.090+0000 7fbebbdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb40d02d0 con 0x7fbeb4160d40 2023-05-10T04:19:51.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.090+0000 7fbebbdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40d0cb0 con 0x7fbeb40b87a0 2023-05-10T04:19:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeba39c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbeb4160d40 0x7fbeb40d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:51.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeb9b9b700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40b87a0 0x7fbeb40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeba39c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbeb4160d40 0x7fbeb40d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:40726/0 (socket says 172.21.15.132:40726) 2023-05-10T04:19:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeba39c700 1 -- 172.21.15.132:0/1044146593 learned_addr learned my addr 172.21.15.132:0/1044146593 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeb939a700 1 --1- 172.21.15.132:0/1044146593 >> v1:172.21.15.154:6789/0 conn(0x7fbeb41601e0 0x7fbeb4160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:46340/0 (socket says 172.21.15.132:46340) 2023-05-10T04:19:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeb9b9b700 1 -- 172.21.15.132:0/1044146593 >> v2:172.21.15.154:3300/0 conn(0x7fbeb4160d40 msgr2=0x7fbeb40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeb9b9b700 1 --2- 172.21.15.132:0/1044146593 >> v2:172.21.15.154:3300/0 conn(0x7fbeb4160d40 0x7fbeb40d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeb9b9b700 1 -- 172.21.15.132:0/1044146593 >> v1:172.21.15.154:6789/0 conn(0x7fbeb41601e0 legacy=0x7fbeb4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:51.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeb9b9b700 1 -- 172.21.15.132:0/1044146593 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb40cd6a0 con 0x7fbeb40b87a0 2023-05-10T04:19:51.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeba39c700 1 --2- 172.21.15.132:0/1044146593 >> v2:172.21.15.154:3300/0 conn(0x7fbeb4160d40 0x7fbeb40d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:19:51.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.091+0000 7fbeb9b9b700 1 --2- 172.21.15.132:0/1044146593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40b87a0 0x7fbeb40cfbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009840 tx=0x7fbeb0009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c950f0189c5807f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:51.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbeb8b99700 1 -- 172.21.15.132:0/1044146593 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0011830 con 0x7fbeb40b87a0 2023-05-10T04:19:51.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbeb8b99700 1 -- 172.21.15.132:0/1044146593 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb0011990 con 0x7fbeb40b87a0 2023-05-10T04:19:51.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbeb8b99700 1 -- 172.21.15.132:0/1044146593 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0011d20 con 0x7fbeb40b87a0 2023-05-10T04:19:51.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbebbdff700 1 -- 172.21.15.132:0/1044146593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40b87a0 msgr2=0x7fbeb40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbebbdff700 1 --2- 172.21.15.132:0/1044146593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40b87a0 0x7fbeb40cfbf0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fbeb0009840 tx=0x7fbeb0009b50 comp rx=0 tx=0).stop 2023-05-10T04:19:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbebbdff700 1 -- 172.21.15.132:0/1044146593 shutdown_connections 2023-05-10T04:19:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbebbdff700 1 --2- 172.21.15.132:0/1044146593 >> v2:172.21.15.154:3300/0 conn(0x7fbeb4160d40 0x7fbeb40d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbebbdff700 1 --2- 172.21.15.132:0/1044146593 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb40b87a0 0x7fbeb40cfbf0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbebbdff700 1 -- 172.21.15.132:0/1044146593 >> 172.21.15.132:0/1044146593 conn(0x7fbeb4071b10 msgr2=0x7fbeb4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbebbdff700 1 -- 172.21.15.132:0/1044146593 shutdown_connections 2023-05-10T04:19:51.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.092+0000 7fbebbdff700 1 -- 172.21.15.132:0/1044146593 wait complete. 2023-05-10T04:19:51.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.094+0000 7fbebbdff700 1 Processor -- start 2023-05-10T04:19:51.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.094+0000 7fbebbdff700 1 -- start start 2023-05-10T04:19:51.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbebbdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40b87a0 0x7fbeb40cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:51.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbebbdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeb41601e0 0x7fbeb4151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:51.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbebbdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb4160d40 0x7fbeb40d2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:51.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbebbdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4151c90 con 0x7fbeb41601e0 2023-05-10T04:19:51.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbebbdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb41f5e00 con 0x7fbeb40b87a0 2023-05-10T04:19:51.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbebbdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb41f60e0 con 0x7fbeb4160d40 2023-05-10T04:19:51.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbeb939a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeb41601e0 0x7fbeb4151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:51.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbeb939a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeb41601e0 0x7fbeb4151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42034/0 (socket says 172.21.15.132:42034) 2023-05-10T04:19:51.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.095+0000 7fbeb939a700 1 -- 172.21.15.132:0/3244746190 learned_addr learned my addr 172.21.15.132:0/3244746190 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:51.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeb9b9b700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40b87a0 0x7fbeb40cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:51.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeba39c700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb4160d40 0x7fbeb40d2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:51.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeb939a700 1 -- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb4160d40 msgr2=0x7fbeb40d2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:51.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeb939a700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb4160d40 0x7fbeb40d2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeb939a700 1 -- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40b87a0 msgr2=0x7fbeb40cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:51.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeb939a700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40b87a0 0x7fbeb40cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeb939a700 1 -- 172.21.15.132:0/3244746190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac009b30 con 0x7fbeb41601e0 2023-05-10T04:19:51.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeba39c700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb4160d40 0x7fbeb40d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:51.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeb9b9b700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40b87a0 0x7fbeb40cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:51.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeb939a700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeb41601e0 0x7fbeb4151750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c520 tx=0x7fbea400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:51.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeaa7fc700 1 -- 172.21.15.132:0/3244746190 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea4005cb0 con 0x7fbeb41601e0 2023-05-10T04:19:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeaa7fc700 1 -- 172.21.15.132:0/3244746190 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea4005e10 con 0x7fbeb41601e0 2023-05-10T04:19:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb00094a0 con 0x7fbeb41601e0 2023-05-10T04:19:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbeaa7fc700 1 -- 172.21.15.132:0/3244746190 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea40072d0 con 0x7fbeb41601e0 2023-05-10T04:19:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.096+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb40d1640 con 0x7fbeb41601e0 2023-05-10T04:19:51.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.097+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb40cd980 con 0x7fbeb41601e0 2023-05-10T04:19:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.098+0000 7fbeaa7fc700 1 -- 172.21.15.132:0/3244746190 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbea4007430 con 0x7fbeb41601e0 2023-05-10T04:19:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.099+0000 7fbeaa7fc700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbe9806ace0 0x7fbe9806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.099+0000 7fbeaa7fc700 1 -- 172.21.15.132:0/3244746190 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbea4088c10 con 0x7fbeb41601e0 2023-05-10T04:19:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.100+0000 7fbeb9b9b700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbe9806ace0 0x7fbe9806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:51.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.100+0000 7fbeb9b9b700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbe9806ace0 0x7fbe9806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00090b0 tx=0x7fbeb0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:51.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.104+0000 7fbeaa7fc700 1 -- 172.21.15.132:0/3244746190 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbea40539e0 con 0x7fbeb41601e0 2023-05-10T04:19:51.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.341+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbeb40d17d0 con 0x7fbeb41601e0 2023-05-10T04:19:51.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.341+0000 7fbeaa7fc700 1 -- 172.21.15.132:0/3244746190 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbea4017070 con 0x7fbeb41601e0 2023-05-10T04:19:51.344 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-10T04:19:51.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbe9806ace0 msgr2=0x7fbe9806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:51.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbe9806ace0 0x7fbe9806d190 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbeb00090b0 tx=0x7fbeb0008030 comp rx=0 tx=0).stop 2023-05-10T04:19:51.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeb41601e0 msgr2=0x7fbeb4151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:51.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeb41601e0 0x7fbeb4151750 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbea400c520 tx=0x7fbea400c8e0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 shutdown_connections 2023-05-10T04:19:51.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbe9806ace0 0x7fbe9806d190 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbeb4160d40 0x7fbeb40d2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbeb40b87a0 0x7fbeb40cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 --2- 172.21.15.132:0/3244746190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeb41601e0 0x7fbeb4151750 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:51.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 >> 172.21.15.132:0/3244746190 conn(0x7fbeb4071b10 msgr2=0x7fbeb40b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:51.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 shutdown_connections 2023-05-10T04:19:51.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:51.344+0000 7fbebbdff700 1 -- 172.21.15.132:0/3244746190 wait complete. 2023-05-10T04:19:51.363 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T04:19:51.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T04:19:51.364 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-05-10T04:19:51.364 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-05-10T04:19:51.364 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-05-10T04:19:51.364 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T04:19:51.365 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T04:19:51.365 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T04:19:51.365 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-05-10T04:19:51.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:51.365 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-05-10T04:19:51.411 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:51.412 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:51.413 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:51.413 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-05-10T04:19:51.414 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:51.414 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-05-10T04:19:51.414 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:51.415 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T04:19:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:51.415 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-10T04:19:51.416 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42155sec preferred_lft 42155sec 2023-05-10T04:19:51.416 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::733a:826e:e143:5eaa/64 scope link noprefixroute 2023-05-10T04:19:51.417 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:51.417 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-10T04:19:51.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:51.418 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:51.418 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:51.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add name ceph-brx type bridge 2023-05-10T04:19:51.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr flush dev ceph-brx 2023-05-10T04:19:51.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set ceph-brx up 2023-05-10T04:19:51.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-10T04:19:51.420 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:51.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:51.938 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T04:19:52.001 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-05-10T04:19:52.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:52.005 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-05-10T04:19:52.054 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-05-10T04:19:52.054 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T04:19:52.054 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-10T04:19:52.055 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-10T04:19:52.055 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T04:19:52.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:52.056 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:52.056 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:52.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-10T04:19:52.056 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-10T04:19:52.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-10T04:19:52.057 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:52.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:52.734 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-05-10T04:19:52.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:52.774 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-05-10T04:19:52.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:52.853 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:52.853 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:52.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-10T04:19:52.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-05-10T04:19:52.854 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:53.019 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-05-10T04:19:53.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:53.020 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:53.020 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:53.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-05-10T04:19:53.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-10T04:19:53.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-05-10T04:19:53.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-05-10T04:19:53.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-05-10T04:19:53.022 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:53.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:53.275 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:53.275 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:53.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.0 up 2023-05-10T04:19:53.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.0 master ceph-brx 2023-05-10T04:19:53.276 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:53.442 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-05-10T04:19:53.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:53.443 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-05-10T04:19:53.482 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-05-10T04:19:53.483 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:53.483 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-05-10T04:19:53.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-05-10T04:19:53.663 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:53.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:53.722 INFO:teuthology.orchestra.run.smithi154.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:53.724 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:53.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:53.725 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-05-10T04:19:53.764 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-10T04:19:53.764 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-05-10T04:19:53.808 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-05-10T04:19:53.870 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:53.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:53.931 INFO:teuthology.orchestra.run.smithi154.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:53.933 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:53.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:53.934 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-05-10T04:19:53.971 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:2023-05-10T04:19:53.969+0000 7fe0815cd5c0 -1 init, newargv = 0x564f5e7937b0 newargc=15 2023-05-10T04:19:53.972 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:ceph-fuse[133516]: starting ceph client 2023-05-10T04:19:53.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi154.stderr:ceph-fuse[133516]: starting fuse 2023-05-10T04:19:55.076 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-05-10T04:19:55.146 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:55.147 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:55.210 INFO:teuthology.orchestra.run.smithi154.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:55.212 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:55.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:55.213 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-05-10T04:19:55.252 INFO:teuthology.orchestra.run.smithi154.stdout:42 2023-05-10T04:19:55.253 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42] 2023-05-10T04:19:55.253 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-10T04:19:55.253 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2023-05-10T04:19:55.254 DEBUG:teuthology.orchestra.run.smithi154:> import re 2023-05-10T04:19:55.254 DEBUG:teuthology.orchestra.run.smithi154:> import os 2023-05-10T04:19:55.254 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2023-05-10T04:19:55.254 DEBUG:teuthology.orchestra.run.smithi154:> 2023-05-10T04:19:55.255 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2023-05-10T04:19:55.255 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-05-10T04:19:55.255 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2023-05-10T04:19:55.255 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-05-10T04:19:55.256 DEBUG:teuthology.orchestra.run.smithi154:> 2023-05-10T04:19:55.256 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2023-05-10T04:19:55.256 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2023-05-10T04:19:55.257 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2023-05-10T04:19:55.257 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2023-05-10T04:19:55.257 DEBUG:teuthology.orchestra.run.smithi154:> 2023-05-10T04:19:55.257 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2023-05-10T04:19:55.258 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-10T04:19:55.258 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-10T04:19:55.258 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-10T04:19:55.259 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2023-05-10T04:19:55.259 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2023-05-10T04:19:55.259 DEBUG:teuthology.orchestra.run.smithi154:> return f 2023-05-10T04:19:55.259 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-10T04:19:55.260 DEBUG:teuthology.orchestra.run.smithi154:> 2023-05-10T04:19:55.260 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.1")) 2023-05-10T04:19:55.260 DEBUG:teuthology.orchestra.run.smithi154:> ' 2023-05-10T04:19:55.425 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.1.133516.asok 2023-05-10T04:19:55.604 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.133516.asok 2023-05-10T04:19:55.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:55.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.133516.asok status 2023-05-10T04:19:55.818 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-05-10T04:19:55.818 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2023-05-10T04:19:55.819 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "2ef5137fbb6e28908d2161218e7b594628c1b6d3", 2023-05-10T04:19:55.819 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.0.0-3851-g2ef5137f (2ef5137fbb6e28908d2161218e7b594628c1b6d3) reef (dev)", 2023-05-10T04:19:55.819 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "1", 2023-05-10T04:19:55.819 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2023-05-10T04:19:55.819 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-05-10T04:19:55.819 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "133516", 2023-05-10T04:19:55.819 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2023-05-10T04:19:55.820 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-05-10T04:19:55.820 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2023-05-10T04:19:55.820 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2023-05-10T04:19:55.820 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4822, 2023-05-10T04:19:55.820 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2023-05-10T04:19:55.820 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2023-05-10T04:19:55.820 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2023-05-10T04:19:55.821 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4822 2023-05-10T04:19:55.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-05-10T04:19:55.821 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-05-10T04:19:55.821 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-05-10T04:19:55.821 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2023-05-10T04:19:55.821 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 3938849182 2023-05-10T04:19:55.821 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-05-10T04:19:55.821 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-05-10T04:19:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-05-10T04:19:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-05-10T04:19:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.1:0", 2023-05-10T04:19:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 3938849182 2023-05-10T04:19:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-05-10T04:19:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4822 192.168.0.1:0/3938849182", 2023-05-10T04:19:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.1:0/3938849182", 2023-05-10T04:19:55.822 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2023-05-10T04:19:55.823 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 9, 2023-05-10T04:19:55.823 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 28, 2023-05-10T04:19:55.823 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2023-05-10T04:19:55.823 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2023-05-10T04:19:55.823 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2023-05-10T04:19:55.823 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-05-10T04:19:55.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-10T04:19:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.024+0000 7f07ad7ff700 1 Processor -- start 2023-05-10T04:19:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.025+0000 7f07ad7ff700 1 -- start start 2023-05-10T04:19:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07ad7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f07a80cf010 0x7f07a8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07ad7ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07a80cff50 0x7f07a80d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07ad7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a80cd520 con 0x7f07a815c590 2023-05-10T04:19:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07ad7ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a80d2640 con 0x7f07a80cff50 2023-05-10T04:19:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07ad7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a81610d0 con 0x7f07a80cf010 2023-05-10T04:19:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07a77fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07a80cff50 0x7f07a80d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07a77fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07a80cff50 0x7f07a80d2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44810/0 (socket says 172.21.15.132:44810) 2023-05-10T04:19:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07a77fe700 1 -- 172.21.15.132:0/586230284 learned_addr learned my addr 172.21.15.132:0/586230284 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f079ffff700 1 --2- 172.21.15.132:0/586230284 >> v2:172.21.15.154:3300/0 conn(0x7f07a80cf010 0x7f07a8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07a77fe700 1 -- 172.21.15.132:0/586230284 >> v2:172.21.15.154:3300/0 conn(0x7f07a80cf010 msgr2=0x7f07a8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07a77fe700 1 --2- 172.21.15.132:0/586230284 >> v2:172.21.15.154:3300/0 conn(0x7f07a80cf010 0x7f07a8160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.026+0000 7f07a77fe700 1 -- 172.21.15.132:0/586230284 >> v1:172.21.15.154:6789/0 conn(0x7f07a815c590 legacy=0x7f07a80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.027+0000 7f07a77fe700 1 -- 172.21.15.132:0/586230284 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a80b23c0 con 0x7f07a80cff50 2023-05-10T04:19:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.027+0000 7f07a77fe700 1 --2- 172.21.15.132:0/586230284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80cff50 0x7f07a80d2ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f07a80b4ee0 tx=0x7f07a000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d00ca21a9a9dd10e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.027+0000 7f07a67fc700 1 -- 172.21.15.132:0/586230284 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000e070 con 0x7f07a80cff50 2023-05-10T04:19:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.027+0000 7f07a67fc700 1 -- 172.21.15.132:0/586230284 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a000b9c0 con 0x7f07a80cff50 2023-05-10T04:19:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.027+0000 7f07a67fc700 1 -- 172.21.15.132:0/586230284 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a000bd70 con 0x7f07a80cff50 2023-05-10T04:19:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.027+0000 7f07ad7ff700 1 -- 172.21.15.132:0/586230284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80cff50 msgr2=0x7f07a80d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.027+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/586230284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80cff50 0x7f07a80d2ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f07a80b4ee0 tx=0x7f07a000b330 comp rx=0 tx=0).stop 2023-05-10T04:19:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.028+0000 7f07ad7ff700 1 -- 172.21.15.132:0/586230284 shutdown_connections 2023-05-10T04:19:56.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.028+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/586230284 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80cff50 0x7f07a80d2ad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.028+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/586230284 >> v2:172.21.15.154:3300/0 conn(0x7f07a80cf010 0x7f07a8160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.028+0000 7f07ad7ff700 1 -- 172.21.15.132:0/586230284 >> 172.21.15.132:0/586230284 conn(0x7f07a8071b10 msgr2=0x7f07a8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:56.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.028+0000 7f07ad7ff700 1 -- 172.21.15.132:0/586230284 shutdown_connections 2023-05-10T04:19:56.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.028+0000 7f07ad7ff700 1 -- 172.21.15.132:0/586230284 wait complete. 2023-05-10T04:19:56.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.029+0000 7f07ad7ff700 1 Processor -- start 2023-05-10T04:19:56.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.029+0000 7f07ad7ff700 1 -- start start 2023-05-10T04:19:56.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.030+0000 7f07ad7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07a80cf010 0x7f07a8155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:56.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.030+0000 7f07ad7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07a80cff50 0x7f07a80c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:56.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.030+0000 7f07ad7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815c590 0x7f07a80c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:56.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.030+0000 7f07ad7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81e7980 con 0x7f07a815c590 2023-05-10T04:19:56.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.030+0000 7f07ad7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81e6d70 con 0x7f07a80cf010 2023-05-10T04:19:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.030+0000 7f07ad7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81e7050 con 0x7f07a80cff50 2023-05-10T04:19:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815c590 0x7f07a80c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815c590 0x7f07a80c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44812/0 (socket says 172.21.15.132:44812) 2023-05-10T04:19:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 -- 172.21.15.132:0/1716777134 learned_addr learned my addr 172.21.15.132:0/1716777134 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f079ffff700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07a80cff50 0x7f07a80c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a6ffd700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07a80cf010 0x7f07a8155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:56.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 -- 172.21.15.132:0/1716777134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07a80cff50 msgr2=0x7f07a80c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07a80cff50 0x7f07a80c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 -- 172.21.15.132:0/1716777134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07a80cf010 msgr2=0x7f07a8155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07a80cf010 0x7f07a8155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 -- 172.21.15.132:0/1716777134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0009b30 con 0x7f07a815c590 2023-05-10T04:19:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.031+0000 7f07a77fe700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815c590 0x7f07a80c6f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f07a8072710 tx=0x7f07a0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.032+0000 7f079f7fe700 1 -- 172.21.15.132:0/1716777134 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0004840 con 0x7f07a815c590 2023-05-10T04:19:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.032+0000 7f079f7fe700 1 -- 172.21.15.132:0/1716777134 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a00099b0 con 0x7f07a815c590 2023-05-10T04:19:56.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.032+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a80cd770 con 0x7f07a815c590 2023-05-10T04:19:56.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.032+0000 7f079f7fe700 1 -- 172.21.15.132:0/1716777134 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a001c680 con 0x7f07a815c590 2023-05-10T04:19:56.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.032+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a80cf560 con 0x7f07a815c590 2023-05-10T04:19:56.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.033+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a815c960 con 0x7f07a815c590 2023-05-10T04:19:56.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.034+0000 7f079f7fe700 1 -- 172.21.15.132:0/1716777134 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07a001c7e0 con 0x7f07a815c590 2023-05-10T04:19:56.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.035+0000 7f079f7fe700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f078806ace0 0x7f078806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:56.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.035+0000 7f079f7fe700 1 -- 172.21.15.132:0/1716777134 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07a008ad30 con 0x7f07a815c590 2023-05-10T04:19:56.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.035+0000 7f07a6ffd700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f078806ace0 0x7f078806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:56.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.035+0000 7f07a6ffd700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f078806ace0 0x7f078806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f0798009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:56.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.039+0000 7f079f7fe700 1 -- 172.21.15.132:0/1716777134 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f07a0055a50 con 0x7f07a815c590 2023-05-10T04:19:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.279+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f07a81600f0 con 0x7f07a815c590 2023-05-10T04:19:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.279+0000 7f079f7fe700 1 -- 172.21.15.132:0/1716777134 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f07a0059070 con 0x7f07a815c590 2023-05-10T04:19:56.281 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-05-10T04:19:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f078806ace0 msgr2=0x7f078806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f078806ace0 0x7f078806d190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f0798009040 comp rx=0 tx=0).stop 2023-05-10T04:19:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815c590 msgr2=0x7f07a80c6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815c590 0x7f07a80c6f40 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f07a8072710 tx=0x7f07a0004ad0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 shutdown_connections 2023-05-10T04:19:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f078806ace0 0x7f078806d190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815c590 0x7f07a80c6f40 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f07a80cf010 0x7f07a8155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 --2- 172.21.15.132:0/1716777134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f07a80cff50 0x7f07a80c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 >> 172.21.15.132:0/1716777134 conn(0x7f07a8071b10 msgr2=0x7f07a80b3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 shutdown_connections 2023-05-10T04:19:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:56.282+0000 7f07ad7ff700 1 -- 172.21.15.132:0/1716777134 wait complete. 2023-05-10T04:19:56.301 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T04:19:56.301 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T04:19:56.302 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi154.front.sepia.ceph.com 2023-05-10T04:19:56.302 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-05-10T04:19:56.302 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-05-10T04:19:56.302 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T04:19:56.302 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T04:19:56.303 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T04:19:56.303 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-05-10T04:19:56.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:56.303 DEBUG:teuthology.orchestra.run.smithi154:> ip addr 2023-05-10T04:19:56.344 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:56.344 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:56.344 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:56.344 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:56.345 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:56.345 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:56.345 INFO:teuthology.orchestra.run.smithi154.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:56.345 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:54 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:56.345 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f0 2023-05-10T04:19:56.345 INFO:teuthology.orchestra.run.smithi154.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:56.345 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:d9:1a:55 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:56.346 INFO:teuthology.orchestra.run.smithi154.stdout: altname enp7s0f1 2023-05-10T04:19:56.346 INFO:teuthology.orchestra.run.smithi154.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:19:56.346 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:60 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:56.346 INFO:teuthology.orchestra.run.smithi154.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T04:19:56.346 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 0c:c4:7a:88:77:61 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:56.346 INFO:teuthology.orchestra.run.smithi154.stdout: inet 172.21.15.154/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-10T04:19:56.346 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft 42150sec preferred_lft 42150sec 2023-05-10T04:19:56.346 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::733a:826e:e143:5eaa/64 scope link noprefixroute 2023-05-10T04:19:56.347 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:56.347 INFO:teuthology.orchestra.run.smithi154.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T04:19:56.347 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether de:12:00:4b:4e:db brd ff:ff:ff:ff:ff:ff 2023-05-10T04:19:56.347 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T04:19:56.347 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:56.347 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::a068:52ff:fe58:8fda/64 scope link 2023-05-10T04:19:56.347 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:56.347 INFO:teuthology.orchestra.run.smithi154.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T04:19:56.348 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether de:12:00:4b:4e:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-05-10T04:19:56.348 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::dc12:ff:fe4b:4edb/64 scope link 2023-05-10T04:19:56.348 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:56.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:56.349 DEBUG:teuthology.orchestra.run.smithi154:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T04:19:56.448 INFO:teuthology.orchestra.run.smithi154.stdout:1 2023-05-10T04:19:56.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:56.452 DEBUG:teuthology.orchestra.run.smithi154:> route 2023-05-10T04:19:56.493 INFO:teuthology.orchestra.run.smithi154.stdout:Kernel IP routing table 2023-05-10T04:19:56.493 INFO:teuthology.orchestra.run.smithi154.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T04:19:56.493 INFO:teuthology.orchestra.run.smithi154.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-10T04:19:56.493 INFO:teuthology.orchestra.run.smithi154.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-10T04:19:56.493 INFO:teuthology.orchestra.run.smithi154.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T04:19:56.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:56.494 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:56.494 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:56.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-10T04:19:56.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-10T04:19:56.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-10T04:19:56.496 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:56.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:56.687 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list 2023-05-10T04:19:56.725 INFO:teuthology.orchestra.run.smithi154.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-05-10T04:19:56.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:56.726 DEBUG:teuthology.orchestra.run.smithi154:> ip netns list-id 2023-05-10T04:19:56.802 INFO:teuthology.orchestra.run.smithi154.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-05-10T04:19:56.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:56.804 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:56.804 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:56.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-05-10T04:19:56.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-05-10T04:19:56.805 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:56.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:56.968 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-10T04:19:57.030 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:57.030 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:57.031 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T04:19:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 1e:84:37:83:07:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-10T04:19:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-10T04:19:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::1c84:37ff:fe83:7b7/64 scope link 2023-05-10T04:19:57.031 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:57.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:57.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-05-10T04:19:57.094 INFO:teuthology.orchestra.run.smithi154.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:19:57.094 INFO:teuthology.orchestra.run.smithi154.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:19:57.094 INFO:teuthology.orchestra.run.smithi154.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:19:57.094 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:57.094 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 ::1/128 scope host 2023-05-10T04:19:57.094 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:57.095 INFO:teuthology.orchestra.run.smithi154.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T04:19:57.095 INFO:teuthology.orchestra.run.smithi154.stdout: link/ether 1e:84:37:83:07:b7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-05-10T04:19:57.095 INFO:teuthology.orchestra.run.smithi154.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-05-10T04:19:57.095 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:57.095 INFO:teuthology.orchestra.run.smithi154.stdout: inet6 fe80::1c84:37ff:fe83:7b7/64 scope link 2023-05-10T04:19:57.095 INFO:teuthology.orchestra.run.smithi154.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:19:57.096 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-05-10T04:19:57.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:57.097 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:57.097 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:57.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-05-10T04:19:57.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-05-10T04:19:57.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-05-10T04:19:57.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-05-10T04:19:57.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-05-10T04:19:57.099 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:57.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:57.323 DEBUG:teuthology.orchestra.run.smithi154:> (cd / && exec bash -c ' 2023-05-10T04:19:57.324 DEBUG:teuthology.orchestra.run.smithi154:> set -e 2023-05-10T04:19:57.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set brx.1 up 2023-05-10T04:19:57.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo ip link set dev brx.1 master ceph-brx 2023-05-10T04:19:57.324 DEBUG:teuthology.orchestra.run.smithi154:> ') 2023-05-10T04:19:57.491 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-05-10T04:19:57.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:57.492 DEBUG:teuthology.orchestra.run.smithi154:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-05-10T04:19:57.530 INFO:teuthology.orchestra.run.smithi154.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-05-10T04:19:57.531 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:19:57.531 DEBUG:teuthology.orchestra.run.smithi154:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-05-10T04:19:57.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-05-10T04:19:57.712 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:57.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:57.772 INFO:teuthology.orchestra.run.smithi154.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:57.774 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:57.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:57.775 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-05-10T04:19:57.814 INFO:teuthology.orchestra.run.smithi154.stdout:42 2023-05-10T04:19:57.814 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [42] 2023-05-10T04:19:57.815 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-05-10T04:19:57.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo modprobe fuse 2023-05-10T04:19:57.921 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:19:57.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:19:57.985 INFO:teuthology.orchestra.run.smithi154.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:19:57.987 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:19:57.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:57.988 DEBUG:teuthology.orchestra.run.smithi154:> ls /sys/fs/fuse/connections 2023-05-10T04:19:58.018 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi154.stderr:2023-05-10T04:19:58.015+0000 7f392a7715c0 -1 init, newargv = 0x5609959252d0 newargc=15 2023-05-10T04:19:58.018 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi154.stderr:ceph-fuse[134184]: starting ceph client 2023-05-10T04:19:58.025 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi154.stderr:ceph-fuse[134184]: starting fuse 2023-05-10T04:19:58.029 INFO:teuthology.orchestra.run.smithi154.stdout:42 2023-05-10T04:19:58.029 INFO:teuthology.orchestra.run.smithi154.stdout:44 2023-05-10T04:19:58.030 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [42, 44] 2023-05-10T04:19:58.030 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-10T04:19:58.031 DEBUG:teuthology.orchestra.run.smithi154:> import glob 2023-05-10T04:19:58.031 DEBUG:teuthology.orchestra.run.smithi154:> import re 2023-05-10T04:19:58.031 DEBUG:teuthology.orchestra.run.smithi154:> import os 2023-05-10T04:19:58.031 DEBUG:teuthology.orchestra.run.smithi154:> import subprocess 2023-05-10T04:19:58.031 DEBUG:teuthology.orchestra.run.smithi154:> 2023-05-10T04:19:58.032 DEBUG:teuthology.orchestra.run.smithi154:> def _find_admin_socket(client_name): 2023-05-10T04:19:58.032 DEBUG:teuthology.orchestra.run.smithi154:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-05-10T04:19:58.032 DEBUG:teuthology.orchestra.run.smithi154:> files = glob.glob(asok_path) 2023-05-10T04:19:58.033 DEBUG:teuthology.orchestra.run.smithi154:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-05-10T04:19:58.033 DEBUG:teuthology.orchestra.run.smithi154:> 2023-05-10T04:19:58.033 DEBUG:teuthology.orchestra.run.smithi154:> # Given a non-glob path, it better be there 2023-05-10T04:19:58.033 DEBUG:teuthology.orchestra.run.smithi154:> if "*" not in asok_path: 2023-05-10T04:19:58.033 DEBUG:teuthology.orchestra.run.smithi154:> assert(len(files) == 1) 2023-05-10T04:19:58.034 DEBUG:teuthology.orchestra.run.smithi154:> return files[0] 2023-05-10T04:19:58.034 DEBUG:teuthology.orchestra.run.smithi154:> 2023-05-10T04:19:58.034 DEBUG:teuthology.orchestra.run.smithi154:> for f in files: 2023-05-10T04:19:58.034 DEBUG:teuthology.orchestra.run.smithi154:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-10T04:19:58.035 DEBUG:teuthology.orchestra.run.smithi154:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-10T04:19:58.035 DEBUG:teuthology.orchestra.run.smithi154:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-10T04:19:58.035 DEBUG:teuthology.orchestra.run.smithi154:> contents = proc_f.read() 2023-05-10T04:19:58.035 DEBUG:teuthology.orchestra.run.smithi154:> if mountpoint in contents: 2023-05-10T04:19:58.035 DEBUG:teuthology.orchestra.run.smithi154:> return f 2023-05-10T04:19:58.036 DEBUG:teuthology.orchestra.run.smithi154:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-10T04:19:58.036 DEBUG:teuthology.orchestra.run.smithi154:> 2023-05-10T04:19:58.036 DEBUG:teuthology.orchestra.run.smithi154:> print(_find_admin_socket("client.3")) 2023-05-10T04:19:58.036 DEBUG:teuthology.orchestra.run.smithi154:> ' 2023-05-10T04:19:58.205 INFO:teuthology.orchestra.run.smithi154.stdout:/var/run/ceph/ceph-client.3.134184.asok 2023-05-10T04:19:58.383 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.134184.asok 2023-05-10T04:19:58.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:58.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.134184.asok status 2023-05-10T04:19:58.599 INFO:teuthology.orchestra.run.smithi154.stdout:{ 2023-05-10T04:19:58.599 INFO:teuthology.orchestra.run.smithi154.stdout: "metadata": { 2023-05-10T04:19:58.599 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_sha1": "2ef5137fbb6e28908d2161218e7b594628c1b6d3", 2023-05-10T04:19:58.599 INFO:teuthology.orchestra.run.smithi154.stdout: "ceph_version": "ceph version 18.0.0-3851-g2ef5137f (2ef5137fbb6e28908d2161218e7b594628c1b6d3) reef (dev)", 2023-05-10T04:19:58.599 INFO:teuthology.orchestra.run.smithi154.stdout: "entity_id": "3", 2023-05-10T04:19:58.600 INFO:teuthology.orchestra.run.smithi154.stdout: "hostname": "smithi154", 2023-05-10T04:19:58.600 INFO:teuthology.orchestra.run.smithi154.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-05-10T04:19:58.600 INFO:teuthology.orchestra.run.smithi154.stdout: "pid": "134184", 2023-05-10T04:19:58.600 INFO:teuthology.orchestra.run.smithi154.stdout: "root": "/" 2023-05-10T04:19:58.600 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-05-10T04:19:58.600 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_count": 0, 2023-05-10T04:19:58.600 INFO:teuthology.orchestra.run.smithi154.stdout: "dentry_pinned_count": 0, 2023-05-10T04:19:58.601 INFO:teuthology.orchestra.run.smithi154.stdout: "id": 4634, 2023-05-10T04:19:58.601 INFO:teuthology.orchestra.run.smithi154.stdout: "inst": { 2023-05-10T04:19:58.601 INFO:teuthology.orchestra.run.smithi154.stdout: "name": { 2023-05-10T04:19:58.601 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "client", 2023-05-10T04:19:58.601 INFO:teuthology.orchestra.run.smithi154.stdout: "num": 4634 2023-05-10T04:19:58.601 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-05-10T04:19:58.601 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-05-10T04:19:58.601 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-05-10T04:19:58.602 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.2:0", 2023-05-10T04:19:58.602 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 3554505309 2023-05-10T04:19:58.602 INFO:teuthology.orchestra.run.smithi154.stdout: } 2023-05-10T04:19:58.602 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-05-10T04:19:58.602 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": { 2023-05-10T04:19:58.602 INFO:teuthology.orchestra.run.smithi154.stdout: "type": "v1", 2023-05-10T04:19:58.602 INFO:teuthology.orchestra.run.smithi154.stdout: "addr": "192.168.0.2:0", 2023-05-10T04:19:58.602 INFO:teuthology.orchestra.run.smithi154.stdout: "nonce": 3554505309 2023-05-10T04:19:58.603 INFO:teuthology.orchestra.run.smithi154.stdout: }, 2023-05-10T04:19:58.603 INFO:teuthology.orchestra.run.smithi154.stdout: "inst_str": "client.4634 192.168.0.2:0/3554505309", 2023-05-10T04:19:58.603 INFO:teuthology.orchestra.run.smithi154.stdout: "addr_str": "192.168.0.2:0/3554505309", 2023-05-10T04:19:58.603 INFO:teuthology.orchestra.run.smithi154.stdout: "inode_count": 1, 2023-05-10T04:19:58.603 INFO:teuthology.orchestra.run.smithi154.stdout: "mds_epoch": 9, 2023-05-10T04:19:58.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch": 28, 2023-05-10T04:19:58.603 INFO:teuthology.orchestra.run.smithi154.stdout: "osd_epoch_barrier": 0, 2023-05-10T04:19:58.604 INFO:teuthology.orchestra.run.smithi154.stdout: "blocklisted": false, 2023-05-10T04:19:58.604 INFO:teuthology.orchestra.run.smithi154.stdout: "fs_name": "cephfs" 2023-05-10T04:19:58.604 INFO:teuthology.orchestra.run.smithi154.stdout:} 2023-05-10T04:19:58.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:58.612 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-05-10T04:19:58.613 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-10T04:19:58.657 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-05-10T04:19:58.657 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-10T04:19:58.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:58.658 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T04:19:58.762 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:58.763 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-05-10T04:19:58.763 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.2 2023-05-10T04:19:58.803 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-05-10T04:19:58.804 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-05-10T04:19:58.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:58.805 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-05-10T04:19:58.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:58.906 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2023-05-10T04:19:58.906 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.1 2023-05-10T04:19:58.946 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2023-05-10T04:19:58.947 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-05-10T04:19:58.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:58.947 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-05-10T04:19:59.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:59.049 DEBUG:teuthology.orchestra.run.smithi154:> stat --file-system '--printf=%T 2023-05-10T04:19:59.049 DEBUG:teuthology.orchestra.run.smithi154:> ' -- /home/ubuntu/cephtest/mnt.3 2023-05-10T04:19:59.088 INFO:teuthology.orchestra.run.smithi154.stdout:fuseblk 2023-05-10T04:19:59.089 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-05-10T04:19:59.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:19:59.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-05-10T04:19:59.190 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-10T04:19:59.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:19:59.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.491+0000 7f76b6bff700 1 Processor -- start 2023-05-10T04:19:59.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.491+0000 7f76b6bff700 1 -- start start 2023-05-10T04:19:59.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.493+0000 7f76b6bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f76b0158da0 0x7f76b006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:59.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.493+0000 7f76b6bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b00ca890 con 0x7f76b01589d0 2023-05-10T04:19:59.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.493+0000 7f76b6bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b00cd860 con 0x7f76b006cc00 2023-05-10T04:19:59.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.493+0000 7f76b6bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b00ca5b0 con 0x7f76b0158da0 2023-05-10T04:19:59.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.493+0000 7f76b499b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f76b01589d0 0x7f76b00cd150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44456/0 (socket says 172.21.15.132:44456) 2023-05-10T04:19:59.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.493+0000 7f76b499b700 1 -- 172.21.15.132:0/1826268028 learned_addr learned my addr 172.21.15.132:0/1826268028 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:19:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.493+0000 7f76affff700 1 --2- 172.21.15.132:0/1826268028 >> v2:172.21.15.154:3300/0 conn(0x7f76b0158da0 0x7f76b006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.493+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2999411513 0 0) 0x7f76b00ca890 con 0x7f76b01589d0 2023-05-10T04:19:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76a00057c0 con 0x7f76b01589d0 2023-05-10T04:19:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4066291028 0 0) 0x7f76a00057c0 con 0x7f76b01589d0 2023-05-10T04:19:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 >> v2:172.21.15.154:3300/0 conn(0x7f76b0158da0 msgr2=0x7f76b006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:59.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 --2- 172.21.15.132:0/1826268028 >> v2:172.21.15.154:3300/0 conn(0x7f76b0158da0 0x7f76b006c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 >> v1:172.21.15.154:6789/0 conn(0x7f76b006cc00 legacy=0x7f76b006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:59.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00cc670 con 0x7f76b01589d0 2023-05-10T04:19:59.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f76a4001670 con 0x7f76b01589d0 2023-05-10T04:19:59.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 >> v1:172.21.15.132:6789/0 conn(0x7f76b01589d0 legacy=0x7f76b00cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:59.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76a0006070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:59.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76a0006a60 0x7f76a0006ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a0007410 0x7f76a000dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b00ca5b0 con 0x7f76a0007410 2023-05-10T04:19:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76a000e2f0 con 0x7f76a0005c60 2023-05-10T04:19:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76a000e4b0 con 0x7f76a0006a60 2023-05-10T04:19:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76b499b700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76a0006070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76b519c700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a0007410 0x7f76a000dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.494+0000 7f76affff700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76a0006a60 0x7f76a0006ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76b499b700 1 -- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76a0006a60 msgr2=0x7f76a0006ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76b499b700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76a0006a60 0x7f76a0006ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76b499b700 1 -- 172.21.15.132:0/1826268028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a0007410 msgr2=0x7f76a000dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:19:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76b499b700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76a0007410 0x7f76a000dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76b499b700 1 -- 172.21.15.132:0/1826268028 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a00057c0 con 0x7f76a0005c60 2023-05-10T04:19:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76b519c700 1 -- 172.21.15.132:0/1826268028 reap_dead start 2023-05-10T04:19:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76b499b700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76a0006070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f76a400c160 tx=0x7f76a0007a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1e7d3c46e6335eb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4007b70 con 0x7f76a0005c60 2023-05-10T04:19:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a400cce0 con 0x7f76a0005c60 2023-05-10T04:19:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.495+0000 7f76af7fe700 1 -- 172.21.15.132:0/1826268028 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a4005ba0 con 0x7f76a0005c60 2023-05-10T04:19:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.496+0000 7f76b6bff700 1 -- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 msgr2=0x7f76a0006070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.496+0000 7f76b6bff700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76a0006070 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f76a400c160 tx=0x7f76a0007a90 comp rx=0 tx=0).stop 2023-05-10T04:19:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.496+0000 7f76b6bff700 1 -- 172.21.15.132:0/1826268028 shutdown_connections 2023-05-10T04:19:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.496+0000 7f76b6bff700 1 --2- 172.21.15.132:0/1826268028 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76a0006070 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.496+0000 7f76b6bff700 1 -- 172.21.15.132:0/1826268028 >> 172.21.15.132:0/1826268028 conn(0x7f76b00cf720 msgr2=0x7f76b00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:59.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.496+0000 7f76b6bff700 1 -- 172.21.15.132:0/1826268028 shutdown_connections 2023-05-10T04:19:59.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.496+0000 7f76b6bff700 1 -- 172.21.15.132:0/1826268028 wait complete. 2023-05-10T04:19:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.497+0000 7f76b6bff700 1 Processor -- start 2023-05-10T04:19:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.498+0000 7f76b6bff700 1 -- start start 2023-05-10T04:19:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.498+0000 7f76b6bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76b00c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.498+0000 7f76b6bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b00c3ae0 0x7f76b01ee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76b6bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76b01ee6f0 0x7f76b01eeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76b6bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b01ef0b0 con 0x7f76b00c3ae0 2023-05-10T04:19:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76b6bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b015b850 con 0x7f76a0005c60 2023-05-10T04:19:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76b6bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b015bb30 con 0x7f76b01ee6f0 2023-05-10T04:19:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b00c3ae0 0x7f76b01ee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b00c3ae0 0x7f76b01ee1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44834/0 (socket says 172.21.15.132:44834) 2023-05-10T04:19:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 -- 172.21.15.132:0/3054131298 learned_addr learned my addr 172.21.15.132:0/3054131298 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:19:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76b499b700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76b00c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76b519c700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76b01ee6f0 0x7f76b01eeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 -- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76b01ee6f0 msgr2=0x7f76b01eeb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76b01ee6f0 0x7f76b01eeb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 -- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 msgr2=0x7f76b00c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76b00c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 -- 172.21.15.132:0/3054131298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b00ccc30 con 0x7f76b00c3ae0 2023-05-10T04:19:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76b499b700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76b00c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76b519c700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76b01ee6f0 0x7f76b01eeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:19:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.499+0000 7f76affff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b00c3ae0 0x7f76b01ee1b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f769c011920 tx=0x7f769c011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.500+0000 7f76ad7fa700 1 -- 172.21.15.132:0/3054131298 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c009610 con 0x7f76b00c3ae0 2023-05-10T04:19:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.500+0000 7f76ad7fa700 1 -- 172.21.15.132:0/3054131298 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769c005c30 con 0x7f76b00c3ae0 2023-05-10T04:19:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.500+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b00cc950 con 0x7f76b00c3ae0 2023-05-10T04:19:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.500+0000 7f76ad7fa700 1 -- 172.21.15.132:0/3054131298 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c00f730 con 0x7f76b00c3ae0 2023-05-10T04:19:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.500+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b006c6c0 con 0x7f76b00c3ae0 2023-05-10T04:19:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.501+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b00c95e0 con 0x7f76b00c3ae0 2023-05-10T04:19:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.502+0000 7f76ad7fa700 1 -- 172.21.15.132:0/3054131298 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f769c00f890 con 0x7f76b00c3ae0 2023-05-10T04:19:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.503+0000 7f76ad7fa700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f769406ace0 0x7f769406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:19:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.503+0000 7f76ad7fa700 1 -- 172.21.15.132:0/3054131298 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f769c089de0 con 0x7f76b00c3ae0 2023-05-10T04:19:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.503+0000 7f76b499b700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f769406ace0 0x7f769406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:19:59.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.504+0000 7f76b499b700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f769406ace0 0x7f769406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f76b0151570 tx=0x7f76a4007000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:19:59.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.507+0000 7f76ad7fa700 1 -- 172.21.15.132:0/3054131298 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f769c054b90 con 0x7f76b00c3ae0 2023-05-10T04:19:59.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.707+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76b00b4a10 con 0x7f76b00c3ae0 2023-05-10T04:19:59.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.708+0000 7f76ad7fa700 1 -- 172.21.15.132:0/3054131298 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f769c0581b0 con 0x7f76b00c3ae0 2023-05-10T04:19:59.710 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:19:59.711 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:19:59.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f769406ace0 msgr2=0x7f769406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:59.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f769406ace0 0x7f769406d190 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f76b0151570 tx=0x7f76a4007000 comp rx=0 tx=0).stop 2023-05-10T04:19:59.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b00c3ae0 msgr2=0x7f76b01ee1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:19:59.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b00c3ae0 0x7f76b01ee1b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f769c011920 tx=0x7f769c011ce0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 shutdown_connections 2023-05-10T04:19:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f769406ace0 0x7f769406d190 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f76b01ee6f0 0x7f76b01eeb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f76a0005c60 0x7f76b00c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 --2- 172.21.15.132:0/3054131298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76b00c3ae0 0x7f76b01ee1b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:19:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 >> 172.21.15.132:0/3054131298 conn(0x7f76b00cf720 msgr2=0x7f76b00afda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:19:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 shutdown_connections 2023-05-10T04:19:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:19:59.711+0000 7f76b6bff700 1 -- 172.21.15.132:0/3054131298 wait complete. 2023-05-10T04:19:59.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:19:59.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:00.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.000+0000 7f192cdff700 1 Processor -- start 2023-05-10T04:20:00.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.000+0000 7f192cdff700 1 -- start start 2023-05-10T04:20:00.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.001+0000 7f192cdff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f19280cff50 0x7f1928160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.001+0000 7f192cdff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19280cd520 con 0x7f19280cf010 2023-05-10T04:20:00.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.001+0000 7f192cdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19280d2640 con 0x7f192815c590 2023-05-10T04:20:00.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.001+0000 7f192cdff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19281610d0 con 0x7f19280cff50 2023-05-10T04:20:00.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.001+0000 7f1926d9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f19280cff50 0x7f1928160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.001+0000 7f191ffff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f19280cf010 0x7f19280d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44458/0 (socket says 172.21.15.132:44458) 2023-05-10T04:20:00.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.001+0000 7f191ffff700 1 -- 172.21.15.132:0/1796011986 learned_addr learned my addr 172.21.15.132:0/1796011986 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:00.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.002+0000 7f1926d9d700 1 -- 172.21.15.132:0/1796011986 >> v1:172.21.15.154:6789/0 conn(0x7f192815c590 legacy=0x7f19280cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.002+0000 7f1926d9d700 1 -- 172.21.15.132:0/1796011986 >> v1:172.21.15.132:6789/0 conn(0x7f19280cf010 legacy=0x7f19280d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.002+0000 7f1926d9d700 1 -- 172.21.15.132:0/1796011986 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19280b23c0 con 0x7f19280cff50 2023-05-10T04:20:00.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.002+0000 7f1925d9b700 1 -- 172.21.15.132:0/1796011986 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359424754 0 0) 0x7f19280cd520 con 0x7f19280cf010 2023-05-10T04:20:00.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.002+0000 7f1926d9d700 1 --2- 172.21.15.132:0/1796011986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f1928160b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1920009d90 tx=0x7f192000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31b290c8bdefe34 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.002+0000 7f1925d9b700 1 -- 172.21.15.132:0/1796011986 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f192000e070 con 0x7f19280cff50 2023-05-10T04:20:00.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.002+0000 7f1925d9b700 1 -- 172.21.15.132:0/1796011986 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f192000bbd0 con 0x7f19280cff50 2023-05-10T04:20:00.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.002+0000 7f1925d9b700 1 -- 172.21.15.132:0/1796011986 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1920012430 con 0x7f19280cff50 2023-05-10T04:20:00.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.003+0000 7f192cdff700 1 -- 172.21.15.132:0/1796011986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 msgr2=0x7f1928160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.003+0000 7f192cdff700 1 --2- 172.21.15.132:0/1796011986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f1928160b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1920009d90 tx=0x7f192000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:00.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.003+0000 7f192cdff700 1 -- 172.21.15.132:0/1796011986 shutdown_connections 2023-05-10T04:20:00.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.003+0000 7f192cdff700 1 --2- 172.21.15.132:0/1796011986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f1928160b90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.003+0000 7f192cdff700 1 -- 172.21.15.132:0/1796011986 >> 172.21.15.132:0/1796011986 conn(0x7f1928071b10 msgr2=0x7f1928071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:00.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.003+0000 7f192cdff700 1 -- 172.21.15.132:0/1796011986 shutdown_connections 2023-05-10T04:20:00.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.003+0000 7f192cdff700 1 -- 172.21.15.132:0/1796011986 wait complete. 2023-05-10T04:20:00.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.004+0000 7f192cdff700 1 Processor -- start 2023-05-10T04:20:00.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.005+0000 7f192cdff700 1 -- start start 2023-05-10T04:20:00.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.005+0000 7f192cdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19280cf010 0x7f1928154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.005+0000 7f192cdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f19280b76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.005+0000 7f192cdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192815c590 0x7f19280cc180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.005+0000 7f192cdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1928155250 con 0x7f19280cff50 2023-05-10T04:20:00.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.005+0000 7f192cdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19281e6d30 con 0x7f192815c590 2023-05-10T04:20:00.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.005+0000 7f192cdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19281e6120 con 0x7f19280cf010 2023-05-10T04:20:00.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f19280b76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f19280b76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44852/0 (socket says 172.21.15.132:44852) 2023-05-10T04:20:00.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 -- 172.21.15.132:0/2321119606 learned_addr learned my addr 172.21.15.132:0/2321119606 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:00.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f1926d9d700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192815c590 0x7f19280cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f192659c700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19280cf010 0x7f1928154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 -- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19280cf010 msgr2=0x7f1928154d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19280cf010 0x7f1928154d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 -- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192815c590 msgr2=0x7f19280cc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192815c590 0x7f19280cc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 -- 172.21.15.132:0/2321119606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1920009a70 con 0x7f19280cff50 2023-05-10T04:20:00.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f192659c700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19280cf010 0x7f1928154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:00.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.006+0000 7f191ffff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f19280b76f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f191000c520 tx=0x7f191000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.007+0000 7f191effd700 1 -- 172.21.15.132:0/2321119606 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910004c80 con 0x7f19280cff50 2023-05-10T04:20:00.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.007+0000 7f191effd700 1 -- 172.21.15.132:0/2321119606 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1910004de0 con 0x7f19280cff50 2023-05-10T04:20:00.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.007+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19280cd770 con 0x7f19280cff50 2023-05-10T04:20:00.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.007+0000 7f191effd700 1 -- 172.21.15.132:0/2321119606 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1910007310 con 0x7f19280cff50 2023-05-10T04:20:00.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.007+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19280cf560 con 0x7f19280cff50 2023-05-10T04:20:00.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.008+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f192815c960 con 0x7f19280cff50 2023-05-10T04:20:00.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.009+0000 7f191effd700 1 -- 172.21.15.132:0/2321119606 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1910007470 con 0x7f19280cff50 2023-05-10T04:20:00.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.010+0000 7f191effd700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f190806ace0 0x7f190806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.010+0000 7f191effd700 1 -- 172.21.15.132:0/2321119606 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f19100894a0 con 0x7f19280cff50 2023-05-10T04:20:00.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.010+0000 7f192659c700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f190806ace0 0x7f190806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.011+0000 7f192659c700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f190806ace0 0x7f190806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1918000f60 tx=0x7f1918009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.014+0000 7f191effd700 1 -- 172.21.15.132:0/2321119606 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f19100541c0 con 0x7f19280cff50 2023-05-10T04:20:00.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.208+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f19281e6e70 con 0x7f19280cff50 2023-05-10T04:20:00.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.208+0000 7f191effd700 1 -- 172.21.15.132:0/2321119606 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19100577e0 con 0x7f19280cff50 2023-05-10T04:20:00.210 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f190806ace0 msgr2=0x7f190806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f190806ace0 0x7f190806d190 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1918000f60 tx=0x7f1918009040 comp rx=0 tx=0).stop 2023-05-10T04:20:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 msgr2=0x7f19280b76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f19280b76f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f191000c520 tx=0x7f191000c830 comp rx=0 tx=0).stop 2023-05-10T04:20:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 shutdown_connections 2023-05-10T04:20:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f190806ace0 0x7f190806d190 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f192815c590 0x7f19280cc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f19280cf010 0x7f1928154d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.210+0000 7f192cdff700 1 --2- 172.21.15.132:0/2321119606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19280cff50 0x7f19280b76f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.211+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 >> 172.21.15.132:0/2321119606 conn(0x7f1928071b10 msgr2=0x7f19280ca890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:00.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.211+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 shutdown_connections 2023-05-10T04:20:00.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.211+0000 7f192cdff700 1 -- 172.21.15.132:0/2321119606 wait complete. 2023-05-10T04:20:00.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.423+0000 7fd148fff700 1 Processor -- start 2023-05-10T04:20:00.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.423+0000 7fd148fff700 1 -- start start 2023-05-10T04:20:00.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd148fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd14415a5a0 0x7fd14406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd148fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd14406a920 0x7fd144070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd148fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1440cb280 con 0x7fd144071030 2023-05-10T04:20:00.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd148fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14406adc0 con 0x7fd14415a5a0 2023-05-10T04:20:00.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd148fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14415a970 con 0x7fd14406a920 2023-05-10T04:20:00.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd14259c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd14415a5a0 0x7fd14406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd14259c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd14415a5a0 0x7fd14406a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44856/0 (socket says 172.21.15.132:44856) 2023-05-10T04:20:00.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd14259c700 1 -- 172.21.15.132:0/829904473 learned_addr learned my addr 172.21.15.132:0/829904473 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:00.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.424+0000 7fd13bfff700 1 --2- 172.21.15.132:0/829904473 >> v2:172.21.15.154:3300/0 conn(0x7fd14406a920 0x7fd144070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.425+0000 7fd14259c700 1 -- 172.21.15.132:0/829904473 >> v2:172.21.15.154:3300/0 conn(0x7fd14406a920 msgr2=0x7fd144070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:00.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.425+0000 7fd14259c700 1 --2- 172.21.15.132:0/829904473 >> v2:172.21.15.154:3300/0 conn(0x7fd14406a920 0x7fd144070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.425+0000 7fd14259c700 1 -- 172.21.15.132:0/829904473 >> v1:172.21.15.154:6789/0 conn(0x7fd144071030 legacy=0x7fd14415dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:00.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.425+0000 7fd14259c700 1 -- 172.21.15.132:0/829904473 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd144071470 con 0x7fd14415a5a0 2023-05-10T04:20:00.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.425+0000 7fd14259c700 1 --2- 172.21.15.132:0/829904473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd14406a3e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd14406f0c0 tx=0x7fd134009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2aeda6a605e96 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.425+0000 7fd141d9b700 1 -- 172.21.15.132:0/829904473 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134004230 con 0x7fd14415a5a0 2023-05-10T04:20:00.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.425+0000 7fd141d9b700 1 -- 172.21.15.132:0/829904473 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134004390 con 0x7fd14415a5a0 2023-05-10T04:20:00.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.425+0000 7fd141d9b700 1 -- 172.21.15.132:0/829904473 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340036a0 con 0x7fd14415a5a0 2023-05-10T04:20:00.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.426+0000 7fd148fff700 1 -- 172.21.15.132:0/829904473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 msgr2=0x7fd14406a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.426+0000 7fd148fff700 1 --2- 172.21.15.132:0/829904473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd14406a3e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd14406f0c0 tx=0x7fd134009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:00.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.426+0000 7fd148fff700 1 -- 172.21.15.132:0/829904473 shutdown_connections 2023-05-10T04:20:00.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.426+0000 7fd148fff700 1 --2- 172.21.15.132:0/829904473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd14406a3e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.426+0000 7fd148fff700 1 --2- 172.21.15.132:0/829904473 >> v2:172.21.15.154:3300/0 conn(0x7fd14406a920 0x7fd144070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.426+0000 7fd148fff700 1 -- 172.21.15.132:0/829904473 >> 172.21.15.132:0/829904473 conn(0x7fd1440cf720 msgr2=0x7fd1440cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:00.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.426+0000 7fd148fff700 1 -- 172.21.15.132:0/829904473 shutdown_connections 2023-05-10T04:20:00.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.426+0000 7fd148fff700 1 -- 172.21.15.132:0/829904473 wait complete. 2023-05-10T04:20:00.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.428+0000 7fd148fff700 1 Processor -- start 2023-05-10T04:20:00.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.428+0000 7fd148fff700 1 -- start start 2023-05-10T04:20:00.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.429+0000 7fd148fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd14406a920 0x7fd144155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd148fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd144071030 0x7fd1440a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd148fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd1440a79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd148fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1441564c0 con 0x7fd14415a5a0 2023-05-10T04:20:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd148fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1440c6c50 con 0x7fd144071030 2023-05-10T04:20:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd148fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14415d240 con 0x7fd14406a920 2023-05-10T04:20:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd1440a79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd1440a79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44870/0 (socket says 172.21.15.132:44870) 2023-05-10T04:20:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 -- 172.21.15.132:0/431759352 learned_addr learned my addr 172.21.15.132:0/431759352 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd14259c700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd14406a920 0x7fd144155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd13bfff700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd144071030 0x7fd1440a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 -- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd14406a920 msgr2=0x7fd144155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd14406a920 0x7fd144155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 -- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd144071030 msgr2=0x7fd1440a74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd144071030 0x7fd1440a74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 -- 172.21.15.132:0/431759352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009550 con 0x7fd14415a5a0 2023-05-10T04:20:00.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd14259c700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd14406a920 0x7fd144155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:00.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd13bfff700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd144071030 0x7fd1440a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:00.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.430+0000 7fd142d9d700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd1440a79e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00cc10 tx=0x7fd13c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.431+0000 7fd13affd700 1 -- 172.21.15.132:0/431759352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c00abb0 con 0x7fd14415a5a0 2023-05-10T04:20:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.431+0000 7fd13affd700 1 -- 172.21.15.132:0/431759352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c00ad10 con 0x7fd14415a5a0 2023-05-10T04:20:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.431+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440719e0 con 0x7fd14415a5a0 2023-05-10T04:20:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.431+0000 7fd13affd700 1 -- 172.21.15.132:0/431759352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c012660 con 0x7fd14415a5a0 2023-05-10T04:20:00.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.431+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd144071700 con 0x7fd14415a5a0 2023-05-10T04:20:00.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.432+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14406c6c0 con 0x7fd14415a5a0 2023-05-10T04:20:00.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.433+0000 7fd13affd700 1 -- 172.21.15.132:0/431759352 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd13c0127c0 con 0x7fd14415a5a0 2023-05-10T04:20:00.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.433+0000 7fd13affd700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd12406ace0 0x7fd12406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.434+0000 7fd13affd700 1 -- 172.21.15.132:0/431759352 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd13c089fe0 con 0x7fd14415a5a0 2023-05-10T04:20:00.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.434+0000 7fd14259c700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd12406ace0 0x7fd12406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.434+0000 7fd14259c700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd12406ace0 0x7fd12406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1440c8dd0 tx=0x7fd134008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.438+0000 7fd13affd700 1 -- 172.21.15.132:0/431759352 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd13c054d60 con 0x7fd14415a5a0 2023-05-10T04:20:00.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.638+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fd144074430 con 0x7fd14415a5a0 2023-05-10T04:20:00.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.638+0000 7fd13affd700 1 -- 172.21.15.132:0/431759352 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fd13c0160a0 con 0x7fd14415a5a0 2023-05-10T04:20:00.641 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:00.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd12406ace0 msgr2=0x7fd12406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd12406ace0 0x7fd12406d190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd1440c8dd0 tx=0x7fd134008030 comp rx=0 tx=0).stop 2023-05-10T04:20:00.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 msgr2=0x7fd1440a79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd1440a79e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd13c00cc10 tx=0x7fd13c00a060 comp rx=0 tx=0).stop 2023-05-10T04:20:00.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 shutdown_connections 2023-05-10T04:20:00.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd12406ace0 0x7fd12406d190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd14415a5a0 0x7fd1440a79e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd14406a920 0x7fd144155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 --2- 172.21.15.132:0/431759352 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd144071030 0x7fd1440a74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 >> 172.21.15.132:0/431759352 conn(0x7fd1440cf720 msgr2=0x7fd144158740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:00.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 shutdown_connections 2023-05-10T04:20:00.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.641+0000 7fd148fff700 1 -- 172.21.15.132:0/431759352 wait complete. 2023-05-10T04:20:00.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:00.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.845+0000 7fde28bff700 1 Processor -- start 2023-05-10T04:20:00.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.845+0000 7fde28bff700 1 -- start start 2023-05-10T04:20:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.846+0000 7fde28bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fde240b87a0 0x7fde240cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.846+0000 7fde28bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde240cdc60 con 0x7fde241601e0 2023-05-10T04:20:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.846+0000 7fde28bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde240cd6a0 con 0x7fde24160d40 2023-05-10T04:20:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.846+0000 7fde28bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde240d02d0 con 0x7fde240b87a0 2023-05-10T04:20:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde1bfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fde241601e0 0x7fde24160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44464/0 (socket says 172.21.15.132:44464) 2023-05-10T04:20:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde1bfff700 1 -- 172.21.15.132:0/405139273 learned_addr learned my addr 172.21.15.132:0/405139273 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde2259c700 1 --2- 172.21.15.132:0/405139273 >> v2:172.21.15.154:3300/0 conn(0x7fde240b87a0 0x7fde240cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1450644144 0 0) 0x7fde240cdc60 con 0x7fde241601e0 2023-05-10T04:20:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde100035b0 con 0x7fde241601e0 2023-05-10T04:20:00.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2162909795 0 0) 0x7fde100035b0 con 0x7fde241601e0 2023-05-10T04:20:00.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 >> v2:172.21.15.154:3300/0 conn(0x7fde240b87a0 msgr2=0x7fde240cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:00.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 --2- 172.21.15.132:0/405139273 >> v2:172.21.15.154:3300/0 conn(0x7fde240b87a0 0x7fde240cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 >> v1:172.21.15.154:6789/0 conn(0x7fde24160d40 legacy=0x7fde240d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240cd980 con 0x7fde241601e0 2023-05-10T04:20:00.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fde0c001670 con 0x7fde241601e0 2023-05-10T04:20:00.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 >> v1:172.21.15.132:6789/0 conn(0x7fde241601e0 legacy=0x7fde24160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.847+0000 7fde21d9b700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde10003a00 0x7fde10003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde21d9b700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde100043f0 0x7fde100048b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde21d9b700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde100050b0 0x7fde1000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde240d02d0 con 0x7fde10003a00 2023-05-10T04:20:00.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde1000c000 con 0x7fde100050b0 2023-05-10T04:20:00.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1000c1c0 con 0x7fde100043f0 2023-05-10T04:20:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde2259c700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde10003a00 0x7fde10003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde1bfff700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde100043f0 0x7fde100048b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde22d9d700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde100050b0 0x7fde1000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde2259c700 1 -- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde100043f0 msgr2=0x7fde100048b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde2259c700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde100043f0 0x7fde100048b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde2259c700 1 -- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde100050b0 msgr2=0x7fde1000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde2259c700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde100050b0 0x7fde1000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde2259c700 1 -- 172.21.15.132:0/405139273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100035b0 con 0x7fde10003a00 2023-05-10T04:20:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde22d9d700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde100050b0 0x7fde1000ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde22d9d700 1 -- 172.21.15.132:0/405139273 reap_dead start 2023-05-10T04:20:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.848+0000 7fde2259c700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde10003a00 0x7fde10003dd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde14009b60 tx=0x7fde10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c5d506a532e68f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400e6c0 con 0x7fde10003a00 2023-05-10T04:20:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1400e820 con 0x7fde10003a00 2023-05-10T04:20:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde21d9b700 1 -- 172.21.15.132:0/405139273 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1400eb90 con 0x7fde10003a00 2023-05-10T04:20:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde28bff700 1 -- 172.21.15.132:0/405139273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde10003a00 msgr2=0x7fde10003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde28bff700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde10003a00 0x7fde10003dd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fde14009b60 tx=0x7fde10005880 comp rx=0 tx=0).stop 2023-05-10T04:20:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde28bff700 1 -- 172.21.15.132:0/405139273 shutdown_connections 2023-05-10T04:20:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde28bff700 1 --2- 172.21.15.132:0/405139273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde10003a00 0x7fde10003dd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde28bff700 1 -- 172.21.15.132:0/405139273 >> 172.21.15.132:0/405139273 conn(0x7fde24071b10 msgr2=0x7fde24071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde28bff700 1 -- 172.21.15.132:0/405139273 shutdown_connections 2023-05-10T04:20:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.849+0000 7fde28bff700 1 -- 172.21.15.132:0/405139273 wait complete. 2023-05-10T04:20:00.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.851+0000 7fde28bff700 1 Processor -- start 2023-05-10T04:20:00.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.851+0000 7fde28bff700 1 -- start start 2023-05-10T04:20:00.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde28bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde10003a00 0x7fde24147160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde28bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde24154700 0x7fde240b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde28bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde24154140 0x7fde240b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde28bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde241e63a0 con 0x7fde24154140 2023-05-10T04:20:00.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde28bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde241e6680 con 0x7fde24154700 2023-05-10T04:20:00.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde28bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde241e6960 con 0x7fde10003a00 2023-05-10T04:20:00.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde22d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde24154140 0x7fde240b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde22d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde24154140 0x7fde240b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44890/0 (socket says 172.21.15.132:44890) 2023-05-10T04:20:00.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde22d9d700 1 -- 172.21.15.132:0/185021486 learned_addr learned my addr 172.21.15.132:0/185021486 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:00.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde2259c700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde10003a00 0x7fde24147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.852+0000 7fde1bfff700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde24154700 0x7fde240b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde22d9d700 1 -- 172.21.15.132:0/185021486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde10003a00 msgr2=0x7fde24147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde22d9d700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde10003a00 0x7fde24147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde22d9d700 1 -- 172.21.15.132:0/185021486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde24154700 msgr2=0x7fde240b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:00.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde22d9d700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde24154700 0x7fde240b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:00.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde22d9d700 1 -- 172.21.15.132:0/185021486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde240cfd80 con 0x7fde24154140 2023-05-10T04:20:00.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde22d9d700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde24154140 0x7fde240b4230 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fde1c001990 tx=0x7fde1c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde1affd700 1 -- 172.21.15.132:0/185021486 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c003c10 con 0x7fde24154140 2023-05-10T04:20:00.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde1affd700 1 -- 172.21.15.132:0/185021486 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde1c003d90 con 0x7fde24154140 2023-05-10T04:20:00.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde240cfbf0 con 0x7fde24154140 2023-05-10T04:20:00.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde1affd700 1 -- 172.21.15.132:0/185021486 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde1c005310 con 0x7fde24154140 2023-05-10T04:20:00.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.853+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde240cff10 con 0x7fde24154140 2023-05-10T04:20:00.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.854+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde240d3c60 con 0x7fde24154140 2023-05-10T04:20:00.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.855+0000 7fde1affd700 1 -- 172.21.15.132:0/185021486 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fde1c005470 con 0x7fde24154140 2023-05-10T04:20:00.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.856+0000 7fde1affd700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde0406ace0 0x7fde0406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:00.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.856+0000 7fde1affd700 1 -- 172.21.15.132:0/185021486 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde1c089780 con 0x7fde24154140 2023-05-10T04:20:00.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.856+0000 7fde2259c700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde0406ace0 0x7fde0406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:00.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.857+0000 7fde2259c700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde0406ace0 0x7fde0406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fde140090b0 tx=0x7fde1401f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:00.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:00.860+0000 7fde1affd700 1 -- 172.21.15.132:0/185021486 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fde1c054530 con 0x7fde24154140 2023-05-10T04:20:01.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.055+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fde240b52f0 con 0x7fde24154140 2023-05-10T04:20:01.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.056+0000 7fde1affd700 1 -- 172.21.15.132:0/185021486 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fde1c057b50 con 0x7fde24154140 2023-05-10T04:20:01.058 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:01.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde0406ace0 msgr2=0x7fde0406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde0406ace0 0x7fde0406d190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fde140090b0 tx=0x7fde1401f040 comp rx=0 tx=0).stop 2023-05-10T04:20:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde24154140 msgr2=0x7fde240b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde24154140 0x7fde240b4230 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fde1c001990 tx=0x7fde1c00ef20 comp rx=0 tx=0).stop 2023-05-10T04:20:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 shutdown_connections 2023-05-10T04:20:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fde0406ace0 0x7fde0406d190 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde24154140 0x7fde240b4230 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fde10003a00 0x7fde24147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 --2- 172.21.15.132:0/185021486 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fde24154700 0x7fde240b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.058+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 >> 172.21.15.132:0/185021486 conn(0x7fde24071b10 msgr2=0x7fde240b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:01.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.059+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 shutdown_connections 2023-05-10T04:20:01.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.059+0000 7fde28bff700 1 -- 172.21.15.132:0/185021486 wait complete. 2023-05-10T04:20:01.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:01.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.261+0000 7f5b8dfff700 1 Processor -- start 2023-05-10T04:20:01.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.261+0000 7f5b8dfff700 1 -- start start 2023-05-10T04:20:01.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.262+0000 7f5b8dfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b880b87a0 0x7f5b880cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.262+0000 7f5b8dfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b88160d40 0x7f5b880d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.262+0000 7f5b8dfff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b880cdc60 con 0x7f5b881601e0 2023-05-10T04:20:01.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.262+0000 7f5b8dfff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b880d02d0 con 0x7f5b880b87a0 2023-05-10T04:20:01.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.262+0000 7f5b8dfff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880d0cb0 con 0x7f5b88160d40 2023-05-10T04:20:01.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b877fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b880b87a0 0x7f5b880cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b877fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b880b87a0 0x7f5b880cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44892/0 (socket says 172.21.15.132:44892) 2023-05-10T04:20:01.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b877fe700 1 -- 172.21.15.132:0/4063058995 learned_addr learned my addr 172.21.15.132:0/4063058995 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:01.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b87fff700 1 --2- 172.21.15.132:0/4063058995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b88160d40 0x7f5b880d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b877fe700 1 -- 172.21.15.132:0/4063058995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b88160d40 msgr2=0x7f5b880d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:01.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b877fe700 1 --2- 172.21.15.132:0/4063058995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b88160d40 0x7f5b880d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b877fe700 1 -- 172.21.15.132:0/4063058995 >> v1:172.21.15.154:6789/0 conn(0x7f5b881601e0 legacy=0x7f5b88160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:01.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b877fe700 1 -- 172.21.15.132:0/4063058995 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b880cd6a0 con 0x7f5b880b87a0 2023-05-10T04:20:01.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b87fff700 1 --2- 172.21.15.132:0/4063058995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b88160d40 0x7f5b880d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:01.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.263+0000 7f5b877fe700 1 --2- 172.21.15.132:0/4063058995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b880b87a0 0x7f5b880cfbf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5b780098f0 tx=0x7f5b78009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6020def99b9bcb78 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:01.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b867fc700 1 -- 172.21.15.132:0/4063058995 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b78004230 con 0x7f5b880b87a0 2023-05-10T04:20:01.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b867fc700 1 -- 172.21.15.132:0/4063058995 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b78004390 con 0x7f5b880b87a0 2023-05-10T04:20:01.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b867fc700 1 -- 172.21.15.132:0/4063058995 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b780036a0 con 0x7f5b880b87a0 2023-05-10T04:20:01.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b8dfff700 1 -- 172.21.15.132:0/4063058995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b880b87a0 msgr2=0x7f5b880cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/4063058995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b880b87a0 0x7f5b880cfbf0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5b780098f0 tx=0x7f5b78009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b8dfff700 1 -- 172.21.15.132:0/4063058995 shutdown_connections 2023-05-10T04:20:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/4063058995 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b88160d40 0x7f5b880d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/4063058995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b880b87a0 0x7f5b880cfbf0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b8dfff700 1 -- 172.21.15.132:0/4063058995 >> 172.21.15.132:0/4063058995 conn(0x7f5b88071b10 msgr2=0x7f5b88071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:01.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b8dfff700 1 -- 172.21.15.132:0/4063058995 shutdown_connections 2023-05-10T04:20:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.264+0000 7f5b8dfff700 1 -- 172.21.15.132:0/4063058995 wait complete. 2023-05-10T04:20:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.266+0000 7f5b8dfff700 1 Processor -- start 2023-05-10T04:20:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.266+0000 7f5b8dfff700 1 -- start start 2023-05-10T04:20:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b8dfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b880b87a0 0x7f5b8815ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b8dfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881601e0 0x7f5b881598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b8dfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b88160d40 0x7f5b88159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b8dfff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880cc020 con 0x7f5b88160d40 2023-05-10T04:20:01.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b8dfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880c9f80 con 0x7f5b881601e0 2023-05-10T04:20:01.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b8dfff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b880ca260 con 0x7f5b880b87a0 2023-05-10T04:20:01.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b87fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b88160d40 0x7f5b88159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b87fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b88160d40 0x7f5b88159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44896/0 (socket says 172.21.15.132:44896) 2023-05-10T04:20:01.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b87fff700 1 -- 172.21.15.132:0/1311066613 learned_addr learned my addr 172.21.15.132:0/1311066613 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:01.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b877fe700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b880b87a0 0x7f5b8815ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.267+0000 7f5b86ffd700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881601e0 0x7f5b881598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b87fff700 1 -- 172.21.15.132:0/1311066613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b880b87a0 msgr2=0x7f5b8815ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b87fff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b880b87a0 0x7f5b8815ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b87fff700 1 -- 172.21.15.132:0/1311066613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881601e0 msgr2=0x7f5b881598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b87fff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881601e0 0x7f5b881598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b87fff700 1 -- 172.21.15.132:0/1311066613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b78009550 con 0x7f5b88160d40 2023-05-10T04:20:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b87fff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b88160d40 0x7f5b88159e00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000cd50 tx=0x7f5b8000a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b6ffff700 1 -- 172.21.15.132:0/1311066613 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000cea0 con 0x7f5b88160d40 2023-05-10T04:20:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b6ffff700 1 -- 172.21.15.132:0/1311066613 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8000f480 con 0x7f5b88160d40 2023-05-10T04:20:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b880d1640 con 0x7f5b88160d40 2023-05-10T04:20:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b6ffff700 1 -- 172.21.15.132:0/1311066613 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b8000f830 con 0x7f5b88160d40 2023-05-10T04:20:01.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.268+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b880cd980 con 0x7f5b88160d40 2023-05-10T04:20:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.269+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b880d17d0 con 0x7f5b88160d40 2023-05-10T04:20:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.270+0000 7f5b6ffff700 1 -- 172.21.15.132:0/1311066613 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5b8000b040 con 0x7f5b88160d40 2023-05-10T04:20:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.271+0000 7f5b6ffff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5b7406ace0 0x7f5b7406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.271+0000 7f5b6ffff700 1 -- 172.21.15.132:0/1311066613 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5b80089f00 con 0x7f5b88160d40 2023-05-10T04:20:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.271+0000 7f5b877fe700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5b7406ace0 0x7f5b7406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.272+0000 7f5b877fe700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5b7406ace0 0x7f5b7406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009130 tx=0x7f5b78008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:01.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.275+0000 7f5b6ffff700 1 -- 172.21.15.132:0/1311066613 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5b80054c20 con 0x7f5b88160d40 2023-05-10T04:20:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.474+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5b88074430 con 0x7f5b88160d40 2023-05-10T04:20:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.474+0000 7f5b6ffff700 1 -- 172.21.15.132:0/1311066613 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5b8001d0a0 con 0x7f5b88160d40 2023-05-10T04:20:01.477 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:01.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5b7406ace0 msgr2=0x7f5b7406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5b7406ace0 0x7f5b7406d190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009130 tx=0x7f5b78008030 comp rx=0 tx=0).stop 2023-05-10T04:20:01.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b88160d40 msgr2=0x7f5b88159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b88160d40 0x7f5b88159e00 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5b8000cd50 tx=0x7f5b8000a560 comp rx=0 tx=0).stop 2023-05-10T04:20:01.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 shutdown_connections 2023-05-10T04:20:01.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5b7406ace0 0x7f5b7406d190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b88160d40 0x7f5b88159e00 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5b880b87a0 0x7f5b8815ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 --2- 172.21.15.132:0/1311066613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5b881601e0 0x7f5b881598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 >> 172.21.15.132:0/1311066613 conn(0x7f5b88071b10 msgr2=0x7f5b880b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 shutdown_connections 2023-05-10T04:20:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.477+0000 7f5b8dfff700 1 -- 172.21.15.132:0/1311066613 wait complete. 2023-05-10T04:20:01.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:01.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.682+0000 7f983b1ff700 1 Processor -- start 2023-05-10T04:20:01.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.682+0000 7f983b1ff700 1 -- start start 2023-05-10T04:20:01.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.683+0000 7f983b1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98340b87a0 0x7f98340cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.683+0000 7f983b1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98341601e0 0x7f9834160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.683+0000 7f983b1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9834160ff0 con 0x7f9834160b70 2023-05-10T04:20:01.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.683+0000 7f983b1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98340d02d0 con 0x7f98340b87a0 2023-05-10T04:20:01.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.683+0000 7f983b1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98340d0cb0 con 0x7f98341601e0 2023-05-10T04:20:01.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f9833fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98341601e0 0x7f9834160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f9838f9b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98340b87a0 0x7f98340cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f9833fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98341601e0 0x7f9834160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:59788/0 (socket says 172.21.15.132:59788) 2023-05-10T04:20:01.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f9833fff700 1 -- 172.21.15.132:0/101264963 learned_addr learned my addr 172.21.15.132:0/101264963 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f983979c700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f9834160b70 0x7f98340d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:42246/0 (socket says 172.21.15.132:42246) 2023-05-10T04:20:01.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f9838f9b700 1 -- 172.21.15.132:0/101264963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98341601e0 msgr2=0x7f9834160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:01.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f9838f9b700 1 --2- 172.21.15.132:0/101264963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98341601e0 0x7f9834160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f9838f9b700 1 -- 172.21.15.132:0/101264963 >> v1:172.21.15.154:6789/0 conn(0x7f9834160b70 legacy=0x7f98340d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f9838f9b700 1 -- 172.21.15.132:0/101264963 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98340cdc60 con 0x7f98340b87a0 2023-05-10T04:20:01.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.684+0000 7f98337fe700 1 -- 172.21.15.132:0/101264963 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005848532 0 0) 0x7f9834160ff0 con 0x7f9834160b70 2023-05-10T04:20:01.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f9838f9b700 1 --2- 172.21.15.132:0/101264963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98340b87a0 0x7f98340cfbf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9828009840 tx=0x7f9828009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cdcb134a6796585 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:01.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f98337fe700 1 -- 172.21.15.132:0/101264963 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828011830 con 0x7f98340b87a0 2023-05-10T04:20:01.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f98337fe700 1 -- 172.21.15.132:0/101264963 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9828011990 con 0x7f98340b87a0 2023-05-10T04:20:01.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f98337fe700 1 -- 172.21.15.132:0/101264963 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9828011d20 con 0x7f98340b87a0 2023-05-10T04:20:01.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f983b1ff700 1 -- 172.21.15.132:0/101264963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98340b87a0 msgr2=0x7f98340cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f983b1ff700 1 --2- 172.21.15.132:0/101264963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98340b87a0 0x7f98340cfbf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9828009840 tx=0x7f9828009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:01.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f983b1ff700 1 -- 172.21.15.132:0/101264963 shutdown_connections 2023-05-10T04:20:01.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f983b1ff700 1 --2- 172.21.15.132:0/101264963 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98340b87a0 0x7f98340cfbf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.685+0000 7f983b1ff700 1 --2- 172.21.15.132:0/101264963 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98341601e0 0x7f9834160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.686+0000 7f983b1ff700 1 -- 172.21.15.132:0/101264963 >> 172.21.15.132:0/101264963 conn(0x7f9834071b10 msgr2=0x7f9834071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:01.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.686+0000 7f983b1ff700 1 -- 172.21.15.132:0/101264963 shutdown_connections 2023-05-10T04:20:01.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.686+0000 7f983b1ff700 1 -- 172.21.15.132:0/101264963 wait complete. 2023-05-10T04:20:01.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.687+0000 7f983b1ff700 1 Processor -- start 2023-05-10T04:20:01.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.687+0000 7f983b1ff700 1 -- start start 2023-05-10T04:20:01.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.688+0000 7f983b1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98340b87a0 0x7f98341513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.688+0000 7f983b1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98341601e0 0x7f98341f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.688+0000 7f983b1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834160b70 0x7f98340cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.688+0000 7f983b1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98341518e0 con 0x7f98341601e0 2023-05-10T04:20:01.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.688+0000 7f983b1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98341f23f0 con 0x7f9834160b70 2023-05-10T04:20:01.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.688+0000 7f983b1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983415d210 con 0x7f98340b87a0 2023-05-10T04:20:01.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98341601e0 0x7f98341f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98341601e0 0x7f98341f3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44906/0 (socket says 172.21.15.132:44906) 2023-05-10T04:20:01.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 -- 172.21.15.132:0/368967618 learned_addr learned my addr 172.21.15.132:0/368967618 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:01.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9838f9b700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98340b87a0 0x7f98341513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f983979c700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834160b70 0x7f98340cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 -- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98340b87a0 msgr2=0x7f98341513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98340b87a0 0x7f98341513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 -- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834160b70 msgr2=0x7f98340cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834160b70 0x7f98340cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 -- 172.21.15.132:0/368967618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98280094a0 con 0x7f98341601e0 2023-05-10T04:20:01.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9838f9b700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98340b87a0 0x7f98341513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:01.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f983979c700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834160b70 0x7f98340cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:01.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f9833fff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98341601e0 0x7f98341f3470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f982000e910 tx=0x7f982000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:01.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f98317fa700 1 -- 172.21.15.132:0/368967618 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98200096a0 con 0x7f98341601e0 2023-05-10T04:20:01.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f98317fa700 1 -- 172.21.15.132:0/368967618 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982000c850 con 0x7f98341601e0 2023-05-10T04:20:01.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98340cd980 con 0x7f98341601e0 2023-05-10T04:20:01.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.689+0000 7f98317fa700 1 -- 172.21.15.132:0/368967618 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982000cc00 con 0x7f98341601e0 2023-05-10T04:20:01.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.690+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98340cd6a0 con 0x7f98341601e0 2023-05-10T04:20:01.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.691+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98340d2110 con 0x7f98341601e0 2023-05-10T04:20:01.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.692+0000 7f98317fa700 1 -- 172.21.15.132:0/368967618 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f982000cd60 con 0x7f98341601e0 2023-05-10T04:20:01.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.693+0000 7f98317fa700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f981806ace0 0x7f981806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:01.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.693+0000 7f98317fa700 1 -- 172.21.15.132:0/368967618 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9820089860 con 0x7f98341601e0 2023-05-10T04:20:01.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.694+0000 7f9838f9b700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f981806ace0 0x7f981806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:01.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.694+0000 7f9838f9b700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f981806ace0 0x7f981806d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9828000c00 tx=0x7f9828008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:01.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.697+0000 7f98317fa700 1 -- 172.21.15.132:0/368967618 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9820054580 con 0x7f98341601e0 2023-05-10T04:20:01.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.895+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9834074430 con 0x7f98341601e0 2023-05-10T04:20:01.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.895+0000 7f98317fa700 1 -- 172.21.15.132:0/368967618 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9820057ba0 con 0x7f98341601e0 2023-05-10T04:20:01.897 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:01.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f981806ace0 msgr2=0x7f981806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f981806ace0 0x7f981806d190 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9828000c00 tx=0x7f9828008030 comp rx=0 tx=0).stop 2023-05-10T04:20:01.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98341601e0 msgr2=0x7f98341f3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:01.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98341601e0 0x7f98341f3470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f982000e910 tx=0x7f982000ecd0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 shutdown_connections 2023-05-10T04:20:01.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f981806ace0 0x7f981806d190 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9834160b70 0x7f98340cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98340b87a0 0x7f98341513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 --2- 172.21.15.132:0/368967618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98341601e0 0x7f98341f3470 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:01.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.897+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 >> 172.21.15.132:0/368967618 conn(0x7f9834071b10 msgr2=0x7f9834071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:01.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.898+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 shutdown_connections 2023-05-10T04:20:01.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:01.898+0000 7f983b1ff700 1 -- 172.21.15.132:0/368967618 wait complete. 2023-05-10T04:20:01.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:02.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.101+0000 7fa290dff700 1 Processor -- start 2023-05-10T04:20:02.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.101+0000 7fa290dff700 1 -- start start 2023-05-10T04:20:02.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.102+0000 7fa290dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa28c0b87a0 0x7fa28c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.102+0000 7fa290dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 0x7fa28c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.102+0000 7fa290dff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28c160ff0 con 0x7fa28c160b70 2023-05-10T04:20:02.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.102+0000 7fa290dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa28c0d02d0 con 0x7fa28c0b87a0 2023-05-10T04:20:02.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.102+0000 7fa290dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0d0cb0 con 0x7fa28c1601e0 2023-05-10T04:20:02.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.102+0000 7fa28ad9d700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa28c160b70 0x7fa28c0d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44474/0 (socket says 172.21.15.132:44474) 2023-05-10T04:20:02.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.102+0000 7fa28ad9d700 1 -- 172.21.15.132:0/2233888347 learned_addr learned my addr 172.21.15.132:0/2233888347 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942395995 0 0) 0x7fa28c160ff0 con 0x7fa28c160b70 2023-05-10T04:20:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2740035b0 con 0x7fa28c160b70 2023-05-10T04:20:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa289d9b700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 0x7fa28c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28a59c700 1 --2- 172.21.15.132:0/2233888347 >> v2:172.21.15.154:3300/0 conn(0x7fa28c0b87a0 0x7fa28c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3237886387 0 0) 0x7fa2740035b0 con 0x7fa28c160b70 2023-05-10T04:20:02.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 msgr2=0x7fa28c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 0x7fa28c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 >> v2:172.21.15.154:3300/0 conn(0x7fa28c0b87a0 msgr2=0x7fa28c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 --2- 172.21.15.132:0/2233888347 >> v2:172.21.15.154:3300/0 conn(0x7fa28c0b87a0 0x7fa28c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0cdc60 con 0x7fa28c160b70 2023-05-10T04:20:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fa2840019f0 con 0x7fa28c160b70 2023-05-10T04:20:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 >> v1:172.21.15.132:6789/0 conn(0x7fa28c160b70 legacy=0x7fa28c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274003a00 0x7fa274003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa274004430 0x7fa2740048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 0x7fa274005070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0d02d0 con 0x7fa274003a00 2023-05-10T04:20:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27400ba10 con 0x7fa274004430 2023-05-10T04:20:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27400bb50 con 0x7fa28c1601e0 2023-05-10T04:20:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.103+0000 7fa28a59c700 1 --2- 172.21.15.132:0/2233888347 >> v2:172.21.15.154:3300/0 conn(0x7fa28c0b87a0 0x7fa28c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28a59c700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274003a00 0x7fa274003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28ad9d700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 0x7fa274005070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa289d9b700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa274004430 0x7fa2740048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28a59c700 1 -- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 msgr2=0x7fa274005070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28a59c700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 0x7fa274005070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28a59c700 1 -- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa274004430 msgr2=0x7fa2740048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28a59c700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa274004430 0x7fa2740048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28a59c700 1 -- 172.21.15.132:0/2233888347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740035b0 con 0x7fa274003a00 2023-05-10T04:20:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28ad9d700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa28c1601e0 0x7fa274005070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:02.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28a59c700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274003a00 0x7fa274003e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009930 tx=0x7fa274005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48618768d4b203d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00c070 con 0x7fa274003a00 2023-05-10T04:20:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c004230 con 0x7fa274003a00 2023-05-10T04:20:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.104+0000 7fa28959a700 1 -- 172.21.15.132:0/2233888347 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c0036a0 con 0x7fa274003a00 2023-05-10T04:20:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.105+0000 7fa290dff700 1 -- 172.21.15.132:0/2233888347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274003a00 msgr2=0x7fa274003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.105+0000 7fa290dff700 1 --2- 172.21.15.132:0/2233888347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274003a00 0x7fa274003e10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009930 tx=0x7fa274005880 comp rx=0 tx=0).stop 2023-05-10T04:20:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.105+0000 7fa28ad9d700 1 -- 172.21.15.132:0/2233888347 reap_dead start 2023-05-10T04:20:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.105+0000 7fa290dff700 1 -- 172.21.15.132:0/2233888347 shutdown_connections 2023-05-10T04:20:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.105+0000 7fa290dff700 1 -- 172.21.15.132:0/2233888347 >> 172.21.15.132:0/2233888347 conn(0x7fa28c071b10 msgr2=0x7fa28c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.105+0000 7fa290dff700 1 -- 172.21.15.132:0/2233888347 shutdown_connections 2023-05-10T04:20:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.105+0000 7fa290dff700 1 -- 172.21.15.132:0/2233888347 wait complete. 2023-05-10T04:20:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.107+0000 7fa290dff700 1 Processor -- start 2023-05-10T04:20:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.107+0000 7fa290dff700 1 -- start start 2023-05-10T04:20:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa290dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa274003a00 0x7fa28c15d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa290dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c150c00 0x7fa28c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa290dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c151120 0x7fa28c159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa290dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0ca7b0 con 0x7fa28c150c00 2023-05-10T04:20:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa290dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0caa90 con 0x7fa28c151120 2023-05-10T04:20:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa290dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28c0cad70 con 0x7fa274003a00 2023-05-10T04:20:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa289d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c150c00 0x7fa28c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa289d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c150c00 0x7fa28c0c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44922/0 (socket says 172.21.15.132:44922) 2023-05-10T04:20:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa289d9b700 1 -- 172.21.15.132:0/3444973248 learned_addr learned my addr 172.21.15.132:0/3444973248 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa289d9b700 1 -- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa274003a00 msgr2=0x7fa28c15d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa28ad9d700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c151120 0x7fa28c159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa28a59c700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa274003a00 0x7fa28c15d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa289d9b700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa274003a00 0x7fa28c15d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa289d9b700 1 -- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c151120 msgr2=0x7fa28c159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa289d9b700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c151120 0x7fa28c159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa289d9b700 1 -- 172.21.15.132:0/3444973248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28c0cd980 con 0x7fa28c150c00 2023-05-10T04:20:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa28ad9d700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c151120 0x7fa28c159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.108+0000 7fa28a59c700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa274003a00 0x7fa28c15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.109+0000 7fa289d9b700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c150c00 0x7fa28c0c9f80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa280011660 tx=0x7fa280011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.109+0000 7fa27affd700 1 -- 172.21.15.132:0/3444973248 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280015870 con 0x7fa28c150c00 2023-05-10T04:20:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.109+0000 7fa27affd700 1 -- 172.21.15.132:0/3444973248 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2800159d0 con 0x7fa28c150c00 2023-05-10T04:20:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.109+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c0cd6a0 con 0x7fa28c150c00 2023-05-10T04:20:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.109+0000 7fa27affd700 1 -- 172.21.15.132:0/3444973248 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280015d40 con 0x7fa28c150c00 2023-05-10T04:20:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.109+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28c0d2110 con 0x7fa28c150c00 2023-05-10T04:20:02.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.110+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28c0b8b70 con 0x7fa28c150c00 2023-05-10T04:20:02.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.111+0000 7fa27affd700 1 -- 172.21.15.132:0/3444973248 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa280013400 con 0x7fa28c150c00 2023-05-10T04:20:02.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:20:02.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.112+0000 7fa27affd700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa26c06ace0 0x7fa26c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.112+0000 7fa27affd700 1 -- 172.21.15.132:0/3444973248 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa280089ae0 con 0x7fa28c150c00 2023-05-10T04:20:02.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.112+0000 7fa28a59c700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa26c06ace0 0x7fa26c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.113+0000 7fa28a59c700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa26c06ace0 0x7fa26c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009930 tx=0x7fa27c00c000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.116+0000 7fa27affd700 1 -- 172.21.15.132:0/3444973248 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa2800583c0 con 0x7fa28c150c00 2023-05-10T04:20:02.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:20:02.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.316+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa28c0b52f0 con 0x7fa28c150c00 2023-05-10T04:20:02.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.318+0000 7fa27affd700 1 -- 172.21.15.132:0/3444973248 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fa280057f50 con 0x7fa28c150c00 2023-05-10T04:20:02.320 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:02.320 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:02.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa26c06ace0 msgr2=0x7fa26c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa26c06ace0 0x7fa26c06d190 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009930 tx=0x7fa27c00c000 comp rx=0 tx=0).stop 2023-05-10T04:20:02.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c150c00 msgr2=0x7fa28c0c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c150c00 0x7fa28c0c9f80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa280011660 tx=0x7fa280011a20 comp rx=0 tx=0).stop 2023-05-10T04:20:02.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 shutdown_connections 2023-05-10T04:20:02.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa26c06ace0 0x7fa26c06d190 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa28c151120 0x7fa28c159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa274003a00 0x7fa28c15d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 --2- 172.21.15.132:0/3444973248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa28c150c00 0x7fa28c0c9f80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 >> 172.21.15.132:0/3444973248 conn(0x7fa28c071b10 msgr2=0x7fa28c0d3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:02.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 shutdown_connections 2023-05-10T04:20:02.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.320+0000 7fa290dff700 1 -- 172.21.15.132:0/3444973248 wait complete. 2023-05-10T04:20:02.340 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:02.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:02.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.526+0000 7f49eebff700 1 Processor -- start 2023-05-10T04:20:02.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.526+0000 7f49eebff700 1 -- start start 2023-05-10T04:20:02.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.527+0000 7f49eebff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f49e80adf70 0x7f49e80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.527+0000 7f49eebff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e815cf10 0x7f49e806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49eebff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80cc9e0 con 0x7f49e80cd760 2023-05-10T04:20:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49eebff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e815de20 con 0x7f49e80adf70 2023-05-10T04:20:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49eebff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e815d860 con 0x7f49e815cf10 2023-05-10T04:20:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49ec99b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f49e80cd760 0x7f49e80cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44486/0 (socket says 172.21.15.132:44486) 2023-05-10T04:20:02.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49ec99b700 1 -- 172.21.15.132:0/3540093613 learned_addr learned my addr 172.21.15.132:0/3540093613 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:02.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49e7fff700 1 --2- 172.21.15.132:0/3540093613 >> v2:172.21.15.154:3300/0 conn(0x7f49e80adf70 0x7f49e80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49ed19c700 1 --2- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e815cf10 0x7f49e806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49e77fe700 1 -- 172.21.15.132:0/3540093613 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034781861 0 0) 0x7f49e80cc9e0 con 0x7f49e80cd760 2023-05-10T04:20:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.528+0000 7f49e77fe700 1 -- 172.21.15.132:0/3540093613 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d80035b0 con 0x7f49e80cd760 2023-05-10T04:20:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49e7fff700 1 -- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e815cf10 msgr2=0x7f49e806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:02.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49e7fff700 1 --2- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e815cf10 0x7f49e806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49e7fff700 1 -- 172.21.15.132:0/3540093613 >> v1:172.21.15.132:6789/0 conn(0x7f49e80cd760 legacy=0x7f49e80cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49e7fff700 1 -- 172.21.15.132:0/3540093613 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e815db40 con 0x7f49e80adf70 2023-05-10T04:20:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49ed19c700 1 --2- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e815cf10 0x7f49e806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49e7fff700 1 --2- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80adf70 0x7f49e80cce70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009820 tx=0x7f49d4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71cefeb6522ec13d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49e77fe700 1 -- 172.21.15.132:0/3540093613 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d4005e30 con 0x7f49e80adf70 2023-05-10T04:20:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49e77fe700 1 -- 172.21.15.132:0/3540093613 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d4006030 con 0x7f49e80adf70 2023-05-10T04:20:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.529+0000 7f49e77fe700 1 -- 172.21.15.132:0/3540093613 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d40063c0 con 0x7f49e80adf70 2023-05-10T04:20:02.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.530+0000 7f49eebff700 1 -- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80adf70 msgr2=0x7f49e80cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.530+0000 7f49eebff700 1 --2- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80adf70 0x7f49e80cce70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f49d4009820 tx=0x7f49d4009b30 comp rx=0 tx=0).stop 2023-05-10T04:20:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.530+0000 7f49eebff700 1 -- 172.21.15.132:0/3540093613 shutdown_connections 2023-05-10T04:20:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.530+0000 7f49eebff700 1 --2- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e815cf10 0x7f49e806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.530+0000 7f49eebff700 1 --2- 172.21.15.132:0/3540093613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80adf70 0x7f49e80cce70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.530+0000 7f49eebff700 1 -- 172.21.15.132:0/3540093613 >> 172.21.15.132:0/3540093613 conn(0x7f49e80cf720 msgr2=0x7f49e80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.530+0000 7f49eebff700 1 -- 172.21.15.132:0/3540093613 shutdown_connections 2023-05-10T04:20:02.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.530+0000 7f49eebff700 1 -- 172.21.15.132:0/3540093613 wait complete. 2023-05-10T04:20:02.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.531+0000 7f49eebff700 1 Processor -- start 2023-05-10T04:20:02.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.532+0000 7f49eebff700 1 -- start start 2023-05-10T04:20:02.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.532+0000 7f49eebff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e80adf70 0x7f49e806a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49eebff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80cd760 0x7f49e80b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49eebff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49e815cf10 0x7f49e814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49eebff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e8150f20 con 0x7f49e815cf10 2023-05-10T04:20:02.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49eebff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e81511c0 con 0x7f49e80cd760 2023-05-10T04:20:02.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49eebff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e81514a0 con 0x7f49e80adf70 2023-05-10T04:20:02.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49e815cf10 0x7f49e814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49e815cf10 0x7f49e814eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49820/0 (socket says 172.21.15.132:49820) 2023-05-10T04:20:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 -- 172.21.15.132:0/14177036 learned_addr learned my addr 172.21.15.132:0/14177036 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ec99b700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e80adf70 0x7f49e806a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49e7fff700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80cd760 0x7f49e80b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 -- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e80adf70 msgr2=0x7f49e806a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e80adf70 0x7f49e806a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 -- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80cd760 msgr2=0x7f49e80b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80cd760 0x7f49e80b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 -- 172.21.15.132:0/14177036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e00094a0 con 0x7f49e815cf10 2023-05-10T04:20:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49e7fff700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80cd760 0x7f49e80b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.533+0000 7f49ed19c700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49e815cf10 0x7f49e814eb90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f49e000e930 tx=0x7f49e000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.534+0000 7f49e57fa700 1 -- 172.21.15.132:0/14177036 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0009700 con 0x7f49e815cf10 2023-05-10T04:20:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.534+0000 7f49e57fa700 1 -- 172.21.15.132:0/14177036 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e000ee80 con 0x7f49e815cf10 2023-05-10T04:20:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.534+0000 7f49e57fa700 1 -- 172.21.15.132:0/14177036 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0004240 con 0x7f49e815cf10 2023-05-10T04:20:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.534+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d4009430 con 0x7f49e815cf10 2023-05-10T04:20:02.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.534+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e8071600 con 0x7f49e815cf10 2023-05-10T04:20:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.535+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e80cc670 con 0x7f49e815cf10 2023-05-10T04:20:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.536+0000 7f49e57fa700 1 -- 172.21.15.132:0/14177036 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f49e00043e0 con 0x7f49e815cf10 2023-05-10T04:20:02.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.537+0000 7f49e57fa700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f49cc06ace0 0x7f49cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.537+0000 7f49e57fa700 1 -- 172.21.15.132:0/14177036 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f49e0089440 con 0x7f49e815cf10 2023-05-10T04:20:02.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.537+0000 7f49ec99b700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f49cc06ace0 0x7f49cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.538+0000 7f49ec99b700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f49cc06ace0 0x7f49cc06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001560 tx=0x7f49dc001a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.541+0000 7f49e57fa700 1 -- 172.21.15.132:0/14177036 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f49e0057c90 con 0x7f49e815cf10 2023-05-10T04:20:02.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.738+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f49e80cd3b0 con 0x7f49e815cf10 2023-05-10T04:20:02.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.739+0000 7f49e57fa700 1 -- 172.21.15.132:0/14177036 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f49e0057820 con 0x7f49e815cf10 2023-05-10T04:20:02.741 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:02.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f49cc06ace0 msgr2=0x7f49cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f49cc06ace0 0x7f49cc06d190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001560 tx=0x7f49dc001a90 comp rx=0 tx=0).stop 2023-05-10T04:20:02.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49e815cf10 msgr2=0x7f49e814eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49e815cf10 0x7f49e814eb90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f49e000e930 tx=0x7f49e000ec40 comp rx=0 tx=0).stop 2023-05-10T04:20:02.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 shutdown_connections 2023-05-10T04:20:02.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f49cc06ace0 0x7f49cc06d190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49e815cf10 0x7f49e814eb90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f49e80adf70 0x7f49e806a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 --2- 172.21.15.132:0/14177036 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f49e80cd760 0x7f49e80b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.741+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 >> 172.21.15.132:0/14177036 conn(0x7f49e80cf720 msgr2=0x7f49e806d480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:02.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.742+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 shutdown_connections 2023-05-10T04:20:02.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.742+0000 7f49eebff700 1 -- 172.21.15.132:0/14177036 wait complete. 2023-05-10T04:20:02.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:02.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.943+0000 7fb499bff700 1 Processor -- start 2023-05-10T04:20:02.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.943+0000 7fb499bff700 1 -- start start 2023-05-10T04:20:02.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.944+0000 7fb499bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4940cfbf0 0x7fb4941608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.944+0000 7fb499bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb499bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4940d0020 con 0x7fb4940b87a0 2023-05-10T04:20:02.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb499bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4940d02d0 con 0x7fb4940cfbf0 2023-05-10T04:20:02.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb499bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940d0cb0 con 0x7fb4940d1100 2023-05-10T04:20:02.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb48bfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4940cfbf0 0x7fb4941608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb48bfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4940cfbf0 0x7fb4941608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49826/0 (socket says 172.21.15.132:49826) 2023-05-10T04:20:02.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb48bfff700 1 -- 172.21.15.132:0/3176824497 learned_addr learned my addr 172.21.15.132:0/3176824497 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:02.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb493fff700 1 --2- 172.21.15.132:0/3176824497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb48bfff700 1 -- 172.21.15.132:0/3176824497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 msgr2=0x7fb4940d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:02.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb48bfff700 1 --2- 172.21.15.132:0/3176824497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb48bfff700 1 -- 172.21.15.132:0/3176824497 >> v1:172.21.15.154:6789/0 conn(0x7fb4940b87a0 legacy=0x7fb4941601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb48bfff700 1 -- 172.21.15.132:0/3176824497 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4940cdc60 con 0x7fb4940cfbf0 2023-05-10T04:20:02.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.945+0000 7fb48bfff700 1 --2- 172.21.15.132:0/3176824497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940cfbf0 0x7fb4941608f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0098f0 tx=0x7fb47c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6879c3ce8266f89a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb492ffd700 1 -- 172.21.15.132:0/3176824497 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00b8a0 con 0x7fb4940cfbf0 2023-05-10T04:20:02.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb492ffd700 1 -- 172.21.15.132:0/3176824497 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c00ba00 con 0x7fb4940cfbf0 2023-05-10T04:20:02.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb492ffd700 1 -- 172.21.15.132:0/3176824497 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00bd90 con 0x7fb4940cfbf0 2023-05-10T04:20:02.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb499bff700 1 -- 172.21.15.132:0/3176824497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940cfbf0 msgr2=0x7fb4941608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb499bff700 1 --2- 172.21.15.132:0/3176824497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940cfbf0 0x7fb4941608f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb47c0098f0 tx=0x7fb47c009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:02.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb499bff700 1 -- 172.21.15.132:0/3176824497 shutdown_connections 2023-05-10T04:20:02.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb499bff700 1 --2- 172.21.15.132:0/3176824497 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb499bff700 1 --2- 172.21.15.132:0/3176824497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940cfbf0 0x7fb4941608f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb499bff700 1 -- 172.21.15.132:0/3176824497 >> 172.21.15.132:0/3176824497 conn(0x7fb494071b10 msgr2=0x7fb494071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:02.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb499bff700 1 -- 172.21.15.132:0/3176824497 shutdown_connections 2023-05-10T04:20:02.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.946+0000 7fb499bff700 1 -- 172.21.15.132:0/3176824497 wait complete. 2023-05-10T04:20:02.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.948+0000 7fb499bff700 1 Processor -- start 2023-05-10T04:20:02.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.948+0000 7fb499bff700 1 -- start start 2023-05-10T04:20:02.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb499bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940b87a0 0x7fb49414b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb499bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4940cfbf0 0x7fb494157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb499bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb499bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49414b7a0 con 0x7fb4940b87a0 2023-05-10T04:20:02.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb499bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494157e50 con 0x7fb4940cfbf0 2023-05-10T04:20:02.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb499bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb494158130 con 0x7fb4940d1100 2023-05-10T04:20:02.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb4937fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940b87a0 0x7fb49414b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb4937fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940b87a0 0x7fb49414b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49832/0 (socket says 172.21.15.132:49832) 2023-05-10T04:20:02.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.949+0000 7fb4937fe700 1 -- 172.21.15.132:0/4175695186 learned_addr learned my addr 172.21.15.132:0/4175695186 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:02.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb48bfff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4940cfbf0 0x7fb494157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb493fff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb4937fe700 1 -- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 msgr2=0x7fb4940c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb4937fe700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb4937fe700 1 -- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4940cfbf0 msgr2=0x7fb494157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:02.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb4937fe700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4940cfbf0 0x7fb494157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:02.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb4937fe700 1 -- 172.21.15.132:0/4175695186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c009550 con 0x7fb4940b87a0 2023-05-10T04:20:02.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb493fff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:02.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb48bfff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4940cfbf0 0x7fb494157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:02.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb4937fe700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940b87a0 0x7fb49414b260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c450 tx=0x7fb48400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb490ff9700 1 -- 172.21.15.132:0/4175695186 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4840052d0 con 0x7fb4940b87a0 2023-05-10T04:20:02.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb490ff9700 1 -- 172.21.15.132:0/4175695186 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb484005430 con 0x7fb4940b87a0 2023-05-10T04:20:02.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4940cd980 con 0x7fb4940b87a0 2023-05-10T04:20:02.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.950+0000 7fb490ff9700 1 -- 172.21.15.132:0/4175695186 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4840038c0 con 0x7fb4940b87a0 2023-05-10T04:20:02.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.951+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4940cd6a0 con 0x7fb4940b87a0 2023-05-10T04:20:02.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.951+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494160e30 con 0x7fb4940b87a0 2023-05-10T04:20:02.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.952+0000 7fb490ff9700 1 -- 172.21.15.132:0/4175695186 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb484003a20 con 0x7fb4940b87a0 2023-05-10T04:20:02.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.953+0000 7fb490ff9700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb47406ace0 0x7fb47406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:02.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.953+0000 7fb490ff9700 1 -- 172.21.15.132:0/4175695186 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb484088b20 con 0x7fb4940b87a0 2023-05-10T04:20:02.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.954+0000 7fb48bfff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb47406ace0 0x7fb47406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:02.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.954+0000 7fb48bfff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb47406ace0 0x7fb47406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb49415f190 tx=0x7fb47c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:02.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:02.957+0000 7fb490ff9700 1 -- 172.21.15.132:0/4175695186 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb4840538d0 con 0x7fb4940b87a0 2023-05-10T04:20:03.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.151+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb49415cce0 con 0x7fb4940b87a0 2023-05-10T04:20:03.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.152+0000 7fb490ff9700 1 -- 172.21.15.132:0/4175695186 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb49415cce0 con 0x7fb4940b87a0 2023-05-10T04:20:03.154 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:03.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb47406ace0 msgr2=0x7fb47406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb47406ace0 0x7fb47406d190 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb49415f190 tx=0x7fb47c008030 comp rx=0 tx=0).stop 2023-05-10T04:20:03.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940b87a0 msgr2=0x7fb49414b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940b87a0 0x7fb49414b260 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb48400c450 tx=0x7fb48400c810 comp rx=0 tx=0).stop 2023-05-10T04:20:03.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 shutdown_connections 2023-05-10T04:20:03.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb47406ace0 0x7fb47406d190 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4940d1100 0x7fb4940c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4940b87a0 0x7fb49414b260 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 --2- 172.21.15.132:0/4175695186 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4940cfbf0 0x7fb494157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 >> 172.21.15.132:0/4175695186 conn(0x7fb494071b10 msgr2=0x7fb4940b7cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:03.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 shutdown_connections 2023-05-10T04:20:03.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.154+0000 7fb499bff700 1 -- 172.21.15.132:0/4175695186 wait complete. 2023-05-10T04:20:03.172 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:03.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.357+0000 7f99bc3ff700 1 Processor -- start 2023-05-10T04:20:03.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.357+0000 7f99bc3ff700 1 -- start start 2023-05-10T04:20:03.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.358+0000 7f99bc3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f99b406b4f0 0x7f99b406b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.358+0000 7f99bc3ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99b40d0130 0x7f99b40cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.358+0000 7f99bc3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 0x7f99b40cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.358+0000 7f99bc3ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b40b26f0 con 0x7f99b40d0130 2023-05-10T04:20:03.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.358+0000 7f99bc3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b406be00 con 0x7f99b406b4f0 2023-05-10T04:20:03.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.358+0000 7f99bc3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40cf890 con 0x7f99b40cd7d0 2023-05-10T04:20:03.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.358+0000 7f99b999a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99b40d0130 0x7f99b40cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b999a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99b40d0130 0x7f99b40cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49836/0 (socket says 172.21.15.132:49836) 2023-05-10T04:20:03.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b999a700 1 -- 172.21.15.132:0/2874847653 learned_addr learned my addr 172.21.15.132:0/2874847653 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:03.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99ba99c700 1 --2- 172.21.15.132:0/2874847653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 0x7f99b40cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99ba19b700 1 --2- 172.21.15.132:0/2874847653 >> v2:172.21.15.154:3300/0 conn(0x7f99b406b4f0 0x7f99b406b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b999a700 1 -- 172.21.15.132:0/2874847653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 msgr2=0x7f99b40cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:03.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b999a700 1 --2- 172.21.15.132:0/2874847653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 0x7f99b40cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b999a700 1 -- 172.21.15.132:0/2874847653 >> v2:172.21.15.154:3300/0 conn(0x7f99b406b4f0 msgr2=0x7f99b406b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:03.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b999a700 1 --2- 172.21.15.132:0/2874847653 >> v2:172.21.15.154:3300/0 conn(0x7f99b406b4f0 0x7f99b406b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b999a700 1 -- 172.21.15.132:0/2874847653 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b40cfb60 con 0x7f99b40d0130 2023-05-10T04:20:03.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b999a700 1 --2- 172.21.15.132:0/2874847653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40cf350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f99a40098f0 tx=0x7f99a4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a2197d8be8f7b4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:03.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b9199700 1 -- 172.21.15.132:0/2874847653 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400b860 con 0x7f99b40d0130 2023-05-10T04:20:03.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b9199700 1 -- 172.21.15.132:0/2874847653 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a400b9c0 con 0x7f99b40d0130 2023-05-10T04:20:03.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.359+0000 7f99b9199700 1 -- 172.21.15.132:0/2874847653 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a400bd50 con 0x7f99b40d0130 2023-05-10T04:20:03.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 -- 172.21.15.132:0/2874847653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 msgr2=0x7f99b40cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/2874847653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40cf350 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f99a40098f0 tx=0x7f99a4009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:03.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 -- 172.21.15.132:0/2874847653 shutdown_connections 2023-05-10T04:20:03.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/2874847653 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 0x7f99b40cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/2874847653 >> v2:172.21.15.154:3300/0 conn(0x7f99b406b4f0 0x7f99b406b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/2874847653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40cf350 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 -- 172.21.15.132:0/2874847653 >> 172.21.15.132:0/2874847653 conn(0x7f99b409a090 msgr2=0x7f99b40d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:03.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 -- 172.21.15.132:0/2874847653 shutdown_connections 2023-05-10T04:20:03.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.360+0000 7f99bc3ff700 1 -- 172.21.15.132:0/2874847653 wait complete. 2023-05-10T04:20:03.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.362+0000 7f99bc3ff700 1 Processor -- start 2023-05-10T04:20:03.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.363+0000 7f99bc3ff700 1 -- start start 2023-05-10T04:20:03.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99bc3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b406b4f0 0x7f99b4158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99bc3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 0x7f99b4158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99bc3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99bc3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40b6290 con 0x7f99b40d0130 2023-05-10T04:20:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99bc3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40b3bf0 con 0x7f99b406b4f0 2023-05-10T04:20:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99bc3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b40b59f0 con 0x7f99b40cd7d0 2023-05-10T04:20:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99ba99c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99ba99c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40b4320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49848/0 (socket says 172.21.15.132:49848) 2023-05-10T04:20:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99ba99c700 1 -- 172.21.15.132:0/3902971702 learned_addr learned my addr 172.21.15.132:0/3902971702 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99ba19b700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b406b4f0 0x7f99b4158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99b999a700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 0x7f99b4158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99ba99c700 1 -- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 msgr2=0x7f99b4158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99ba99c700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 0x7f99b4158640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99ba99c700 1 -- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b406b4f0 msgr2=0x7f99b4158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.364+0000 7f99ba99c700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b406b4f0 0x7f99b4158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.365+0000 7f99ba99c700 1 -- 172.21.15.132:0/3902971702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a4009550 con 0x7f99b40d0130 2023-05-10T04:20:03.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.365+0000 7f99ba19b700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b406b4f0 0x7f99b4158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:03.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.365+0000 7f99ba99c700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40b4320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f99ac007e40 tx=0x7f99ac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:03.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.365+0000 7f99aaffd700 1 -- 172.21.15.132:0/3902971702 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00eea0 con 0x7f99b40d0130 2023-05-10T04:20:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.365+0000 7f99aaffd700 1 -- 172.21.15.132:0/3902971702 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac014420 con 0x7f99b40d0130 2023-05-10T04:20:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.365+0000 7f99aaffd700 1 -- 172.21.15.132:0/3902971702 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac0147b0 con 0x7f99b40d0130 2023-05-10T04:20:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.365+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b40cb4b0 con 0x7f99b40d0130 2023-05-10T04:20:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.365+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b40cfe40 con 0x7f99b40d0130 2023-05-10T04:20:03.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.366+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b40cb790 con 0x7f99b40d0130 2023-05-10T04:20:03.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.367+0000 7f99aaffd700 1 -- 172.21.15.132:0/3902971702 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f99ac014910 con 0x7f99b40d0130 2023-05-10T04:20:03.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.368+0000 7f99aaffd700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f999806ace0 0x7f999806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.368+0000 7f99aaffd700 1 -- 172.21.15.132:0/3902971702 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f99ac089ff0 con 0x7f99b40d0130 2023-05-10T04:20:03.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.368+0000 7f99ba19b700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f999806ace0 0x7f999806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.369+0000 7f99ba19b700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f999806ace0 0x7f999806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f99b40cd500 tx=0x7f99b0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:03.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.372+0000 7f99aaffd700 1 -- 172.21.15.132:0/3902971702 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f99ac054d10 con 0x7f99b40d0130 2023-05-10T04:20:03.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.572+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99b4074430 con 0x7f99b40d0130 2023-05-10T04:20:03.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.572+0000 7f99aaffd700 1 -- 172.21.15.132:0/3902971702 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99ac058330 con 0x7f99b40d0130 2023-05-10T04:20:03.574 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:03.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.574+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f999806ace0 msgr2=0x7f999806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.574+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f999806ace0 0x7f999806d190 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f99b40cd500 tx=0x7f99b0008040 comp rx=0 tx=0).stop 2023-05-10T04:20:03.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.574+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 msgr2=0x7f99b40b4320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40b4320 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f99ac007e40 tx=0x7f99ac00e3c0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 shutdown_connections 2023-05-10T04:20:03.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f999806ace0 0x7f999806d190 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b40d0130 0x7f99b40b4320 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f99b406b4f0 0x7f99b4158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 --2- 172.21.15.132:0/3902971702 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f99b40cd7d0 0x7f99b4158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 >> 172.21.15.132:0/3902971702 conn(0x7f99b409a090 msgr2=0x7f99b40cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:03.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 shutdown_connections 2023-05-10T04:20:03.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.575+0000 7f99bc3ff700 1 -- 172.21.15.132:0/3902971702 wait complete. 2023-05-10T04:20:03.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:03.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.779+0000 7fc61d9ff700 1 Processor -- start 2023-05-10T04:20:03.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.779+0000 7fc61d9ff700 1 -- start start 2023-05-10T04:20:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.780+0000 7fc61d9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61815c590 0x7fc618160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.780+0000 7fc61d9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6180cd520 con 0x7fc6180cf010 2023-05-10T04:20:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.780+0000 7fc61d9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6180d2640 con 0x7fc6180cff50 2023-05-10T04:20:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.780+0000 7fc61d9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6181610d0 con 0x7fc61815c590 2023-05-10T04:20:03.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.780+0000 7fc60ffff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc6180cf010 0x7fc6180cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32858/0 (socket says 172.21.15.132:32858) 2023-05-10T04:20:03.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.780+0000 7fc60ffff700 1 -- 172.21.15.132:0/1970508710 learned_addr learned my addr 172.21.15.132:0/1970508710 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:03.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc616ffd700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61815c590 0x7fc618160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253690944 0 0) 0x7fc6180cd520 con 0x7fc6180cf010 2023-05-10T04:20:03.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6040035b0 con 0x7fc6180cf010 2023-05-10T04:20:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429222882 0 0) 0x7fc6180d2640 con 0x7fc6180cff50 2023-05-10T04:20:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6180cd520 con 0x7fc6180cff50 2023-05-10T04:20:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3980232456 0 0) 0x7fc6040035b0 con 0x7fc6180cf010 2023-05-10T04:20:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61815c590 msgr2=0x7fc618160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61815c590 0x7fc618160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 >> v1:172.21.15.154:6789/0 conn(0x7fc6180cff50 legacy=0x7fc6180d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180b23c0 con 0x7fc6180cf010 2023-05-10T04:20:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fc600001670 con 0x7fc6180cf010 2023-05-10T04:20:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 >> v1:172.21.15.132:6789/0 conn(0x7fc6180cf010 legacy=0x7fc6180cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61815c590 0x7fc604003bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc604004120 0x7fc604004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004d90 0x7fc604005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6181610d0 con 0x7fc604004120 2023-05-10T04:20:03.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc60400bac0 con 0x7fc604004d90 2023-05-10T04:20:03.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc60400bc80 con 0x7fc61815c590 2023-05-10T04:20:03.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.781+0000 7fc60ffff700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc604004120 0x7fc604004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc6177fe700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004d90 0x7fc604005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc616ffd700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61815c590 0x7fc604003bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc60ffff700 1 -- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61815c590 msgr2=0x7fc604003bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc60ffff700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc61815c590 0x7fc604003bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc60ffff700 1 -- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004d90 msgr2=0x7fc604005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc60ffff700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004d90 0x7fc604005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc60ffff700 1 -- 172.21.15.132:0/1970508710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040035b0 con 0x7fc604004120 2023-05-10T04:20:03.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc60ffff700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc604004120 0x7fc604004850 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc600001eb0 tx=0x7fc604005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893afa5359272d4c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:03.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000cd20 con 0x7fc604004120 2023-05-10T04:20:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc600005960 con 0x7fc604004120 2023-05-10T04:20:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.782+0000 7fc6167fc700 1 -- 172.21.15.132:0/1970508710 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60000cea0 con 0x7fc604004120 2023-05-10T04:20:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.783+0000 7fc61d9ff700 1 -- 172.21.15.132:0/1970508710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc604004120 msgr2=0x7fc604004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.783+0000 7fc61d9ff700 1 --2- 172.21.15.132:0/1970508710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc604004120 0x7fc604004850 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc600001eb0 tx=0x7fc604005880 comp rx=0 tx=0).stop 2023-05-10T04:20:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.783+0000 7fc6177fe700 1 -- 172.21.15.132:0/1970508710 reap_dead start 2023-05-10T04:20:03.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.783+0000 7fc61d9ff700 1 -- 172.21.15.132:0/1970508710 shutdown_connections 2023-05-10T04:20:03.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.783+0000 7fc61d9ff700 1 -- 172.21.15.132:0/1970508710 >> 172.21.15.132:0/1970508710 conn(0x7fc618071b10 msgr2=0x7fc618071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:03.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.783+0000 7fc61d9ff700 1 -- 172.21.15.132:0/1970508710 shutdown_connections 2023-05-10T04:20:03.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.783+0000 7fc61d9ff700 1 -- 172.21.15.132:0/1970508710 wait complete. 2023-05-10T04:20:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.785+0000 7fc61d9ff700 1 Processor -- start 2023-05-10T04:20:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.785+0000 7fc61d9ff700 1 -- start start 2023-05-10T04:20:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc61d9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004120 0x7fc61815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc61d9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc61815b340 0x7fc6180b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc61d9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6180c6a00 0x7fc61815f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc61d9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61815e180 con 0x7fc61815b340 2023-05-10T04:20:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc61d9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61815e420 con 0x7fc604004120 2023-05-10T04:20:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc61d9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61815e700 con 0x7fc6180c6a00 2023-05-10T04:20:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc60ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc61815b340 0x7fc6180b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc60ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc61815b340 0x7fc6180b75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49860/0 (socket says 172.21.15.132:49860) 2023-05-10T04:20:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc60ffff700 1 -- 172.21.15.132:0/849641042 learned_addr learned my addr 172.21.15.132:0/849641042 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc6177fe700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6180c6a00 0x7fc61815f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc616ffd700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004120 0x7fc61815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc60ffff700 1 -- 172.21.15.132:0/849641042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6180c6a00 msgr2=0x7fc61815f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc60ffff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6180c6a00 0x7fc61815f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc60ffff700 1 -- 172.21.15.132:0/849641042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004120 msgr2=0x7fc61815d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc60ffff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004120 0x7fc61815d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.786+0000 7fc60ffff700 1 -- 172.21.15.132:0/849641042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6180cd770 con 0x7fc61815b340 2023-05-10T04:20:03.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.787+0000 7fc60ffff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc61815b340 0x7fc6180b75a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc6040047d0 tx=0x7fc600001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.787+0000 7fc614ff9700 1 -- 172.21.15.132:0/849641042 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600004870 con 0x7fc61815b340 2023-05-10T04:20:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.787+0000 7fc614ff9700 1 -- 172.21.15.132:0/849641042 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6000049d0 con 0x7fc61815b340 2023-05-10T04:20:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.787+0000 7fc614ff9700 1 -- 172.21.15.132:0/849641042 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc600004d60 con 0x7fc61815b340 2023-05-10T04:20:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.787+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6180cf560 con 0x7fc61815b340 2023-05-10T04:20:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.787+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61815c960 con 0x7fc61815b340 2023-05-10T04:20:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.788+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61815f030 con 0x7fc61815b340 2023-05-10T04:20:03.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.789+0000 7fc614ff9700 1 -- 172.21.15.132:0/849641042 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc6000070d0 con 0x7fc61815b340 2023-05-10T04:20:03.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.790+0000 7fc614ff9700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc5f806ace0 0x7fc5f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:03.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.790+0000 7fc614ff9700 1 -- 172.21.15.132:0/849641042 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc60008a7c0 con 0x7fc61815b340 2023-05-10T04:20:03.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.790+0000 7fc616ffd700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc5f806ace0 0x7fc5f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:03.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.790+0000 7fc616ffd700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc5f806ace0 0x7fc5f806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc608009ac0 tx=0x7fc608008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:03.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.794+0000 7fc614ff9700 1 -- 172.21.15.132:0/849641042 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc600055570 con 0x7fc61815b340 2023-05-10T04:20:03.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.987+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6180cfd70 con 0x7fc61815b340 2023-05-10T04:20:03.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.987+0000 7fc614ff9700 1 -- 172.21.15.132:0/849641042 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc600019310 con 0x7fc61815b340 2023-05-10T04:20:03.990 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc5f806ace0 msgr2=0x7fc5f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc5f806ace0 0x7fc5f806d190 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc608009ac0 tx=0x7fc608008040 comp rx=0 tx=0).stop 2023-05-10T04:20:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc61815b340 msgr2=0x7fc6180b75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:03.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc61815b340 0x7fc6180b75a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fc6040047d0 tx=0x7fc600001980 comp rx=0 tx=0).stop 2023-05-10T04:20:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 shutdown_connections 2023-05-10T04:20:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc5f806ace0 0x7fc5f806d190 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc6180c6a00 0x7fc61815f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc604004120 0x7fc61815d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 --2- 172.21.15.132:0/849641042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc61815b340 0x7fc6180b75a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 >> 172.21.15.132:0/849641042 conn(0x7fc618071b10 msgr2=0x7fc6180b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:03.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 shutdown_connections 2023-05-10T04:20:03.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:03.990+0000 7fc61d9ff700 1 -- 172.21.15.132:0/849641042 wait complete. 2023-05-10T04:20:04.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.193+0000 7f958e9ff700 1 Processor -- start 2023-05-10T04:20:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.193+0000 7f958e9ff700 1 -- start start 2023-05-10T04:20:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f958e9ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f958806b4f0 0x7f958806b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f958e9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95880d0130 0x7f95880cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f958e9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95880b26f0 con 0x7f95880cd7d0 2023-05-10T04:20:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f958e9ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f958806be00 con 0x7f958806b4f0 2023-05-10T04:20:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f958e9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95880cf890 con 0x7f95880d0130 2023-05-10T04:20:04.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f9587fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f958806b4f0 0x7f958806b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f958cf9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f95880cd7d0 0x7f95880cdc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32868/0 (socket says 172.21.15.132:32868) 2023-05-10T04:20:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f9587fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f958806b4f0 0x7f958806b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49874/0 (socket says 172.21.15.132:49874) 2023-05-10T04:20:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f958cf9c700 1 -- 172.21.15.132:0/2166047087 learned_addr learned my addr 172.21.15.132:0/2166047087 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f95877fe700 1 --2- 172.21.15.132:0/2166047087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95880d0130 0x7f95880cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f9587fff700 1 -- 172.21.15.132:0/2166047087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95880d0130 msgr2=0x7f95880cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f9587fff700 1 --2- 172.21.15.132:0/2166047087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95880d0130 0x7f95880cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f9587fff700 1 -- 172.21.15.132:0/2166047087 >> v1:172.21.15.132:6789/0 conn(0x7f95880cd7d0 legacy=0x7f95880cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f9587fff700 1 -- 172.21.15.132:0/2166047087 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880cfb60 con 0x7f958806b4f0 2023-05-10T04:20:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f9586ffd700 1 -- 172.21.15.132:0/2166047087 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512127483 0 0) 0x7f95880b26f0 con 0x7f95880cd7d0 2023-05-10T04:20:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.195+0000 7f95877fe700 1 --2- 172.21.15.132:0/2166047087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95880d0130 0x7f95880cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.196+0000 7f9587fff700 1 --2- 172.21.15.132:0/2166047087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f958806b4f0 0x7f958806b8c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9578009840 tx=0x7f9578009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c31db93a1c639165 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.196+0000 7f9586ffd700 1 -- 172.21.15.132:0/2166047087 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578011830 con 0x7f958806b4f0 2023-05-10T04:20:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.196+0000 7f9586ffd700 1 -- 172.21.15.132:0/2166047087 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9578011990 con 0x7f958806b4f0 2023-05-10T04:20:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.196+0000 7f9586ffd700 1 -- 172.21.15.132:0/2166047087 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9578011d20 con 0x7f958806b4f0 2023-05-10T04:20:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.196+0000 7f958e9ff700 1 -- 172.21.15.132:0/2166047087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f958806b4f0 msgr2=0x7f958806b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.196+0000 7f958e9ff700 1 --2- 172.21.15.132:0/2166047087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f958806b4f0 0x7f958806b8c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9578009840 tx=0x7f9578009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.197+0000 7f958e9ff700 1 -- 172.21.15.132:0/2166047087 shutdown_connections 2023-05-10T04:20:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.197+0000 7f958e9ff700 1 --2- 172.21.15.132:0/2166047087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f958806b4f0 0x7f958806b8c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.197+0000 7f958e9ff700 1 --2- 172.21.15.132:0/2166047087 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95880d0130 0x7f95880cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.197+0000 7f958e9ff700 1 -- 172.21.15.132:0/2166047087 >> 172.21.15.132:0/2166047087 conn(0x7f958809a090 msgr2=0x7f95880d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:04.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.197+0000 7f958e9ff700 1 -- 172.21.15.132:0/2166047087 shutdown_connections 2023-05-10T04:20:04.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.197+0000 7f958e9ff700 1 -- 172.21.15.132:0/2166047087 wait complete. 2023-05-10T04:20:04.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.198+0000 7f958e9ff700 1 Processor -- start 2023-05-10T04:20:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.198+0000 7f958e9ff700 1 -- start start 2023-05-10T04:20:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.199+0000 7f958e9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f958806b4f0 0x7f95880b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.199+0000 7f958e9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95880cd7d0 0x7f95880b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.199+0000 7f958e9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95880d0130 0x7f95881f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.199+0000 7f958e9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880b3fb0 con 0x7f95880cd7d0 2023-05-10T04:20:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.199+0000 7f958e9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95880b5590 con 0x7f95880d0130 2023-05-10T04:20:04.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.199+0000 7f958e9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95881f3c20 con 0x7f958806b4f0 2023-05-10T04:20:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95880cd7d0 0x7f95880b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95880cd7d0 0x7f95880b5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49878/0 (socket says 172.21.15.132:49878) 2023-05-10T04:20:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 -- 172.21.15.132:0/1245824173 learned_addr learned my addr 172.21.15.132:0/1245824173 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f9587fff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f958806b4f0 0x7f95880b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f958cf9c700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95880d0130 0x7f95881f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 -- 172.21.15.132:0/1245824173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f958806b4f0 msgr2=0x7f95880b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f958806b4f0 0x7f95880b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 -- 172.21.15.132:0/1245824173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95880d0130 msgr2=0x7f95881f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95880d0130 0x7f95881f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 -- 172.21.15.132:0/1245824173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95780094a0 con 0x7f95880cd7d0 2023-05-10T04:20:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.200+0000 7f95877fe700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95880cd7d0 0x7f95880b5050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f957c00c7f0 tx=0x7f957c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.201+0000 7f9584ff9700 1 -- 172.21.15.132:0/1245824173 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c011800 con 0x7f95880cd7d0 2023-05-10T04:20:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.201+0000 7f9584ff9700 1 -- 172.21.15.132:0/1245824173 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c011960 con 0x7f95880cd7d0 2023-05-10T04:20:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.201+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95880cb4b0 con 0x7f95880cd7d0 2023-05-10T04:20:04.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.201+0000 7f9584ff9700 1 -- 172.21.15.132:0/1245824173 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c011d10 con 0x7f95880cd7d0 2023-05-10T04:20:04.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.201+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95880cfe40 con 0x7f95880cd7d0 2023-05-10T04:20:04.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.202+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95880cb790 con 0x7f95880cd7d0 2023-05-10T04:20:04.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.203+0000 7f9584ff9700 1 -- 172.21.15.132:0/1245824173 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f957c018360 con 0x7f95880cd7d0 2023-05-10T04:20:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.204+0000 7f9584ff9700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f957406ace0 0x7f957406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.204+0000 7f9584ff9700 1 -- 172.21.15.132:0/1245824173 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f957c089760 con 0x7f95880cd7d0 2023-05-10T04:20:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.204+0000 7f9587fff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f957406ace0 0x7f957406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.205+0000 7f9587fff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f957406ace0 0x7f957406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9578009790 tx=0x7f9578008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:04.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.208+0000 7f9584ff9700 1 -- 172.21.15.132:0/1245824173 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f957c057fa0 con 0x7f95880cd7d0 2023-05-10T04:20:04.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.406+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f95880cb180 con 0x7f95880cd7d0 2023-05-10T04:20:04.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.406+0000 7f9584ff9700 1 -- 172.21.15.132:0/1245824173 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f957c057b30 con 0x7f95880cd7d0 2023-05-10T04:20:04.409 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f957406ace0 msgr2=0x7f957406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f957406ace0 0x7f957406d190 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9578009790 tx=0x7f9578008030 comp rx=0 tx=0).stop 2023-05-10T04:20:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95880cd7d0 msgr2=0x7f95880b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95880cd7d0 0x7f95880b5050 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f957c00c7f0 tx=0x7f957c00cbb0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 shutdown_connections 2023-05-10T04:20:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f957406ace0 0x7f957406d190 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95880d0130 0x7f95881f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f958806b4f0 0x7f95880b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 --2- 172.21.15.132:0/1245824173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95880cd7d0 0x7f95880b5050 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 >> 172.21.15.132:0/1245824173 conn(0x7f958809a090 msgr2=0x7f958806f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:04.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 shutdown_connections 2023-05-10T04:20:04.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.409+0000 7f958e9ff700 1 -- 172.21.15.132:0/1245824173 wait complete. 2023-05-10T04:20:04.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:04.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.610+0000 7f8a4f1ff700 1 Processor -- start 2023-05-10T04:20:04.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.610+0000 7f8a4f1ff700 1 -- start start 2023-05-10T04:20:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4f1ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a480cfff0 0x7f8a480b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4f1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4815d660 con 0x7f8a4815a140 2023-05-10T04:20:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4f1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a4815cd70 con 0x7f8a480cd520 2023-05-10T04:20:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4f1ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a4815d010 con 0x7f8a480cfff0 2023-05-10T04:20:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4cf9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8a4815a140 0x7f8a48160ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32880/0 (socket says 172.21.15.132:32880) 2023-05-10T04:20:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4cf9b700 1 -- 172.21.15.132:0/3940338870 learned_addr learned my addr 172.21.15.132:0/3940338870 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:04.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4d79c700 1 --2- 172.21.15.132:0/3940338870 >> v2:172.21.15.132:3300/0 conn(0x7f8a480cfff0 0x7f8a480b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4d79c700 1 -- 172.21.15.132:0/3940338870 >> v1:172.21.15.154:6789/0 conn(0x7f8a480cd520 legacy=0x7f8a480cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a477fe700 1 -- 172.21.15.132:0/3940338870 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3593485278 0 0) 0x7f8a4815d660 con 0x7f8a4815a140 2023-05-10T04:20:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4d79c700 1 -- 172.21.15.132:0/3940338870 >> v1:172.21.15.132:6789/0 conn(0x7f8a4815a140 legacy=0x7f8a48160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.612+0000 7f8a4d79c700 1 -- 172.21.15.132:0/3940338870 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4815d2f0 con 0x7f8a480cfff0 2023-05-10T04:20:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a4d79c700 1 --2- 172.21.15.132:0/3940338870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cfff0 0x7f8a480b1b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009d90 tx=0x7f8a4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d202aad91235d5a2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a477fe700 1 -- 172.21.15.132:0/3940338870 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000e070 con 0x7f8a480cfff0 2023-05-10T04:20:04.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a477fe700 1 -- 172.21.15.132:0/3940338870 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4000bbd0 con 0x7f8a480cfff0 2023-05-10T04:20:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a477fe700 1 -- 172.21.15.132:0/3940338870 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40012430 con 0x7f8a480cfff0 2023-05-10T04:20:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/3940338870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cfff0 msgr2=0x7f8a480b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a4f1ff700 1 --2- 172.21.15.132:0/3940338870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cfff0 0x7f8a480b1b70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009d90 tx=0x7f8a4000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/3940338870 shutdown_connections 2023-05-10T04:20:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a4f1ff700 1 --2- 172.21.15.132:0/3940338870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cfff0 0x7f8a480b1b70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/3940338870 >> 172.21.15.132:0/3940338870 conn(0x7f8a48071b10 msgr2=0x7f8a48071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:04.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.613+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/3940338870 shutdown_connections 2023-05-10T04:20:04.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.614+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/3940338870 wait complete. 2023-05-10T04:20:04.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.615+0000 7f8a4f1ff700 1 Processor -- start 2023-05-10T04:20:04.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.615+0000 7f8a4f1ff700 1 -- start start 2023-05-10T04:20:04.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4f1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cd520 0x7f8a480b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4f1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a480cfff0 0x7f8a480b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4f1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4815a140 0x7f8a480c5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4f1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b6600 con 0x7f8a480cd520 2023-05-10T04:20:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4f1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b68e0 con 0x7f8a480cfff0 2023-05-10T04:20:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4f1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a480b6bc0 con 0x7f8a4815a140 2023-05-10T04:20:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4cf9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cd520 0x7f8a480b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4cf9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cd520 0x7f8a480b76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49904/0 (socket says 172.21.15.132:49904) 2023-05-10T04:20:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.616+0000 7f8a4cf9b700 1 -- 172.21.15.132:0/2436805300 learned_addr learned my addr 172.21.15.132:0/2436805300 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a47fff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a480cfff0 0x7f8a480b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4cf9b700 1 -- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4815a140 msgr2=0x7f8a480c5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4d79c700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4815a140 0x7f8a480c5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4cf9b700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4815a140 0x7f8a480c5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4cf9b700 1 -- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a480cfff0 msgr2=0x7f8a480b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4cf9b700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a480cfff0 0x7f8a480b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4cf9b700 1 -- 172.21.15.132:0/2436805300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a40009a70 con 0x7f8a480cd520 2023-05-10T04:20:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a47fff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a480cfff0 0x7f8a480b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4d79c700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4815a140 0x7f8a480c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4cf9b700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cd520 0x7f8a480b76a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00c520 tx=0x7f8a3c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a457fa700 1 -- 172.21.15.132:0/2436805300 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c004c80 con 0x7f8a480cd520 2023-05-10T04:20:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a457fa700 1 -- 172.21.15.132:0/2436805300 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3c004e20 con 0x7f8a480cd520 2023-05-10T04:20:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a480cdb00 con 0x7f8a480cd520 2023-05-10T04:20:04.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a457fa700 1 -- 172.21.15.132:0/2436805300 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c007310 con 0x7f8a480cd520 2023-05-10T04:20:04.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.617+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a4815daf0 con 0x7f8a480cd520 2023-05-10T04:20:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.618+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a480d3520 con 0x7f8a480cd520 2023-05-10T04:20:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.619+0000 7f8a457fa700 1 -- 172.21.15.132:0/2436805300 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8a3c007470 con 0x7f8a480cd520 2023-05-10T04:20:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.620+0000 7f8a457fa700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a2c06ace0 0x7f8a2c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.620+0000 7f8a457fa700 1 -- 172.21.15.132:0/2436805300 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8a3c0894f0 con 0x7f8a480cd520 2023-05-10T04:20:04.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.621+0000 7f8a47fff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a2c06ace0 0x7f8a2c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:04.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.621+0000 7f8a47fff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a2c06ace0 0x7f8a2c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a481570e0 tx=0x7f8a34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.625+0000 7f8a457fa700 1 -- 172.21.15.132:0/2436805300 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8a3c054210 con 0x7f8a480cd520 2023-05-10T04:20:04.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.822+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a480b51f0 con 0x7f8a480cd520 2023-05-10T04:20:04.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.823+0000 7f8a457fa700 1 -- 172.21.15.132:0/2436805300 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f8a3c057830 con 0x7f8a480cd520 2023-05-10T04:20:04.826 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:04.826 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:04.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a2c06ace0 msgr2=0x7f8a2c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a2c06ace0 0x7f8a2c06d190 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8a481570e0 tx=0x7f8a34009040 comp rx=0 tx=0).stop 2023-05-10T04:20:04.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cd520 msgr2=0x7f8a480b76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:04.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cd520 0x7f8a480b76a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00c520 tx=0x7f8a3c00c8e0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 shutdown_connections 2023-05-10T04:20:04.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8a2c06ace0 0x7f8a2c06d190 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8a4815a140 0x7f8a480c5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a480cd520 0x7f8a480b76a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 --2- 172.21.15.132:0/2436805300 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8a480cfff0 0x7f8a480b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:04.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 >> 172.21.15.132:0/2436805300 conn(0x7f8a48071b10 msgr2=0x7f8a4815be00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:04.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 shutdown_connections 2023-05-10T04:20:04.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:04.826+0000 7f8a4f1ff700 1 -- 172.21.15.132:0/2436805300 wait complete. 2023-05-10T04:20:04.845 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:04.846 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:05.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.031+0000 7fac333ff700 1 Processor -- start 2023-05-10T04:20:05.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.031+0000 7fac333ff700 1 -- start start 2023-05-10T04:20:05.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac333ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fac2c071450 0x7fac2c0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac333ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fac2c06eb70 0x7fac2c06a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac333ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0cd810 con 0x7fac2c0ccf00 2023-05-10T04:20:05.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac333ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c06a470 con 0x7fac2c071450 2023-05-10T04:20:05.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac333ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2c071a30 con 0x7fac2c06eb70 2023-05-10T04:20:05.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac3099a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fac2c071450 0x7fac2c0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac3099a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fac2c071450 0x7fac2c0cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49908/0 (socket says 172.21.15.132:49908) 2023-05-10T04:20:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac3099a700 1 -- 172.21.15.132:0/142937928 learned_addr learned my addr 172.21.15.132:0/142937928 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:05.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.032+0000 7fac3199c700 1 --2- 172.21.15.132:0/142937928 >> v2:172.21.15.154:3300/0 conn(0x7fac2c06eb70 0x7fac2c06a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.033+0000 7fac3099a700 1 -- 172.21.15.132:0/142937928 >> v2:172.21.15.154:3300/0 conn(0x7fac2c06eb70 msgr2=0x7fac2c06a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:05.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.033+0000 7fac3099a700 1 --2- 172.21.15.132:0/142937928 >> v2:172.21.15.154:3300/0 conn(0x7fac2c06eb70 0x7fac2c06a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.033+0000 7fac3099a700 1 -- 172.21.15.132:0/142937928 >> v1:172.21.15.154:6789/0 conn(0x7fac2c0ccf00 legacy=0x7fac2c15d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.033+0000 7fac3099a700 1 -- 172.21.15.132:0/142937928 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c071d10 con 0x7fac2c071450 2023-05-10T04:20:05.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.033+0000 7fac3099a700 1 --2- 172.21.15.132:0/142937928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c071450 0x7fac2c0cd2d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fac2c06be50 tx=0x7fac1c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30439ea80dbc895e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.033+0000 7fac23fff700 1 -- 172.21.15.132:0/142937928 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c011830 con 0x7fac2c071450 2023-05-10T04:20:05.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.033+0000 7fac23fff700 1 -- 172.21.15.132:0/142937928 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1c011990 con 0x7fac2c071450 2023-05-10T04:20:05.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.033+0000 7fac23fff700 1 -- 172.21.15.132:0/142937928 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1c011d20 con 0x7fac2c071450 2023-05-10T04:20:05.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.034+0000 7fac333ff700 1 -- 172.21.15.132:0/142937928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c071450 msgr2=0x7fac2c0cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.034+0000 7fac333ff700 1 --2- 172.21.15.132:0/142937928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c071450 0x7fac2c0cd2d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fac2c06be50 tx=0x7fac1c009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.034+0000 7fac333ff700 1 -- 172.21.15.132:0/142937928 shutdown_connections 2023-05-10T04:20:05.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.034+0000 7fac333ff700 1 --2- 172.21.15.132:0/142937928 >> v2:172.21.15.154:3300/0 conn(0x7fac2c06eb70 0x7fac2c06a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.034+0000 7fac333ff700 1 --2- 172.21.15.132:0/142937928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c071450 0x7fac2c0cd2d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.034+0000 7fac333ff700 1 -- 172.21.15.132:0/142937928 >> 172.21.15.132:0/142937928 conn(0x7fac2c0cf330 msgr2=0x7fac2c0cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:05.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.034+0000 7fac333ff700 1 -- 172.21.15.132:0/142937928 shutdown_connections 2023-05-10T04:20:05.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.034+0000 7fac333ff700 1 -- 172.21.15.132:0/142937928 wait complete. 2023-05-10T04:20:05.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.035+0000 7fac333ff700 1 Processor -- start 2023-05-10T04:20:05.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.036+0000 7fac333ff700 1 -- start start 2023-05-10T04:20:05.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.036+0000 7fac333ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c06eb70 0x7fac2c0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac333ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2c071450 0x7fac2c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac333ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac2c0ccf00 0x7fac2c0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac333ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c15fce0 con 0x7fac2c06eb70 2023-05-10T04:20:05.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac333ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c15ffc0 con 0x7fac2c0ccf00 2023-05-10T04:20:05.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac333ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c1602a0 con 0x7fac2c071450 2023-05-10T04:20:05.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c06eb70 0x7fac2c0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c06eb70 0x7fac2c0b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49920/0 (socket says 172.21.15.132:49920) 2023-05-10T04:20:05.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 -- 172.21.15.132:0/1351024521 learned_addr learned my addr 172.21.15.132:0/1351024521 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:05.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3099a700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2c071450 0x7fac2c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3199c700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac2c0ccf00 0x7fac2c0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 -- 172.21.15.132:0/1351024521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2c071450 msgr2=0x7fac2c0aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2c071450 0x7fac2c0aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 -- 172.21.15.132:0/1351024521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac2c0ccf00 msgr2=0x7fac2c0af2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac2c0ccf00 0x7fac2c0af2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 -- 172.21.15.132:0/1351024521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac1c009550 con 0x7fac2c06eb70 2023-05-10T04:20:05.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.037+0000 7fac3119b700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c06eb70 0x7fac2c0b1770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fac2800c4e0 tx=0x7fac2800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.038+0000 7fac21ffb700 1 -- 172.21.15.132:0/1351024521 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280052d0 con 0x7fac2c06eb70 2023-05-10T04:20:05.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.038+0000 7fac21ffb700 1 -- 172.21.15.132:0/1351024521 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac28005430 con 0x7fac2c06eb70 2023-05-10T04:20:05.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.038+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c0722d0 con 0x7fac2c06eb70 2023-05-10T04:20:05.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.038+0000 7fac21ffb700 1 -- 172.21.15.132:0/1351024521 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280038c0 con 0x7fac2c06eb70 2023-05-10T04:20:05.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.038+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c071ff0 con 0x7fac2c06eb70 2023-05-10T04:20:05.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.039+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c06fc80 con 0x7fac2c06eb70 2023-05-10T04:20:05.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.040+0000 7fac21ffb700 1 -- 172.21.15.132:0/1351024521 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac28003a20 con 0x7fac2c06eb70 2023-05-10T04:20:05.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.040+0000 7fac21ffb700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fac1006ace0 0x7fac1006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.041+0000 7fac21ffb700 1 -- 172.21.15.132:0/1351024521 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac28088d20 con 0x7fac2c06eb70 2023-05-10T04:20:05.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.041+0000 7fac3099a700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fac1006ace0 0x7fac1006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.041+0000 7fac3099a700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fac1006ace0 0x7fac1006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac1c014040 tx=0x7fac1c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.045+0000 7fac21ffb700 1 -- 172.21.15.132:0/1351024521 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fac28053a40 con 0x7fac2c06eb70 2023-05-10T04:20:05.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.240+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac2c074430 con 0x7fac2c06eb70 2023-05-10T04:20:05.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.241+0000 7fac21ffb700 1 -- 172.21.15.132:0/1351024521 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fac28017020 con 0x7fac2c06eb70 2023-05-10T04:20:05.243 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:05.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fac1006ace0 msgr2=0x7fac1006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fac1006ace0 0x7fac1006d190 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fac1c014040 tx=0x7fac1c008030 comp rx=0 tx=0).stop 2023-05-10T04:20:05.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c06eb70 msgr2=0x7fac2c0b1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c06eb70 0x7fac2c0b1770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fac2800c4e0 tx=0x7fac2800c8a0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 shutdown_connections 2023-05-10T04:20:05.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fac1006ace0 0x7fac1006d190 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fac2c0ccf00 0x7fac2c0af2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac2c06eb70 0x7fac2c0b1770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 --2- 172.21.15.132:0/1351024521 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fac2c071450 0x7fac2c0aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 >> 172.21.15.132:0/1351024521 conn(0x7fac2c0cf330 msgr2=0x7fac2c0c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:05.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 shutdown_connections 2023-05-10T04:20:05.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.243+0000 7fac333ff700 1 -- 172.21.15.132:0/1351024521 wait complete. 2023-05-10T04:20:05.262 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:05.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.446+0000 7f11a57ff700 1 Processor -- start 2023-05-10T04:20:05.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.446+0000 7f11a57ff700 1 -- start start 2023-05-10T04:20:05.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.447+0000 7f11a57ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11a015a5a0 0x7f11a006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.447+0000 7f11a57ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a0071200 0x7f11a006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f11a57ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00cb280 con 0x7f11a006a920 2023-05-10T04:20:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f11a57ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a006adc0 con 0x7f11a015a5a0 2023-05-10T04:20:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f11a57ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a015a970 con 0x7f11a0071200 2023-05-10T04:20:05.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f119effd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11a015a5a0 0x7f11a006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f119effd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11a015a5a0 0x7f11a006a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49934/0 (socket says 172.21.15.132:49934) 2023-05-10T04:20:05.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f119effd700 1 -- 172.21.15.132:0/2875487869 learned_addr learned my addr 172.21.15.132:0/2875487869 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:05.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f119f7fe700 1 --2- 172.21.15.132:0/2875487869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a0071200 0x7f11a006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f119effd700 1 -- 172.21.15.132:0/2875487869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a0071200 msgr2=0x7f11a006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:05.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f119effd700 1 --2- 172.21.15.132:0/2875487869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a0071200 0x7f11a006d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f119effd700 1 -- 172.21.15.132:0/2875487869 >> v1:172.21.15.154:6789/0 conn(0x7f11a006a920 legacy=0x7f11a0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.448+0000 7f119effd700 1 -- 172.21.15.132:0/2875487869 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a0071700 con 0x7f11a015a5a0 2023-05-10T04:20:05.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f119effd700 1 --2- 172.21.15.132:0/2875487869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a006a3e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1190009920 tx=0x7f1190009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f944f8b0594c977 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f119e7fc700 1 -- 172.21.15.132:0/2875487869 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190011830 con 0x7f11a015a5a0 2023-05-10T04:20:05.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f119e7fc700 1 -- 172.21.15.132:0/2875487869 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1190011990 con 0x7f11a015a5a0 2023-05-10T04:20:05.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f119e7fc700 1 -- 172.21.15.132:0/2875487869 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190011d20 con 0x7f11a015a5a0 2023-05-10T04:20:05.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f11a57ff700 1 -- 172.21.15.132:0/2875487869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 msgr2=0x7f11a006a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f11a57ff700 1 --2- 172.21.15.132:0/2875487869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a006a3e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1190009920 tx=0x7f1190009c30 comp rx=0 tx=0).stop 2023-05-10T04:20:05.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f11a57ff700 1 -- 172.21.15.132:0/2875487869 shutdown_connections 2023-05-10T04:20:05.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f11a57ff700 1 --2- 172.21.15.132:0/2875487869 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a0071200 0x7f11a006d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f11a57ff700 1 --2- 172.21.15.132:0/2875487869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a006a3e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.449+0000 7f11a57ff700 1 -- 172.21.15.132:0/2875487869 >> 172.21.15.132:0/2875487869 conn(0x7f11a00cf720 msgr2=0x7f11a00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:05.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.450+0000 7f11a57ff700 1 -- 172.21.15.132:0/2875487869 shutdown_connections 2023-05-10T04:20:05.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.450+0000 7f11a57ff700 1 -- 172.21.15.132:0/2875487869 wait complete. 2023-05-10T04:20:05.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.451+0000 7f11a57ff700 1 Processor -- start 2023-05-10T04:20:05.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.451+0000 7f11a57ff700 1 -- start start 2023-05-10T04:20:05.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.452+0000 7f11a57ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a006a920 0x7f11a0157260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.452+0000 7f11a57ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a0071200 0x7f11a01591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.452+0000 7f11a57ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a00b1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.452+0000 7f11a57ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a01577a0 con 0x7f11a015a5a0 2023-05-10T04:20:05.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.452+0000 7f11a57ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a01596e0 con 0x7f11a0071200 2023-05-10T04:20:05.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.452+0000 7f11a57ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0157990 con 0x7f11a006a920 2023-05-10T04:20:05.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a00b1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a00b1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49946/0 (socket says 172.21.15.132:49946) 2023-05-10T04:20:05.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 -- 172.21.15.132:0/932903936 learned_addr learned my addr 172.21.15.132:0/932903936 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:05.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119effd700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a006a920 0x7f11a0157260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f1197fff700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a0071200 0x7f11a01591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 -- 172.21.15.132:0/932903936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a006a920 msgr2=0x7f11a0157260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a006a920 0x7f11a0157260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 -- 172.21.15.132:0/932903936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a0071200 msgr2=0x7f11a01591a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a0071200 0x7f11a01591a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 -- 172.21.15.132:0/932903936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190009550 con 0x7f11a015a5a0 2023-05-10T04:20:05.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f119f7fe700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a00b1bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f119800efc0 tx=0x7f119800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f11977fe700 1 -- 172.21.15.132:0/932903936 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198009ca0 con 0x7f11a015a5a0 2023-05-10T04:20:05.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f11977fe700 1 -- 172.21.15.132:0/932903936 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119800f040 con 0x7f11a015a5a0 2023-05-10T04:20:05.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.453+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a006c6c0 con 0x7f11a015a5a0 2023-05-10T04:20:05.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.454+0000 7f11977fe700 1 -- 172.21.15.132:0/932903936 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1198014480 con 0x7f11a015a5a0 2023-05-10T04:20:05.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.454+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a00719e0 con 0x7f11a015a5a0 2023-05-10T04:20:05.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.455+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a006c9a0 con 0x7f11a015a5a0 2023-05-10T04:20:05.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.455+0000 7f11977fe700 1 -- 172.21.15.132:0/932903936 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11980145e0 con 0x7f11a015a5a0 2023-05-10T04:20:05.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.456+0000 7f11977fe700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f118006ace0 0x7f118006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.456+0000 7f11977fe700 1 -- 172.21.15.132:0/932903936 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f119808a480 con 0x7f11a015a5a0 2023-05-10T04:20:05.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.457+0000 7f119effd700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f118006ace0 0x7f118006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.457+0000 7f119effd700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f118006ace0 0x7f118006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1190000c00 tx=0x7f1190008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.460+0000 7f11977fe700 1 -- 172.21.15.132:0/932903936 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1198058cd0 con 0x7f11a015a5a0 2023-05-10T04:20:05.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.664+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f11a0074430 con 0x7f11a015a5a0 2023-05-10T04:20:05.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.665+0000 7f11977fe700 1 -- 172.21.15.132:0/932903936 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1198058860 con 0x7f11a015a5a0 2023-05-10T04:20:05.667 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:05.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f118006ace0 msgr2=0x7f118006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f118006ace0 0x7f118006d190 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1190000c00 tx=0x7f1190008030 comp rx=0 tx=0).stop 2023-05-10T04:20:05.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 msgr2=0x7f11a00b1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a00b1bc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f119800efc0 tx=0x7f119800c3a0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 shutdown_connections 2023-05-10T04:20:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f118006ace0 0x7f118006d190 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11a015a5a0 0x7f11a00b1bc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11a006a920 0x7f11a0157260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 --2- 172.21.15.132:0/932903936 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11a0071200 0x7f11a01591a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 >> 172.21.15.132:0/932903936 conn(0x7f11a00cf720 msgr2=0x7f11a00ae4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:05.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 shutdown_connections 2023-05-10T04:20:05.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.667+0000 7f11a57ff700 1 -- 172.21.15.132:0/932903936 wait complete. 2023-05-10T04:20:05.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:05.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.871+0000 7f11de9ff700 1 Processor -- start 2023-05-10T04:20:05.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.872+0000 7f11de9ff700 1 -- start start 2023-05-10T04:20:05.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11de9ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11d80b87a0 0x7f11d80cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11de9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f11d8160d40 0x7f11d80d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11de9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11d80cdc60 con 0x7f11d81601e0 2023-05-10T04:20:05.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11de9ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d80d02d0 con 0x7f11d80b87a0 2023-05-10T04:20:05.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11de9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11d80d0cb0 con 0x7f11d8160d40 2023-05-10T04:20:05.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11d7fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11d80b87a0 0x7f11d80cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11d7fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f11d80b87a0 0x7f11d80cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49952/0 (socket says 172.21.15.132:49952) 2023-05-10T04:20:05.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11d7fff700 1 -- 172.21.15.132:0/333489711 learned_addr learned my addr 172.21.15.132:0/333489711 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:05.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.873+0000 7f11dcf9c700 1 --2- 172.21.15.132:0/333489711 >> v2:172.21.15.154:3300/0 conn(0x7f11d8160d40 0x7f11d80d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.874+0000 7f11d7fff700 1 -- 172.21.15.132:0/333489711 >> v2:172.21.15.154:3300/0 conn(0x7f11d8160d40 msgr2=0x7f11d80d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:05.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.874+0000 7f11d7fff700 1 --2- 172.21.15.132:0/333489711 >> v2:172.21.15.154:3300/0 conn(0x7f11d8160d40 0x7f11d80d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.874+0000 7f11d7fff700 1 -- 172.21.15.132:0/333489711 >> v1:172.21.15.154:6789/0 conn(0x7f11d81601e0 legacy=0x7f11d8160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.874+0000 7f11d7fff700 1 -- 172.21.15.132:0/333489711 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80cd6a0 con 0x7f11d80b87a0 2023-05-10T04:20:05.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.874+0000 7f11d7fff700 1 --2- 172.21.15.132:0/333489711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80b87a0 0x7f11d80cfbf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f11d80d0820 tx=0x7f11c8009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f37cba5138d90 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.874+0000 7f11d77fe700 1 -- 172.21.15.132:0/333489711 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8011830 con 0x7f11d80b87a0 2023-05-10T04:20:05.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.874+0000 7f11d77fe700 1 -- 172.21.15.132:0/333489711 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11c8011990 con 0x7f11d80b87a0 2023-05-10T04:20:05.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.874+0000 7f11d77fe700 1 -- 172.21.15.132:0/333489711 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c8011d20 con 0x7f11d80b87a0 2023-05-10T04:20:05.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.875+0000 7f11de9ff700 1 -- 172.21.15.132:0/333489711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80b87a0 msgr2=0x7f11d80cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.875+0000 7f11de9ff700 1 --2- 172.21.15.132:0/333489711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80b87a0 0x7f11d80cfbf0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f11d80d0820 tx=0x7f11c8009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:05.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.875+0000 7f11de9ff700 1 -- 172.21.15.132:0/333489711 shutdown_connections 2023-05-10T04:20:05.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.875+0000 7f11de9ff700 1 --2- 172.21.15.132:0/333489711 >> v2:172.21.15.154:3300/0 conn(0x7f11d8160d40 0x7f11d80d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.875+0000 7f11de9ff700 1 --2- 172.21.15.132:0/333489711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d80b87a0 0x7f11d80cfbf0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.875+0000 7f11de9ff700 1 -- 172.21.15.132:0/333489711 >> 172.21.15.132:0/333489711 conn(0x7f11d8071b10 msgr2=0x7f11d8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:05.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.875+0000 7f11de9ff700 1 -- 172.21.15.132:0/333489711 shutdown_connections 2023-05-10T04:20:05.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.875+0000 7f11de9ff700 1 -- 172.21.15.132:0/333489711 wait complete. 2023-05-10T04:20:05.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.876+0000 7f11de9ff700 1 Processor -- start 2023-05-10T04:20:05.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.877+0000 7f11de9ff700 1 -- start start 2023-05-10T04:20:05.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.877+0000 7f11de9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11d80b87a0 0x7f11d8151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.877+0000 7f11de9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d81601e0 0x7f11d80c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.877+0000 7f11de9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d8160d40 0x7f11d80d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.877+0000 7f11de9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d81517c0 con 0x7f11d8160d40 2023-05-10T04:20:05.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.877+0000 7f11de9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80c8670 con 0x7f11d81601e0 2023-05-10T04:20:05.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.877+0000 7f11de9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11d80c8950 con 0x7f11d80b87a0 2023-05-10T04:20:05.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d8160d40 0x7f11d80d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d8160d40 0x7f11d80d1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49968/0 (socket says 172.21.15.132:49968) 2023-05-10T04:20:05.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 -- 172.21.15.132:0/2185435857 learned_addr learned my addr 172.21.15.132:0/2185435857 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:05.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11d7fff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11d80b87a0 0x7f11d8151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11cffff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d81601e0 0x7f11d80c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 -- 172.21.15.132:0/2185435857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11d80b87a0 msgr2=0x7f11d8151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11d80b87a0 0x7f11d8151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 -- 172.21.15.132:0/2185435857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d81601e0 msgr2=0x7f11d80c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:05.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d81601e0 0x7f11d80c7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:05.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 -- 172.21.15.132:0/2185435857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11c8009550 con 0x7f11d8160d40 2023-05-10T04:20:05.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.878+0000 7f11dcf9c700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d8160d40 0x7f11d80d1b70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f11d000efc0 tx=0x7f11d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.879+0000 7f11d57fa700 1 -- 172.21.15.132:0/2185435857 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0009ba0 con 0x7f11d8160d40 2023-05-10T04:20:05.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.879+0000 7f11d57fa700 1 -- 172.21.15.132:0/2185435857 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d000f040 con 0x7f11d8160d40 2023-05-10T04:20:05.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.879+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11d80d1640 con 0x7f11d8160d40 2023-05-10T04:20:05.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.879+0000 7f11d57fa700 1 -- 172.21.15.132:0/2185435857 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d0014480 con 0x7f11d8160d40 2023-05-10T04:20:05.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.879+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11d80cd980 con 0x7f11d8160d40 2023-05-10T04:20:05.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.880+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11d80d17d0 con 0x7f11d8160d40 2023-05-10T04:20:05.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.881+0000 7f11d57fa700 1 -- 172.21.15.132:0/2185435857 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f11d00145e0 con 0x7f11d8160d40 2023-05-10T04:20:05.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.882+0000 7f11d57fa700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f11b806ace0 0x7f11b806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:05.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.882+0000 7f11d57fa700 1 -- 172.21.15.132:0/2185435857 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f11d008a0c0 con 0x7f11d8160d40 2023-05-10T04:20:05.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.882+0000 7f11d7fff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f11b806ace0 0x7f11b806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:05.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.883+0000 7f11d7fff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f11b806ace0 0x7f11b806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009870 tx=0x7f11c8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:05.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:05.886+0000 7f11d57fa700 1 -- 172.21.15.132:0/2185435857 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f11d0054e70 con 0x7f11d8160d40 2023-05-10T04:20:06.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.087+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11d8074430 con 0x7f11d8160d40 2023-05-10T04:20:06.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.087+0000 7f11d57fa700 1 -- 172.21.15.132:0/2185435857 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f11d0058490 con 0x7f11d8160d40 2023-05-10T04:20:06.090 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:06.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f11b806ace0 msgr2=0x7f11b806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f11b806ace0 0x7f11b806d190 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f11c8009870 tx=0x7f11c8008030 comp rx=0 tx=0).stop 2023-05-10T04:20:06.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d8160d40 msgr2=0x7f11d80d1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d8160d40 0x7f11d80d1b70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f11d000efc0 tx=0x7f11d000c3a0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 shutdown_connections 2023-05-10T04:20:06.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f11b806ace0 0x7f11b806d190 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11d8160d40 0x7f11d80d1b70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f11d80b87a0 0x7f11d8151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 --2- 172.21.15.132:0/2185435857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f11d81601e0 0x7f11d80c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 >> 172.21.15.132:0/2185435857 conn(0x7f11d8071b10 msgr2=0x7f11d8071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:06.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 shutdown_connections 2023-05-10T04:20:06.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.090+0000 7f11de9ff700 1 -- 172.21.15.132:0/2185435857 wait complete. 2023-05-10T04:20:06.109 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:06.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.294+0000 7f58e5bff700 1 Processor -- start 2023-05-10T04:20:06.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.294+0000 7f58e5bff700 1 -- start start 2023-05-10T04:20:06.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.295+0000 7f58e5bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58e015a280 0x7f58e015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.295+0000 7f58e5bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f58e00d0b50 0x7f58e00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.295+0000 7f58e5bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58e015d6e0 con 0x7f58e00cd640 2023-05-10T04:20:06.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.295+0000 7f58e5bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e015d9c0 con 0x7f58e015a280 2023-05-10T04:20:06.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.295+0000 7f58e5bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58e015dca0 con 0x7f58e00d0b50 2023-05-10T04:20:06.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.295+0000 7f58df7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58e015a280 0x7f58e015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.295+0000 7f58deffd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f58e00cd640 0x7f58e00cfb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32892/0 (socket says 172.21.15.132:32892) 2023-05-10T04:20:06.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.295+0000 7f58deffd700 1 -- 172.21.15.132:0/73632958 learned_addr learned my addr 172.21.15.132:0/73632958 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:06.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58dffff700 1 --2- 172.21.15.132:0/73632958 >> v2:172.21.15.154:3300/0 conn(0x7f58e00d0b50 0x7f58e00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58df7fe700 1 -- 172.21.15.132:0/73632958 >> v2:172.21.15.154:3300/0 conn(0x7f58e00d0b50 msgr2=0x7f58e00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:06.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58df7fe700 1 --2- 172.21.15.132:0/73632958 >> v2:172.21.15.154:3300/0 conn(0x7f58e00d0b50 0x7f58e00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58df7fe700 1 -- 172.21.15.132:0/73632958 >> v1:172.21.15.132:6789/0 conn(0x7f58e00cd640 legacy=0x7f58e00cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58de7fc700 1 -- 172.21.15.132:0/73632958 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535204906 0 0) 0x7f58e015d6e0 con 0x7f58e00cd640 2023-05-10T04:20:06.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58df7fe700 1 -- 172.21.15.132:0/73632958 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e00cf370 con 0x7f58e015a280 2023-05-10T04:20:06.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58df7fe700 1 --2- 172.21.15.132:0/73632958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e015a280 0x7f58e015cd70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f58e0161400 tx=0x7f58d0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e760aac3597c98 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:06.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58de7fc700 1 -- 172.21.15.132:0/73632958 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0011830 con 0x7f58e015a280 2023-05-10T04:20:06.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58de7fc700 1 -- 172.21.15.132:0/73632958 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d0011990 con 0x7f58e015a280 2023-05-10T04:20:06.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.296+0000 7f58de7fc700 1 -- 172.21.15.132:0/73632958 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d0011d20 con 0x7f58e015a280 2023-05-10T04:20:06.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.297+0000 7f58e5bff700 1 -- 172.21.15.132:0/73632958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e015a280 msgr2=0x7f58e015cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.297+0000 7f58e5bff700 1 --2- 172.21.15.132:0/73632958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e015a280 0x7f58e015cd70 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f58e0161400 tx=0x7f58d0009b20 comp rx=0 tx=0).stop 2023-05-10T04:20:06.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.297+0000 7f58e5bff700 1 -- 172.21.15.132:0/73632958 shutdown_connections 2023-05-10T04:20:06.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.297+0000 7f58e5bff700 1 --2- 172.21.15.132:0/73632958 >> v2:172.21.15.154:3300/0 conn(0x7f58e00d0b50 0x7f58e00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.297+0000 7f58e5bff700 1 --2- 172.21.15.132:0/73632958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e015a280 0x7f58e015cd70 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.297+0000 7f58e5bff700 1 -- 172.21.15.132:0/73632958 >> 172.21.15.132:0/73632958 conn(0x7f58e0066260 msgr2=0x7f58e0071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:06.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.297+0000 7f58e5bff700 1 -- 172.21.15.132:0/73632958 shutdown_connections 2023-05-10T04:20:06.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.297+0000 7f58e5bff700 1 -- 172.21.15.132:0/73632958 wait complete. 2023-05-10T04:20:06.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.299+0000 7f58e5bff700 1 Processor -- start 2023-05-10T04:20:06.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.299+0000 7f58e5bff700 1 -- start start 2023-05-10T04:20:06.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58e5bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e00cd640 0x7f58e014d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58e5bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e00d0b50 0x7f58e00b6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58e5bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e015a280 0x7f58e01f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58e5bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e014d9e0 con 0x7f58e00d0b50 2023-05-10T04:20:06.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58e5bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00b6fd0 con 0x7f58e00cd640 2023-05-10T04:20:06.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58e5bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e00b72b0 con 0x7f58e015a280 2023-05-10T04:20:06.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58deffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e00d0b50 0x7f58e00b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58deffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e00d0b50 0x7f58e00b6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49986/0 (socket says 172.21.15.132:49986) 2023-05-10T04:20:06.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58deffd700 1 -- 172.21.15.132:0/2953410295 learned_addr learned my addr 172.21.15.132:0/2953410295 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:06.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58df7fe700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e00cd640 0x7f58e014d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58dffff700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e015a280 0x7f58e01f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58deffd700 1 -- 172.21.15.132:0/2953410295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e015a280 msgr2=0x7f58e01f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58deffd700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e015a280 0x7f58e01f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58deffd700 1 -- 172.21.15.132:0/2953410295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e00cd640 msgr2=0x7f58e014d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58deffd700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e00cd640 0x7f58e014d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.300+0000 7f58deffd700 1 -- 172.21.15.132:0/2953410295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d00094a0 con 0x7f58e00d0b50 2023-05-10T04:20:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.301+0000 7f58deffd700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e00d0b50 0x7f58e00b6510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c540 tx=0x7f58d400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:06.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.301+0000 7f58c7fff700 1 -- 172.21.15.132:0/2953410295 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4004c80 con 0x7f58e00d0b50 2023-05-10T04:20:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.301+0000 7f58c7fff700 1 -- 172.21.15.132:0/2953410295 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58d4004de0 con 0x7f58e00d0b50 2023-05-10T04:20:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.301+0000 7f58c7fff700 1 -- 172.21.15.132:0/2953410295 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58d4007310 con 0x7f58e00d0b50 2023-05-10T04:20:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.301+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58e015a650 con 0x7f58e00d0b50 2023-05-10T04:20:06.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.301+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58e00cf650 con 0x7f58e00d0b50 2023-05-10T04:20:06.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.302+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58e015a7e0 con 0x7f58e00d0b50 2023-05-10T04:20:06.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.303+0000 7f58c7fff700 1 -- 172.21.15.132:0/2953410295 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58d4007470 con 0x7f58e00d0b50 2023-05-10T04:20:06.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.304+0000 7f58c7fff700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58cc06ace0 0x7f58cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.304+0000 7f58c7fff700 1 -- 172.21.15.132:0/2953410295 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f58d4089340 con 0x7f58e00d0b50 2023-05-10T04:20:06.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.304+0000 7f58df7fe700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58cc06ace0 0x7f58cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.305+0000 7f58df7fe700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58cc06ace0 0x7f58cc06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f58d00090b0 tx=0x7f58d001c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:06.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.308+0000 7f58c7fff700 1 -- 172.21.15.132:0/2953410295 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f58d4054190 con 0x7f58e00d0b50 2023-05-10T04:20:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.502+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58e00cdf50 con 0x7f58e00d0b50 2023-05-10T04:20:06.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.502+0000 7f58c7fff700 1 -- 172.21.15.132:0/2953410295 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58d40577b0 con 0x7f58e00d0b50 2023-05-10T04:20:06.505 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:06.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58cc06ace0 msgr2=0x7f58cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58cc06ace0 0x7f58cc06d190 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f58d00090b0 tx=0x7f58d001c040 comp rx=0 tx=0).stop 2023-05-10T04:20:06.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e00d0b50 msgr2=0x7f58e00b6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e00d0b50 0x7f58e00b6510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f58d400c540 tx=0x7f58d400c850 comp rx=0 tx=0).stop 2023-05-10T04:20:06.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 shutdown_connections 2023-05-10T04:20:06.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f58cc06ace0 0x7f58cc06d190 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f58e015a280 0x7f58e01f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f58e00cd640 0x7f58e014d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 --2- 172.21.15.132:0/2953410295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e00d0b50 0x7f58e00b6510 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 >> 172.21.15.132:0/2953410295 conn(0x7f58e0066260 msgr2=0x7f58e0158ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:06.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 shutdown_connections 2023-05-10T04:20:06.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.505+0000 7f58e5bff700 1 -- 172.21.15.132:0/2953410295 wait complete. 2023-05-10T04:20:06.524 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:06.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.709+0000 7f7b84bff700 1 Processor -- start 2023-05-10T04:20:06.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.709+0000 7f7b84bff700 1 -- start start 2023-05-10T04:20:06.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.710+0000 7f7b84bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800b1d50 0x7f7b8006b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.710+0000 7f7b84bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8006a5f0 con 0x7f7b800ca210 2023-05-10T04:20:06.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.710+0000 7f7b84bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8006a840 con 0x7f7b800cd790 2023-05-10T04:20:06.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.710+0000 7f7b84bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800ca6b0 con 0x7f7b800b1d50 2023-05-10T04:20:06.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.710+0000 7f7b7dd9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7b800ca210 0x7f7b800b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32908/0 (socket says 172.21.15.132:32908) 2023-05-10T04:20:06.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.710+0000 7f7b7dd9b700 1 -- 172.21.15.132:0/945678427 learned_addr learned my addr 172.21.15.132:0/945678427 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:06.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7ed9d700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800b1d50 0x7f7b8006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943014737 0 0) 0x7f7b8006a5f0 con 0x7f7b800ca210 2023-05-10T04:20:06.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b680035b0 con 0x7f7b800ca210 2023-05-10T04:20:06.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 310504626 0 0) 0x7f7b680035b0 con 0x7f7b800ca210 2023-05-10T04:20:06.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800b1d50 msgr2=0x7f7b8006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:06.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800b1d50 0x7f7b8006b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 >> v1:172.21.15.154:6789/0 conn(0x7f7b800cd790 legacy=0x7f7b800cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8006ab20 con 0x7f7b800ca210 2023-05-10T04:20:06.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f7b74001670 con 0x7f7b800ca210 2023-05-10T04:20:06.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 >> v1:172.21.15.132:6789/0 conn(0x7f7b800ca210 legacy=0x7f7b800b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b68003a30 0x7f7b68003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800b1d50 0x7f7b68004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b68005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6800bb20 con 0x7f7b68004d90 2023-05-10T04:20:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6800bc90 con 0x7f7b68003a30 2023-05-10T04:20:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.711+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6800be50 con 0x7f7b800b1d50 2023-05-10T04:20:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7ed9d700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b68005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7dd9b700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800b1d50 0x7f7b68004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7e59c700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b68003a30 0x7f7b68003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7ed9d700 1 -- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800b1d50 msgr2=0x7f7b68004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:06.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7ed9d700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800b1d50 0x7f7b68004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7ed9d700 1 -- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b68003a30 msgr2=0x7f7b68003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:06.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7ed9d700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b68003a30 0x7f7b68003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7ed9d700 1 -- 172.21.15.132:0/945678427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b680035b0 con 0x7f7b68004d90 2023-05-10T04:20:06.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7ed9d700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b68005200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009fc0 tx=0x7f7b68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd9d0f416ea0d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:06.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7800ec30 con 0x7f7b68004d90 2023-05-10T04:20:06.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b7800f040 con 0x7f7b68004d90 2023-05-10T04:20:06.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.712+0000 7f7b7d59a700 1 -- 172.21.15.132:0/945678427 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78014480 con 0x7f7b68004d90 2023-05-10T04:20:06.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.713+0000 7f7b84bff700 1 -- 172.21.15.132:0/945678427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 msgr2=0x7f7b68005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.713+0000 7f7b84bff700 1 --2- 172.21.15.132:0/945678427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b68005200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b78009fc0 tx=0x7f7b68005880 comp rx=0 tx=0).stop 2023-05-10T04:20:06.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.713+0000 7f7b7ed9d700 1 -- 172.21.15.132:0/945678427 reap_dead start 2023-05-10T04:20:06.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.713+0000 7f7b84bff700 1 -- 172.21.15.132:0/945678427 shutdown_connections 2023-05-10T04:20:06.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.713+0000 7f7b84bff700 1 -- 172.21.15.132:0/945678427 >> 172.21.15.132:0/945678427 conn(0x7f7b8006e980 msgr2=0x7f7b800cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:06.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.713+0000 7f7b84bff700 1 -- 172.21.15.132:0/945678427 shutdown_connections 2023-05-10T04:20:06.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.713+0000 7f7b84bff700 1 -- 172.21.15.132:0/945678427 wait complete. 2023-05-10T04:20:06.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.715+0000 7f7b84bff700 1 Processor -- start 2023-05-10T04:20:06.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.715+0000 7f7b84bff700 1 -- start start 2023-05-10T04:20:06.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b84bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b800ad580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b84bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80154660 0x7f7b800c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b84bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800c6230 0x7f7b800c9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b84bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800c3c70 con 0x7f7b68004d90 2023-05-10T04:20:06.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b84bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800ae470 con 0x7f7b80154660 2023-05-10T04:20:06.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b84bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b800adeb0 con 0x7f7b800c6230 2023-05-10T04:20:06.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b7e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b800ad580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b7e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b800ad580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50008/0 (socket says 172.21.15.132:50008) 2023-05-10T04:20:06.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b7e59c700 1 -- 172.21.15.132:0/792935901 learned_addr learned my addr 172.21.15.132:0/792935901 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:06.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b7ed9d700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800c6230 0x7f7b800c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.716+0000 7f7b7dd9b700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80154660 0x7f7b800c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b7e59c700 1 -- 172.21.15.132:0/792935901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800c6230 msgr2=0x7f7b800c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b7e59c700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800c6230 0x7f7b800c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b7e59c700 1 -- 172.21.15.132:0/792935901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80154660 msgr2=0x7f7b800c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b7e59c700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80154660 0x7f7b800c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b7e59c700 1 -- 172.21.15.132:0/792935901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b8006b0e0 con 0x7f7b68004d90 2023-05-10T04:20:06.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b7e59c700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b800ad580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000f840 tx=0x7f7b7000fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:06.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b6effd700 1 -- 172.21.15.132:0/792935901 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70005320 con 0x7f7b68004d90 2023-05-10T04:20:06.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b6effd700 1 -- 172.21.15.132:0/792935901 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b700054a0 con 0x7f7b68004d90 2023-05-10T04:20:06.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b6effd700 1 -- 172.21.15.132:0/792935901 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b70006aa0 con 0x7f7b68004d90 2023-05-10T04:20:06.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b8006ae00 con 0x7f7b68004d90 2023-05-10T04:20:06.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.717+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b8015ca20 con 0x7f7b68004d90 2023-05-10T04:20:06.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.718+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b8015bcd0 con 0x7f7b68004d90 2023-05-10T04:20:06.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.719+0000 7f7b6effd700 1 -- 172.21.15.132:0/792935901 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b70006c00 con 0x7f7b68004d90 2023-05-10T04:20:06.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.720+0000 7f7b6effd700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b6006ace0 0x7f7b6006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:06.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.720+0000 7f7b6effd700 1 -- 172.21.15.132:0/792935901 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7b70088d00 con 0x7f7b68004d90 2023-05-10T04:20:06.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.720+0000 7f7b7dd9b700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b6006ace0 0x7f7b6006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:06.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.721+0000 7f7b7dd9b700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b6006ace0 0x7f7b6006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b80154a30 tx=0x7f7b74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:06.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.724+0000 7f7b6effd700 1 -- 172.21.15.132:0/792935901 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7b70053ac0 con 0x7f7b68004d90 2023-05-10T04:20:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.922+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7b8006c510 con 0x7f7b68004d90 2023-05-10T04:20:06.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.922+0000 7f7b6effd700 1 -- 172.21.15.132:0/792935901 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7b700570e0 con 0x7f7b68004d90 2023-05-10T04:20:06.925 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:06.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b6006ace0 msgr2=0x7f7b6006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b6006ace0 0x7f7b6006d190 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7b80154a30 tx=0x7f7b74009040 comp rx=0 tx=0).stop 2023-05-10T04:20:06.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 msgr2=0x7f7b800ad580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:06.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b800ad580 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f7b7000f840 tx=0x7f7b7000fc00 comp rx=0 tx=0).stop 2023-05-10T04:20:06.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 shutdown_connections 2023-05-10T04:20:06.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b6006ace0 0x7f7b6006d190 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b800c6230 0x7f7b800c9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b68004d90 0x7f7b800ad580 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 --2- 172.21.15.132:0/792935901 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b80154660 0x7f7b800c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:06.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 >> 172.21.15.132:0/792935901 conn(0x7f7b8006e980 msgr2=0x7f7b800ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:06.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 shutdown_connections 2023-05-10T04:20:06.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:06.925+0000 7f7b84bff700 1 -- 172.21.15.132:0/792935901 wait complete. 2023-05-10T04:20:06.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:07.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.124+0000 7f37767ff700 1 Processor -- start 2023-05-10T04:20:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.124+0000 7f37767ff700 1 -- start start 2023-05-10T04:20:07.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f37767ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f377015c590 0x7f3770160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f37767ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f37700cf010 0x7f37700cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f37767ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37700cfd80 0x7f37700d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f37767ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700cd520 con 0x7f37700cfd80 2023-05-10T04:20:07.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f37767ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37700d2640 con 0x7f37700cf010 2023-05-10T04:20:07.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f37767ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37701610d0 con 0x7f377015c590 2023-05-10T04:20:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3774d9c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37700cfd80 0x7f37700d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3774d9c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37700cfd80 0x7f37700d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50016/0 (socket says 172.21.15.132:50016) 2023-05-10T04:20:07.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3774d9c700 1 -- 172.21.15.132:0/882846712 learned_addr learned my addr 172.21.15.132:0/882846712 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:07.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3767fff700 1 --2- 172.21.15.132:0/882846712 >> v2:172.21.15.154:3300/0 conn(0x7f37700cf010 0x7f37700cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f376ffff700 1 --2- 172.21.15.132:0/882846712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f377015c590 0x7f3770160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3774d9c700 1 -- 172.21.15.132:0/882846712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f377015c590 msgr2=0x7f3770160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:07.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3774d9c700 1 --2- 172.21.15.132:0/882846712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f377015c590 0x7f3770160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3774d9c700 1 -- 172.21.15.132:0/882846712 >> v2:172.21.15.154:3300/0 conn(0x7f37700cf010 msgr2=0x7f37700cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:07.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3774d9c700 1 --2- 172.21.15.132:0/882846712 >> v2:172.21.15.154:3300/0 conn(0x7f37700cf010 0x7f37700cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3774d9c700 1 -- 172.21.15.132:0/882846712 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37700d0200 con 0x7f37700cfd80 2023-05-10T04:20:07.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.126+0000 7f3767fff700 1 --2- 172.21.15.132:0/882846712 >> v2:172.21.15.154:3300/0 conn(0x7f37700cf010 0x7f37700cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:07.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.127+0000 7f3774d9c700 1 --2- 172.21.15.132:0/882846712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37700cfd80 0x7f37700d0aa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f37700d3f90 tx=0x7f376800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90cab12f937fe17 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.127+0000 7f376f7fe700 1 -- 172.21.15.132:0/882846712 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376800e070 con 0x7f37700cfd80 2023-05-10T04:20:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.127+0000 7f376f7fe700 1 -- 172.21.15.132:0/882846712 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376800b9c0 con 0x7f37700cfd80 2023-05-10T04:20:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.127+0000 7f376f7fe700 1 -- 172.21.15.132:0/882846712 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376800bd70 con 0x7f37700cfd80 2023-05-10T04:20:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.127+0000 7f37767ff700 1 -- 172.21.15.132:0/882846712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37700cfd80 msgr2=0x7f37700d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.127+0000 7f37767ff700 1 --2- 172.21.15.132:0/882846712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37700cfd80 0x7f37700d0aa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f37700d3f90 tx=0x7f376800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:07.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.128+0000 7f37767ff700 1 -- 172.21.15.132:0/882846712 shutdown_connections 2023-05-10T04:20:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.128+0000 7f37767ff700 1 --2- 172.21.15.132:0/882846712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37700cfd80 0x7f37700d0aa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.128+0000 7f37767ff700 1 --2- 172.21.15.132:0/882846712 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f377015c590 0x7f3770160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.128+0000 7f37767ff700 1 --2- 172.21.15.132:0/882846712 >> v2:172.21.15.154:3300/0 conn(0x7f37700cf010 0x7f37700cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.128+0000 7f37767ff700 1 -- 172.21.15.132:0/882846712 >> 172.21.15.132:0/882846712 conn(0x7f3770071b10 msgr2=0x7f3770071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.128+0000 7f37767ff700 1 -- 172.21.15.132:0/882846712 shutdown_connections 2023-05-10T04:20:07.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.128+0000 7f37767ff700 1 -- 172.21.15.132:0/882846712 wait complete. 2023-05-10T04:20:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.129+0000 7f37767ff700 1 Processor -- start 2023-05-10T04:20:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.130+0000 7f37767ff700 1 -- start start 2023-05-10T04:20:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.130+0000 7f37767ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37700cf010 0x7f377014b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.130+0000 7f37767ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37700cfd80 0x7f377015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.130+0000 7f37767ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f377015c590 0x7f377015e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.130+0000 7f37767ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377015f000 con 0x7f377015c590 2023-05-10T04:20:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.130+0000 7f37767ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377015db20 con 0x7f37700cf010 2023-05-10T04:20:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.130+0000 7f37767ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377015ed20 con 0x7f37700cfd80 2023-05-10T04:20:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f377015c590 0x7f377015e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f377015c590 0x7f377015e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50018/0 (socket says 172.21.15.132:50018) 2023-05-10T04:20:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 -- 172.21.15.132:0/1628598056 learned_addr learned my addr 172.21.15.132:0/1628598056 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3767fff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37700cfd80 0x7f377015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f376ffff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37700cf010 0x7f377014b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 -- 172.21.15.132:0/1628598056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37700cfd80 msgr2=0x7f377015d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37700cfd80 0x7f377015d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 -- 172.21.15.132:0/1628598056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37700cf010 msgr2=0x7f377014b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37700cf010 0x7f377014b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 -- 172.21.15.132:0/1628598056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768009b30 con 0x7f377015c590 2023-05-10T04:20:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.131+0000 7f3774d9c700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f377015c590 0x7f377015e280 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3770072710 tx=0x7f3768004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.132+0000 7f376d7fa700 1 -- 172.21.15.132:0/1628598056 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768004250 con 0x7f377015c590 2023-05-10T04:20:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.132+0000 7f376d7fa700 1 -- 172.21.15.132:0/1628598056 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37680043d0 con 0x7f377015c590 2023-05-10T04:20:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.132+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37700cf560 con 0x7f377015c590 2023-05-10T04:20:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.132+0000 7f376d7fa700 1 -- 172.21.15.132:0/1628598056 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3768004780 con 0x7f377015c590 2023-05-10T04:20:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.132+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37700b23c0 con 0x7f377015c590 2023-05-10T04:20:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.133+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37700cd770 con 0x7f377015c590 2023-05-10T04:20:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.134+0000 7f376d7fa700 1 -- 172.21.15.132:0/1628598056 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f376801c440 con 0x7f377015c590 2023-05-10T04:20:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.135+0000 7f376d7fa700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f375006ace0 0x7f375006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.135+0000 7f376d7fa700 1 -- 172.21.15.132:0/1628598056 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f376808ad80 con 0x7f377015c590 2023-05-10T04:20:07.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.135+0000 7f376ffff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f375006ace0 0x7f375006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.136+0000 7f376ffff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f375006ace0 0x7f375006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f376000b930 tx=0x7f3760008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.140+0000 7f376d7fa700 1 -- 172.21.15.132:0/1628598056 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3768055b30 con 0x7f377015c590 2023-05-10T04:20:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.337+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f377015c960 con 0x7f377015c590 2023-05-10T04:20:07.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.338+0000 7f376d7fa700 1 -- 172.21.15.132:0/1628598056 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f377015c960 con 0x7f377015c590 2023-05-10T04:20:07.340 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:07.341 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f375006ace0 msgr2=0x7f375006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f375006ace0 0x7f375006d190 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f376000b930 tx=0x7f3760008040 comp rx=0 tx=0).stop 2023-05-10T04:20:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f377015c590 msgr2=0x7f377015e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f377015c590 0x7f377015e280 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3770072710 tx=0x7f3768004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 shutdown_connections 2023-05-10T04:20:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f375006ace0 0x7f375006d190 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f377015c590 0x7f377015e280 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f37700cf010 0x7f377014b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.340+0000 7f37767ff700 1 --2- 172.21.15.132:0/1628598056 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f37700cfd80 0x7f377015d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.341+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 >> 172.21.15.132:0/1628598056 conn(0x7f3770071b10 msgr2=0x7f37700b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:07.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.341+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 shutdown_connections 2023-05-10T04:20:07.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.341+0000 7f37767ff700 1 -- 172.21.15.132:0/1628598056 wait complete. 2023-05-10T04:20:07.360 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:07.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:07.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.547+0000 7f3a373ff700 1 Processor -- start 2023-05-10T04:20:07.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.547+0000 7f3a373ff700 1 -- start start 2023-05-10T04:20:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.548+0000 7f3a373ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a300b87a0 0x7f3a300cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.548+0000 7f3a373ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a301601e0 0x7f3a30160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.548+0000 7f3a373ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3a30160b70 0x7f3a300d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.548+0000 7f3a373ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300d02d0 con 0x7f3a300b87a0 2023-05-10T04:20:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.548+0000 7f3a373ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a300d0cb0 con 0x7f3a30160b70 2023-05-10T04:20:07.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.548+0000 7f3a373ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a300b2730 con 0x7f3a301601e0 2023-05-10T04:20:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a300b87a0 0x7f3a300cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a300b87a0 0x7f3a300cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50032/0 (socket says 172.21.15.132:50032) 2023-05-10T04:20:07.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 -- 172.21.15.132:0/3210790635 learned_addr learned my addr 172.21.15.132:0/3210790635 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3599c700 1 --2- 172.21.15.132:0/3210790635 >> v2:172.21.15.154:3300/0 conn(0x7f3a30160b70 0x7f3a300d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3499a700 1 --2- 172.21.15.132:0/3210790635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a301601e0 0x7f3a30160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 -- 172.21.15.132:0/3210790635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a301601e0 msgr2=0x7f3a30160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 --2- 172.21.15.132:0/3210790635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a301601e0 0x7f3a30160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 -- 172.21.15.132:0/3210790635 >> v2:172.21.15.154:3300/0 conn(0x7f3a30160b70 msgr2=0x7f3a300d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 --2- 172.21.15.132:0/3210790635 >> v2:172.21.15.154:3300/0 conn(0x7f3a30160b70 0x7f3a300d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 -- 172.21.15.132:0/3210790635 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a30160ff0 con 0x7f3a300b87a0 2023-05-10T04:20:07.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.549+0000 7f3a3519b700 1 --2- 172.21.15.132:0/3210790635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300cfbf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3a3008be30 tx=0x7f3a2c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ac0c8618279d6c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a27fff700 1 -- 172.21.15.132:0/3210790635 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00b870 con 0x7f3a300b87a0 2023-05-10T04:20:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a27fff700 1 -- 172.21.15.132:0/3210790635 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c00b9d0 con 0x7f3a300b87a0 2023-05-10T04:20:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a27fff700 1 -- 172.21.15.132:0/3210790635 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c00bd60 con 0x7f3a300b87a0 2023-05-10T04:20:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 -- 172.21.15.132:0/3210790635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 msgr2=0x7f3a300cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 --2- 172.21.15.132:0/3210790635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300cfbf0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3a3008be30 tx=0x7f3a2c009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 -- 172.21.15.132:0/3210790635 shutdown_connections 2023-05-10T04:20:07.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 --2- 172.21.15.132:0/3210790635 >> v2:172.21.15.154:3300/0 conn(0x7f3a30160b70 0x7f3a300d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 --2- 172.21.15.132:0/3210790635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300cfbf0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 --2- 172.21.15.132:0/3210790635 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a301601e0 0x7f3a30160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 -- 172.21.15.132:0/3210790635 >> 172.21.15.132:0/3210790635 conn(0x7f3a30071b10 msgr2=0x7f3a30071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 -- 172.21.15.132:0/3210790635 shutdown_connections 2023-05-10T04:20:07.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.550+0000 7f3a373ff700 1 -- 172.21.15.132:0/3210790635 wait complete. 2023-05-10T04:20:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.552+0000 7f3a373ff700 1 Processor -- start 2023-05-10T04:20:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.552+0000 7f3a373ff700 1 -- start start 2023-05-10T04:20:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a373ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a373ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a301601e0 0x7f3a3014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a373ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a30160b70 0x7f3a300d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a373ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3014e3f0 con 0x7f3a300b87a0 2023-05-10T04:20:07.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a373ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a301f1ca0 con 0x7f3a301601e0 2023-05-10T04:20:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a373ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a3015dfe0 con 0x7f3a30160b70 2023-05-10T04:20:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a3519b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a3519b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50036/0 (socket says 172.21.15.132:50036) 2023-05-10T04:20:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.553+0000 7f3a3519b700 1 -- 172.21.15.132:0/365684641 learned_addr learned my addr 172.21.15.132:0/365684641 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3499a700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a301601e0 0x7f3a3014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3599c700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a30160b70 0x7f3a300d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3519b700 1 -- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a30160b70 msgr2=0x7f3a300d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3519b700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a30160b70 0x7f3a300d27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3519b700 1 -- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a301601e0 msgr2=0x7f3a3014deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3519b700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a301601e0 0x7f3a3014deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3519b700 1 -- 172.21.15.132:0/365684641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a2c009550 con 0x7f3a300b87a0 2023-05-10T04:20:07.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3499a700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a301601e0 0x7f3a3014deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:07.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a3519b700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300c9f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c000c00 tx=0x7f3a2c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a25ffb700 1 -- 172.21.15.132:0/365684641 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c004520 con 0x7f3a300b87a0 2023-05-10T04:20:07.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a25ffb700 1 -- 172.21.15.132:0/365684641 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a2c01e070 con 0x7f3a300b87a0 2023-05-10T04:20:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a25ffb700 1 -- 172.21.15.132:0/365684641 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0038c0 con 0x7f3a300b87a0 2023-05-10T04:20:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.554+0000 7f3a373ff700 1 -- 172.21.15.132:0/365684641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a300cd6a0 con 0x7f3a300b87a0 2023-05-10T04:20:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.555+0000 7f3a373ff700 1 -- 172.21.15.132:0/365684641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a300cdc60 con 0x7f3a300b87a0 2023-05-10T04:20:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.555+0000 7f3a137fe700 1 -- 172.21.15.132:0/365684641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a0c0052f0 con 0x7f3a300b87a0 2023-05-10T04:20:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.556+0000 7f3a25ffb700 1 -- 172.21.15.132:0/365684641 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a2c003a20 con 0x7f3a300b87a0 2023-05-10T04:20:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.557+0000 7f3a25ffb700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a1406ace0 0x7f3a1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.557+0000 7f3a25ffb700 1 -- 172.21.15.132:0/365684641 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a2c020070 con 0x7f3a300b87a0 2023-05-10T04:20:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.557+0000 7f3a3499a700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a1406ace0 0x7f3a1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.558+0000 7f3a3499a700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a1406ace0 0x7f3a1406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a301e8d80 tx=0x7f3a20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.562+0000 7f3a25ffb700 1 -- 172.21.15.132:0/365684641 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3a2c055a70 con 0x7f3a300b87a0 2023-05-10T04:20:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.764+0000 7f3a137fe700 1 -- 172.21.15.132:0/365684641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a0c005b20 con 0x7f3a300b87a0 2023-05-10T04:20:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.764+0000 7f3a25ffb700 1 -- 172.21.15.132:0/365684641 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a2c059090 con 0x7f3a300b87a0 2023-05-10T04:20:07.766 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:07.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.766+0000 7f3a137fe700 1 -- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a1406ace0 msgr2=0x7f3a1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.766+0000 7f3a137fe700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a1406ace0 0x7f3a1406d190 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3a301e8d80 tx=0x7f3a20008040 comp rx=0 tx=0).stop 2023-05-10T04:20:07.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.766+0000 7f3a137fe700 1 -- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 msgr2=0x7f3a300c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.766+0000 7f3a137fe700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300c9f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c000c00 tx=0x7f3a2c004750 comp rx=0 tx=0).stop 2023-05-10T04:20:07.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.767+0000 7f3a137fe700 1 -- 172.21.15.132:0/365684641 shutdown_connections 2023-05-10T04:20:07.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.767+0000 7f3a137fe700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3a1406ace0 0x7f3a1406d190 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.767+0000 7f3a137fe700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3a30160b70 0x7f3a300d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.767+0000 7f3a137fe700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a300b87a0 0x7f3a300c9f80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.767+0000 7f3a137fe700 1 --2- 172.21.15.132:0/365684641 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3a301601e0 0x7f3a3014deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.767+0000 7f3a137fe700 1 -- 172.21.15.132:0/365684641 >> 172.21.15.132:0/365684641 conn(0x7f3a30071b10 msgr2=0x7f3a300b3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:07.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.767+0000 7f3a137fe700 1 -- 172.21.15.132:0/365684641 shutdown_connections 2023-05-10T04:20:07.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.767+0000 7f3a137fe700 1 -- 172.21.15.132:0/365684641 wait complete. 2023-05-10T04:20:07.786 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.970+0000 7ff8571ff700 1 Processor -- start 2023-05-10T04:20:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.970+0000 7ff8571ff700 1 -- start start 2023-05-10T04:20:07.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.971+0000 7ff8571ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff85015c590 0x7ff850160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.971+0000 7ff8571ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8500cff50 0x7ff8500d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.971+0000 7ff8571ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8500cd520 con 0x7ff8500cf010 2023-05-10T04:20:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.971+0000 7ff8571ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8500d2640 con 0x7ff8500cff50 2023-05-10T04:20:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.971+0000 7ff8571ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8501610d0 con 0x7ff85015c590 2023-05-10T04:20:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff85579c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8500cff50 0x7ff8500d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff85579c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8500cff50 0x7ff8500d2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50048/0 (socket says 172.21.15.132:50048) 2023-05-10T04:20:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff85579c700 1 -- 172.21.15.132:0/1563248653 learned_addr learned my addr 172.21.15.132:0/1563248653 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff854f9b700 1 --2- 172.21.15.132:0/1563248653 >> v2:172.21.15.154:3300/0 conn(0x7ff85015c590 0x7ff850160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff85579c700 1 -- 172.21.15.132:0/1563248653 >> v2:172.21.15.154:3300/0 conn(0x7ff85015c590 msgr2=0x7ff850160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff85579c700 1 --2- 172.21.15.132:0/1563248653 >> v2:172.21.15.154:3300/0 conn(0x7ff85015c590 0x7ff850160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff85579c700 1 -- 172.21.15.132:0/1563248653 >> v1:172.21.15.154:6789/0 conn(0x7ff8500cf010 legacy=0x7ff8500cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff85579c700 1 -- 172.21.15.132:0/1563248653 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8500b23c0 con 0x7ff8500cff50 2023-05-10T04:20:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.972+0000 7ff85579c700 1 --2- 172.21.15.132:0/1563248653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cff50 0x7ff8500d2ad0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff8500d0a50 tx=0x7ff84800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804895ab3994138f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff84f7fe700 1 -- 172.21.15.132:0/1563248653 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800e070 con 0x7ff8500cff50 2023-05-10T04:20:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff84f7fe700 1 -- 172.21.15.132:0/1563248653 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84800b9c0 con 0x7ff8500cff50 2023-05-10T04:20:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff84f7fe700 1 -- 172.21.15.132:0/1563248653 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84800bd70 con 0x7ff8500cff50 2023-05-10T04:20:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff8571ff700 1 -- 172.21.15.132:0/1563248653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cff50 msgr2=0x7ff8500d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff8571ff700 1 --2- 172.21.15.132:0/1563248653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cff50 0x7ff8500d2ad0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff8500d0a50 tx=0x7ff84800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff8571ff700 1 -- 172.21.15.132:0/1563248653 shutdown_connections 2023-05-10T04:20:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff8571ff700 1 --2- 172.21.15.132:0/1563248653 >> v2:172.21.15.154:3300/0 conn(0x7ff85015c590 0x7ff850160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff8571ff700 1 --2- 172.21.15.132:0/1563248653 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cff50 0x7ff8500d2ad0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff8571ff700 1 -- 172.21.15.132:0/1563248653 >> 172.21.15.132:0/1563248653 conn(0x7ff850071b10 msgr2=0x7ff850071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff8571ff700 1 -- 172.21.15.132:0/1563248653 shutdown_connections 2023-05-10T04:20:07.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.973+0000 7ff8571ff700 1 -- 172.21.15.132:0/1563248653 wait complete. 2023-05-10T04:20:07.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.975+0000 7ff8571ff700 1 Processor -- start 2023-05-10T04:20:07.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.975+0000 7ff8571ff700 1 -- start start 2023-05-10T04:20:07.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff8571ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cf010 0x7ff8500c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff8571ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8500cff50 0x7ff8500c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff8571ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff85015c590 0x7ff8501e6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff8571ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500b67b0 con 0x7ff8500cf010 2023-05-10T04:20:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff8571ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500b6a90 con 0x7ff85015c590 2023-05-10T04:20:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff8571ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8500b6d70 con 0x7ff8500cff50 2023-05-10T04:20:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff854f9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cf010 0x7ff8500c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff854f9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cf010 0x7ff8500c6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50054/0 (socket says 172.21.15.132:50054) 2023-05-10T04:20:07.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff854f9b700 1 -- 172.21.15.132:0/3408882834 learned_addr learned my addr 172.21.15.132:0/3408882834 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff84ffff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8500cff50 0x7ff8500c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.976+0000 7ff85579c700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff85015c590 0x7ff8501e6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff854f9b700 1 -- 172.21.15.132:0/3408882834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8500cff50 msgr2=0x7ff8500c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff854f9b700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8500cff50 0x7ff8500c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff854f9b700 1 -- 172.21.15.132:0/3408882834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff85015c590 msgr2=0x7ff8501e6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff854f9b700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff85015c590 0x7ff8501e6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff854f9b700 1 -- 172.21.15.132:0/3408882834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff848009b30 con 0x7ff8500cf010 2023-05-10T04:20:07.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff854f9b700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cf010 0x7ff8500c6a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff84400e810 tx=0x7ff84400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff84d7fa700 1 -- 172.21.15.132:0/3408882834 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84400c070 con 0x7ff8500cf010 2023-05-10T04:20:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff84d7fa700 1 -- 172.21.15.132:0/3408882834 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff844013610 con 0x7ff8500cf010 2023-05-10T04:20:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8500cd770 con 0x7ff8500cf010 2023-05-10T04:20:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff84d7fa700 1 -- 172.21.15.132:0/3408882834 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8440139c0 con 0x7ff8500cf010 2023-05-10T04:20:07.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.977+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8500cf560 con 0x7ff8500cf010 2023-05-10T04:20:07.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.978+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85015c960 con 0x7ff8500cf010 2023-05-10T04:20:07.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.979+0000 7ff84d7fa700 1 -- 172.21.15.132:0/3408882834 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff844013b20 con 0x7ff8500cf010 2023-05-10T04:20:07.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.980+0000 7ff84d7fa700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff83406ace0 0x7ff83406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:07.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.980+0000 7ff84d7fa700 1 -- 172.21.15.132:0/3408882834 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff844089550 con 0x7ff8500cf010 2023-05-10T04:20:07.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.980+0000 7ff84ffff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff83406ace0 0x7ff83406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:07.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.981+0000 7ff84ffff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff83406ace0 0x7ff83406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8501e6610 tx=0x7ff83c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:07.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:07.984+0000 7ff84d7fa700 1 -- 172.21.15.132:0/3408882834 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff844054280 con 0x7ff8500cf010 2023-05-10T04:20:08.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.179+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff8500b76a0 con 0x7ff8500cf010 2023-05-10T04:20:08.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.180+0000 7ff84d7fa700 1 -- 172.21.15.132:0/3408882834 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff8440578a0 con 0x7ff8500cf010 2023-05-10T04:20:08.183 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:08.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff83406ace0 msgr2=0x7ff83406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff83406ace0 0x7ff83406d190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff8501e6610 tx=0x7ff83c009040 comp rx=0 tx=0).stop 2023-05-10T04:20:08.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cf010 msgr2=0x7ff8500c6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cf010 0x7ff8500c6a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff84400e810 tx=0x7ff84400eb20 comp rx=0 tx=0).stop 2023-05-10T04:20:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 shutdown_connections 2023-05-10T04:20:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff83406ace0 0x7ff83406d190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff85015c590 0x7ff8501e6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8500cf010 0x7ff8500c6a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 --2- 172.21.15.132:0/3408882834 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff8500cff50 0x7ff8500c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 >> 172.21.15.132:0/3408882834 conn(0x7ff850071b10 msgr2=0x7ff8500c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 shutdown_connections 2023-05-10T04:20:08.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.182+0000 7ff8571ff700 1 -- 172.21.15.132:0/3408882834 wait complete. 2023-05-10T04:20:08.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:08.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.385+0000 7f0cfb9ff700 1 Processor -- start 2023-05-10T04:20:08.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.385+0000 7f0cfb9ff700 1 -- start start 2023-05-10T04:20:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.386+0000 7f0cfb9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.386+0000 7f0cfb9ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0cf4160d40 0x7f0cf40d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.386+0000 7f0cfb9ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf40cdc60 con 0x7f0cf41601e0 2023-05-10T04:20:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.386+0000 7f0cfb9ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf40d02d0 con 0x7f0cf4160d40 2023-05-10T04:20:08.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.386+0000 7f0cfb9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40d0cb0 con 0x7f0cf40b87a0 2023-05-10T04:20:08.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.386+0000 7f0cf8f9a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0cf41601e0 0x7f0cf4160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32918/0 (socket says 172.21.15.132:32918) 2023-05-10T04:20:08.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.386+0000 7f0cf8f9a700 1 -- 172.21.15.132:0/2276888522 learned_addr learned my addr 172.21.15.132:0/2276888522 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:08.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cf9f9c700 1 --2- 172.21.15.132:0/2276888522 >> v2:172.21.15.154:3300/0 conn(0x7f0cf4160d40 0x7f0cf40d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cf979b700 1 --2- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cebfff700 1 -- 172.21.15.132:0/2276888522 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238031813 0 0) 0x7f0cf40cdc60 con 0x7f0cf41601e0 2023-05-10T04:20:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cebfff700 1 -- 172.21.15.132:0/2276888522 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce00035b0 con 0x7f0cf41601e0 2023-05-10T04:20:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cebfff700 1 -- 172.21.15.132:0/2276888522 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2411090682 0 0) 0x7f0ce00035b0 con 0x7f0cf41601e0 2023-05-10T04:20:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cf9f9c700 1 -- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 msgr2=0x7f0cf40cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cf9f9c700 1 --2- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf40cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cf9f9c700 1 -- 172.21.15.132:0/2276888522 >> v1:172.21.15.132:6789/0 conn(0x7f0cf41601e0 legacy=0x7f0cf4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cf9f9c700 1 -- 172.21.15.132:0/2276888522 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf40cd6a0 con 0x7f0cf4160d40 2023-05-10T04:20:08.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cf979b700 1 --2- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:08.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.387+0000 7f0cf9f9c700 1 --2- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 0x7f0cf40d1100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009d90 tx=0x7f0cec00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf2447cdf13e9083 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:08.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cebfff700 1 -- 172.21.15.132:0/2276888522 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec00e070 con 0x7f0cf4160d40 2023-05-10T04:20:08.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cebfff700 1 -- 172.21.15.132:0/2276888522 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec003a20 con 0x7f0cf4160d40 2023-05-10T04:20:08.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cebfff700 1 -- 172.21.15.132:0/2276888522 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4001670 con 0x7f0cf4160d40 2023-05-10T04:20:08.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 msgr2=0x7f0cf40d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 0x7f0cf40d1100 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0cec009d90 tx=0x7f0cec00b330 comp rx=0 tx=0).stop 2023-05-10T04:20:08.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/2276888522 shutdown_connections 2023-05-10T04:20:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 0x7f0cf40d1100 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/2276888522 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf40cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/2276888522 >> 172.21.15.132:0/2276888522 conn(0x7f0cf4071b10 msgr2=0x7f0cf4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.388+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/2276888522 shutdown_connections 2023-05-10T04:20:08.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.389+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/2276888522 wait complete. 2023-05-10T04:20:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.390+0000 7f0cfb9ff700 1 Processor -- start 2023-05-10T04:20:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.390+0000 7f0cfb9ff700 1 -- start start 2023-05-10T04:20:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.391+0000 7f0cfb9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf41f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.391+0000 7f0cfb9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cf41601e0 0x7f0cf41513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.391+0000 7f0cfb9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 0x7f0cf41597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.391+0000 7f0cfb9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41f6100 con 0x7f0cf41601e0 2023-05-10T04:20:08.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.391+0000 7f0cfb9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf41f5510 con 0x7f0cf4160d40 2023-05-10T04:20:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.391+0000 7f0cfb9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf4151900 con 0x7f0cf40b87a0 2023-05-10T04:20:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cf41601e0 0x7f0cf41513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cf41601e0 0x7f0cf41513c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50056/0 (socket says 172.21.15.132:50056) 2023-05-10T04:20:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 -- 172.21.15.132:0/1480708208 learned_addr learned my addr 172.21.15.132:0/1480708208 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf9f9c700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 0x7f0cf41597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf979b700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf41f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 -- 172.21.15.132:0/1480708208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 msgr2=0x7f0cf41f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf41f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 -- 172.21.15.132:0/1480708208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 msgr2=0x7f0cf41597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 0x7f0cf41597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 -- 172.21.15.132:0/1480708208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00094a0 con 0x7f0cf41601e0 2023-05-10T04:20:08.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cf8f9a700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cf41601e0 0x7f0cf41513c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40011e0 tx=0x7f0ce400cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:08.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0ce9ffb700 1 -- 172.21.15.132:0/1480708208 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4007560 con 0x7f0cf41601e0 2023-05-10T04:20:08.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0ce9ffb700 1 -- 172.21.15.132:0/1480708208 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce40076c0 con 0x7f0cf41601e0 2023-05-10T04:20:08.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec009a70 con 0x7f0cf41601e0 2023-05-10T04:20:08.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.392+0000 7f0ce9ffb700 1 -- 172.21.15.132:0/1480708208 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4004a90 con 0x7f0cf41601e0 2023-05-10T04:20:08.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.393+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf40d1640 con 0x7f0cf41601e0 2023-05-10T04:20:08.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.394+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf40cd980 con 0x7f0cf41601e0 2023-05-10T04:20:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.394+0000 7f0ce9ffb700 1 -- 172.21.15.132:0/1480708208 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0ce4004bf0 con 0x7f0cf41601e0 2023-05-10T04:20:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.395+0000 7f0ce9ffb700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0cd806ace0 0x7f0cd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.395+0000 7f0ce9ffb700 1 -- 172.21.15.132:0/1480708208 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0ce4088ca0 con 0x7f0cf41601e0 2023-05-10T04:20:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.396+0000 7f0cf979b700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0cd806ace0 0x7f0cd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.396+0000 7f0cf979b700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0cd806ace0 0x7f0cd806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40b2310 tx=0x7f0cf0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:08.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.399+0000 7f0ce9ffb700 1 -- 172.21.15.132:0/1480708208 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0ce4053a50 con 0x7f0cf41601e0 2023-05-10T04:20:08.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.594+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0cf40d17d0 con 0x7f0cf41601e0 2023-05-10T04:20:08.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.595+0000 7f0ce9ffb700 1 -- 172.21.15.132:0/1480708208 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ce4018020 con 0x7f0cf41601e0 2023-05-10T04:20:08.598 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:08.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0cd806ace0 msgr2=0x7f0cd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0cd806ace0 0x7f0cd806d190 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40b2310 tx=0x7f0cf0008040 comp rx=0 tx=0).stop 2023-05-10T04:20:08.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cf41601e0 msgr2=0x7f0cf41513c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cf41601e0 0x7f0cf41513c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40011e0 tx=0x7f0ce400cb00 comp rx=0 tx=0).stop 2023-05-10T04:20:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 shutdown_connections 2023-05-10T04:20:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0cd806ace0 0x7f0cd806d190 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0cf4160d40 0x7f0cf41597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0cf40b87a0 0x7f0cf41f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 --2- 172.21.15.132:0/1480708208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cf41601e0 0x7f0cf41513c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 >> 172.21.15.132:0/1480708208 conn(0x7f0cf4071b10 msgr2=0x7f0cf40b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 shutdown_connections 2023-05-10T04:20:08.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.597+0000 7f0cfb9ff700 1 -- 172.21.15.132:0/1480708208 wait complete. 2023-05-10T04:20:08.617 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:08.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.802+0000 7fdd5c7ff700 1 Processor -- start 2023-05-10T04:20:08.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.803+0000 7fdd5c7ff700 1 -- start start 2023-05-10T04:20:08.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5c7ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd540b87a0 0x7fdd540cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5c7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 0x7fdd54160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5c7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd54160ff0 con 0x7fdd54160b70 2023-05-10T04:20:08.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5c7ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd540d02d0 con 0x7fdd540b87a0 2023-05-10T04:20:08.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5c7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd540d0cb0 con 0x7fdd541601e0 2023-05-10T04:20:08.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5a59b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd540b87a0 0x7fdd540cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5a59b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd540b87a0 0x7fdd540cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50062/0 (socket says 172.21.15.132:50062) 2023-05-10T04:20:08.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5ad9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdd54160b70 0x7fdd540d2de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32934/0 (socket says 172.21.15.132:32934) 2023-05-10T04:20:08.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5a59b700 1 -- 172.21.15.132:0/2852303769 learned_addr learned my addr 172.21.15.132:0/2852303769 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:08.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd59d9a700 1 --2- 172.21.15.132:0/2852303769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 0x7fdd54160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5a59b700 1 -- 172.21.15.132:0/2852303769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 msgr2=0x7fdd54160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:08.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5a59b700 1 --2- 172.21.15.132:0/2852303769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 0x7fdd54160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5a59b700 1 -- 172.21.15.132:0/2852303769 >> v1:172.21.15.132:6789/0 conn(0x7fdd54160b70 legacy=0x7fdd540d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd5a59b700 1 -- 172.21.15.132:0/2852303769 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd540cdc60 con 0x7fdd540b87a0 2023-05-10T04:20:08.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.804+0000 7fdd59599700 1 -- 172.21.15.132:0/2852303769 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779202531 0 0) 0x7fdd54160ff0 con 0x7fdd54160b70 2023-05-10T04:20:08.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.805+0000 7fdd5a59b700 1 --2- 172.21.15.132:0/2852303769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd540b87a0 0x7fdd540cfbf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdd500098f0 tx=0x7fdd50009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d057d049291ccff server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:08.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.805+0000 7fdd59599700 1 -- 172.21.15.132:0/2852303769 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000b8a0 con 0x7fdd540b87a0 2023-05-10T04:20:08.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.805+0000 7fdd59599700 1 -- 172.21.15.132:0/2852303769 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5000ba00 con 0x7fdd540b87a0 2023-05-10T04:20:08.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.805+0000 7fdd59599700 1 -- 172.21.15.132:0/2852303769 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000bd90 con 0x7fdd540b87a0 2023-05-10T04:20:08.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.805+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2852303769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd540b87a0 msgr2=0x7fdd540cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.805+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2852303769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd540b87a0 0x7fdd540cfbf0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdd500098f0 tx=0x7fdd50009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:08.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.806+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2852303769 shutdown_connections 2023-05-10T04:20:08.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.806+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2852303769 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd540b87a0 0x7fdd540cfbf0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.806+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2852303769 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 0x7fdd54160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.806+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2852303769 >> 172.21.15.132:0/2852303769 conn(0x7fdd54071b10 msgr2=0x7fdd54071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:08.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.806+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2852303769 shutdown_connections 2023-05-10T04:20:08.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.806+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2852303769 wait complete. 2023-05-10T04:20:08.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.807+0000 7fdd5c7ff700 1 Processor -- start 2023-05-10T04:20:08.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.807+0000 7fdd5c7ff700 1 -- start start 2023-05-10T04:20:08.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.808+0000 7fdd5c7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd540b87a0 0x7fdd541513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.808+0000 7fdd5c7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 0x7fdd541f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.808+0000 7fdd5c7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd54160b70 0x7fdd540cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.808+0000 7fdd5c7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd541518e0 con 0x7fdd54160b70 2023-05-10T04:20:08.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.808+0000 7fdd5c7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd541f23f0 con 0x7fdd540b87a0 2023-05-10T04:20:08.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.808+0000 7fdd5c7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5415d210 con 0x7fdd541601e0 2023-05-10T04:20:08.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.808+0000 7fdd5ad9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd54160b70 0x7fdd540cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5ad9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd54160b70 0x7fdd540cb4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50078/0 (socket says 172.21.15.132:50078) 2023-05-10T04:20:08.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5ad9c700 1 -- 172.21.15.132:0/2231821341 learned_addr learned my addr 172.21.15.132:0/2231821341 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:08.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd59d9a700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 0x7fdd541f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5a59b700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd540b87a0 0x7fdd541513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5ad9c700 1 -- 172.21.15.132:0/2231821341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 msgr2=0x7fdd541f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5ad9c700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 0x7fdd541f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5ad9c700 1 -- 172.21.15.132:0/2231821341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd540b87a0 msgr2=0x7fdd541513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:08.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5ad9c700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd540b87a0 0x7fdd541513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:08.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5ad9c700 1 -- 172.21.15.132:0/2231821341 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50009550 con 0x7fdd54160b70 2023-05-10T04:20:08.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5ad9c700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd54160b70 0x7fdd540cb4a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00cba0 tx=0x7fdd4c00ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:08.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd4affd700 1 -- 172.21.15.132:0/2231821341 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00aad0 con 0x7fdd54160b70 2023-05-10T04:20:08.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd4affd700 1 -- 172.21.15.132:0/2231821341 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c00ac50 con 0x7fdd54160b70 2023-05-10T04:20:08.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd4affd700 1 -- 172.21.15.132:0/2231821341 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0070d0 con 0x7fdd54160b70 2023-05-10T04:20:08.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.809+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd540cd980 con 0x7fdd54160b70 2023-05-10T04:20:08.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.810+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd540cd6a0 con 0x7fdd54160b70 2023-05-10T04:20:08.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.811+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd540d2110 con 0x7fdd54160b70 2023-05-10T04:20:08.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.811+0000 7fdd4affd700 1 -- 172.21.15.132:0/2231821341 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd4c007230 con 0x7fdd54160b70 2023-05-10T04:20:08.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.812+0000 7fdd4affd700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3806ace0 0x7fdd3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:08.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.812+0000 7fdd4affd700 1 -- 172.21.15.132:0/2231821341 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdd4c0891d0 con 0x7fdd54160b70 2023-05-10T04:20:08.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.813+0000 7fdd5a59b700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3806ace0 0x7fdd3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:08.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.813+0000 7fdd5a59b700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3806ace0 0x7fdd3806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009c40 tx=0x7fdd50008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:08.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:08.817+0000 7fdd4affd700 1 -- 172.21.15.132:0/2231821341 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdd4c053f90 con 0x7fdd54160b70 2023-05-10T04:20:09.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.010+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdd54074430 con 0x7fdd54160b70 2023-05-10T04:20:09.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.011+0000 7fdd4affd700 1 -- 172.21.15.132:0/2231821341 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdd4c0575b0 con 0x7fdd54160b70 2023-05-10T04:20:09.014 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:09.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.013+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3806ace0 msgr2=0x7fdd3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.013+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3806ace0 0x7fdd3806d190 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009c40 tx=0x7fdd50008030 comp rx=0 tx=0).stop 2023-05-10T04:20:09.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.013+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd54160b70 msgr2=0x7fdd540cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.013+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd54160b70 0x7fdd540cb4a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c00cba0 tx=0x7fdd4c00ceb0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.013+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 shutdown_connections 2023-05-10T04:20:09.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.014+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3806ace0 0x7fdd3806d190 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.014+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd54160b70 0x7fdd540cb4a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.014+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd540b87a0 0x7fdd541513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.014+0000 7fdd5c7ff700 1 --2- 172.21.15.132:0/2231821341 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd541601e0 0x7fdd541f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.014+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 >> 172.21.15.132:0/2231821341 conn(0x7fdd54071b10 msgr2=0x7fdd54071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:09.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.014+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 shutdown_connections 2023-05-10T04:20:09.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.014+0000 7fdd5c7ff700 1 -- 172.21.15.132:0/2231821341 wait complete. 2023-05-10T04:20:09.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.216+0000 7fede35ff700 1 Processor -- start 2023-05-10T04:20:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.216+0000 7fede35ff700 1 -- start start 2023-05-10T04:20:09.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.217+0000 7fede35ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feddc15c590 0x7feddc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.217+0000 7fede35ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feddc0cf010 0x7feddc0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.217+0000 7fede35ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc0cd520 con 0x7feddc0cfd80 2023-05-10T04:20:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.217+0000 7fede35ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc0d2640 con 0x7feddc0cf010 2023-05-10T04:20:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.217+0000 7fede35ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc1610d0 con 0x7feddc15c590 2023-05-10T04:20:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.217+0000 7fede0b9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feddc0cf010 0x7feddc0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.217+0000 7fede1b9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feddc0cfd80 0x7feddc0d0aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32946/0 (socket says 172.21.15.132:32946) 2023-05-10T04:20:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.217+0000 7fede1b9c700 1 -- 172.21.15.132:0/2813071547 learned_addr learned my addr 172.21.15.132:0/2813071547 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fede139b700 1 --2- 172.21.15.132:0/2813071547 >> v2:172.21.15.154:3300/0 conn(0x7feddc15c590 0x7feddc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fede0b9a700 1 -- 172.21.15.132:0/2813071547 >> v2:172.21.15.154:3300/0 conn(0x7feddc15c590 msgr2=0x7feddc160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fede0b9a700 1 --2- 172.21.15.132:0/2813071547 >> v2:172.21.15.154:3300/0 conn(0x7feddc15c590 0x7feddc160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fede0b9a700 1 -- 172.21.15.132:0/2813071547 >> v1:172.21.15.132:6789/0 conn(0x7feddc0cfd80 legacy=0x7feddc0d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fede0b9a700 1 -- 172.21.15.132:0/2813071547 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc0b23c0 con 0x7feddc0cf010 2023-05-10T04:20:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fedd3fff700 1 -- 172.21.15.132:0/2813071547 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239671447 0 0) 0x7feddc0cd520 con 0x7feddc0cfd80 2023-05-10T04:20:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fede0b9a700 1 --2- 172.21.15.132:0/2813071547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc0cf840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feddc0d0a50 tx=0x7fedcc009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb7541abb0bf93e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fedd3fff700 1 -- 172.21.15.132:0/2813071547 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc011830 con 0x7feddc0cf010 2023-05-10T04:20:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fedd3fff700 1 -- 172.21.15.132:0/2813071547 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc011990 con 0x7feddc0cf010 2023-05-10T04:20:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.218+0000 7fedd3fff700 1 -- 172.21.15.132:0/2813071547 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc011d20 con 0x7feddc0cf010 2023-05-10T04:20:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.219+0000 7fede35ff700 1 -- 172.21.15.132:0/2813071547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 msgr2=0x7feddc0cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.219+0000 7fede35ff700 1 --2- 172.21.15.132:0/2813071547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc0cf840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7feddc0d0a50 tx=0x7fedcc009b20 comp rx=0 tx=0).stop 2023-05-10T04:20:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.219+0000 7fede35ff700 1 -- 172.21.15.132:0/2813071547 shutdown_connections 2023-05-10T04:20:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.219+0000 7fede35ff700 1 --2- 172.21.15.132:0/2813071547 >> v2:172.21.15.154:3300/0 conn(0x7feddc15c590 0x7feddc160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.219+0000 7fede35ff700 1 --2- 172.21.15.132:0/2813071547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc0cf840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.219+0000 7fede35ff700 1 -- 172.21.15.132:0/2813071547 >> 172.21.15.132:0/2813071547 conn(0x7feddc071b10 msgr2=0x7feddc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:09.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.219+0000 7fede35ff700 1 -- 172.21.15.132:0/2813071547 shutdown_connections 2023-05-10T04:20:09.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.219+0000 7fede35ff700 1 -- 172.21.15.132:0/2813071547 wait complete. 2023-05-10T04:20:09.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.221+0000 7fede35ff700 1 Processor -- start 2023-05-10T04:20:09.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.222+0000 7fede35ff700 1 -- start start 2023-05-10T04:20:09.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede35ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc14b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede35ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc0cfd80 0x7feddc0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede35ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feddc15c590 0x7feddc0b79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede35ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0c6c10 con 0x7feddc0cf010 2023-05-10T04:20:09.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede35ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1e7990 con 0x7feddc0cfd80 2023-05-10T04:20:09.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede35ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc1e7c70 con 0x7feddc15c590 2023-05-10T04:20:09.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede139b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc14b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede139b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc14b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50104/0 (socket says 172.21.15.132:50104) 2023-05-10T04:20:09.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede139b700 1 -- 172.21.15.132:0/155826427 learned_addr learned my addr 172.21.15.132:0/155826427 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:09.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede0b9a700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc0cfd80 0x7feddc0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede1b9c700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feddc15c590 0x7feddc0b79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede139b700 1 -- 172.21.15.132:0/155826427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feddc15c590 msgr2=0x7feddc0b79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede139b700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feddc15c590 0x7feddc0b79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede139b700 1 -- 172.21.15.132:0/155826427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc0cfd80 msgr2=0x7feddc0b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede139b700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc0cfd80 0x7feddc0b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.223+0000 7fede139b700 1 -- 172.21.15.132:0/155826427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc0094a0 con 0x7feddc0cf010 2023-05-10T04:20:09.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.224+0000 7fede139b700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc14b1c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fedd800e9b0 tx=0x7fedd800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:09.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.224+0000 7fedd1ffb700 1 -- 172.21.15.132:0/155826427 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd8009710 con 0x7feddc0cf010 2023-05-10T04:20:09.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.224+0000 7fedd1ffb700 1 -- 172.21.15.132:0/155826427 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd800c850 con 0x7feddc0cf010 2023-05-10T04:20:09.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.224+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc0cd770 con 0x7feddc0cf010 2023-05-10T04:20:09.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.224+0000 7fedd1ffb700 1 -- 172.21.15.132:0/155826427 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd800cbc0 con 0x7feddc0cf010 2023-05-10T04:20:09.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.224+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc0cf560 con 0x7feddc0cf010 2023-05-10T04:20:09.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.225+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc0d01a0 con 0x7feddc0cf010 2023-05-10T04:20:09.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.226+0000 7fedd1ffb700 1 -- 172.21.15.132:0/155826427 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fedd800cd20 con 0x7feddc0cf010 2023-05-10T04:20:09.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.227+0000 7fedd1ffb700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fedc006ace0 0x7fedc006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.227+0000 7fedd1ffb700 1 -- 172.21.15.132:0/155826427 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fedd80899b0 con 0x7feddc0cf010 2023-05-10T04:20:09.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.227+0000 7fede0b9a700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fedc006ace0 0x7fedc006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.228+0000 7fede0b9a700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fedc006ace0 0x7fedc006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0090b0 tx=0x7fedcc01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:09.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.231+0000 7fedd1ffb700 1 -- 172.21.15.132:0/155826427 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fedd80580d0 con 0x7feddc0cf010 2023-05-10T04:20:09.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.429+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7feddc0b51f0 con 0x7feddc0cf010 2023-05-10T04:20:09.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.430+0000 7fedd1ffb700 1 -- 172.21.15.132:0/155826427 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fedd80170a0 con 0x7feddc0cf010 2023-05-10T04:20:09.433 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:09.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fedc006ace0 msgr2=0x7fedc006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fedc006ace0 0x7fedc006d190 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0090b0 tx=0x7fedcc01c040 comp rx=0 tx=0).stop 2023-05-10T04:20:09.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 msgr2=0x7feddc14b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc14b1c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fedd800e9b0 tx=0x7fedd800ed70 comp rx=0 tx=0).stop 2023-05-10T04:20:09.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 shutdown_connections 2023-05-10T04:20:09.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fedc006ace0 0x7fedc006d190 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feddc15c590 0x7feddc0b79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feddc0cf010 0x7feddc14b1c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 --2- 172.21.15.132:0/155826427 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feddc0cfd80 0x7feddc0b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 >> 172.21.15.132:0/155826427 conn(0x7feddc071b10 msgr2=0x7feddc15b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:09.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 shutdown_connections 2023-05-10T04:20:09.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.432+0000 7fede35ff700 1 -- 172.21.15.132:0/155826427 wait complete. 2023-05-10T04:20:09.542 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-05-10T04:20:09.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-05-10T04:20:09.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.724+0000 7f7f423ff700 1 Processor -- start 2023-05-10T04:20:09.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.725+0000 7f7f423ff700 1 -- start start 2023-05-10T04:20:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f423ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0b1d50 0x7f7f3c06b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f423ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c06a5f0 con 0x7f7f3c0cd790 2023-05-10T04:20:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f423ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c06a840 con 0x7f7f3c0ca210 2023-05-10T04:20:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f423ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0ca6b0 con 0x7f7f3c0b1d50 2023-05-10T04:20:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f3bfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7f3c0cd790 0x7f7f3c0cdb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32948/0 (socket says 172.21.15.132:32948) 2023-05-10T04:20:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f3bfff700 1 -- 172.21.15.132:0/4228473150 learned_addr learned my addr 172.21.15.132:0/4228473150 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f4099c700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0b1d50 0x7f7f3c06b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3358216594 0 0) 0x7f7f3c06a5f0 con 0x7f7f3c0cd790 2023-05-10T04:20:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.726+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f240035b0 con 0x7f7f3c0cd790 2023-05-10T04:20:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1907832525 0 0) 0x7f7f240035b0 con 0x7f7f3c0cd790 2023-05-10T04:20:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0b1d50 msgr2=0x7f7f3c06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0b1d50 0x7f7f3c06b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 >> v1:172.21.15.154:6789/0 conn(0x7f7f3c0ca210 legacy=0x7f7f3c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c06ab20 con 0x7f7f3c0cd790 2023-05-10T04:20:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f7f2c001670 con 0x7f7f3c0cd790 2023-05-10T04:20:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 >> v1:172.21.15.132:6789/0 conn(0x7f7f3c0cd790 legacy=0x7f7f3c0cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f24003a30 0x7f7f24003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0b1d50 0x7f7f24004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f24005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2400bba0 con 0x7f7f24004d90 2023-05-10T04:20:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2400bce0 con 0x7f7f24003a30 2023-05-10T04:20:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2400bea0 con 0x7f7f3c0b1d50 2023-05-10T04:20:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f4099c700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f24005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3bfff700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f24003a30 0x7f7f24003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.727+0000 7f7f3b7fe700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0b1d50 0x7f7f24004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f4099c700 1 -- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0b1d50 msgr2=0x7f7f24004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:09.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f4099c700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0b1d50 0x7f7f24004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f4099c700 1 -- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f24003a30 msgr2=0x7f7f24003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:09.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f4099c700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f24003a30 0x7f7f24003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f4099c700 1 -- 172.21.15.132:0/4228473150 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f240035b0 con 0x7f7f24004d90 2023-05-10T04:20:09.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f3bfff700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f24003a30 0x7f7f24003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:09.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f4099c700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f24005200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009fc0 tx=0x7f7f24005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90409763c0264e6b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:09.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3400ec30 con 0x7f7f24004d90 2023-05-10T04:20:09.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3400f040 con 0x7f7f24004d90 2023-05-10T04:20:09.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f3affd700 1 -- 172.21.15.132:0/4228473150 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34014480 con 0x7f7f24004d90 2023-05-10T04:20:09.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f423ff700 1 -- 172.21.15.132:0/4228473150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 msgr2=0x7f7f24005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f423ff700 1 --2- 172.21.15.132:0/4228473150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f24005200 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f34009fc0 tx=0x7f7f24005880 comp rx=0 tx=0).stop 2023-05-10T04:20:09.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.728+0000 7f7f4099c700 1 -- 172.21.15.132:0/4228473150 reap_dead start 2023-05-10T04:20:09.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.729+0000 7f7f423ff700 1 -- 172.21.15.132:0/4228473150 shutdown_connections 2023-05-10T04:20:09.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.729+0000 7f7f423ff700 1 -- 172.21.15.132:0/4228473150 >> 172.21.15.132:0/4228473150 conn(0x7f7f3c06e980 msgr2=0x7f7f3c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:09.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.729+0000 7f7f423ff700 1 -- 172.21.15.132:0/4228473150 shutdown_connections 2023-05-10T04:20:09.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.729+0000 7f7f423ff700 1 -- 172.21.15.132:0/4228473150 wait complete. 2023-05-10T04:20:09.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.731+0000 7f7f423ff700 1 Processor -- start 2023-05-10T04:20:09.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.731+0000 7f7f423ff700 1 -- start start 2023-05-10T04:20:09.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.732+0000 7f7f423ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f3c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.732+0000 7f7f423ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f3c0c5090 0x7f7f3c0c36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.732+0000 7f7f423ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0ad820 0x7f7f3c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.732+0000 7f7f423ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c4c70 con 0x7f7f24004d90 2023-05-10T04:20:09.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.732+0000 7f7f423ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c1543b0 con 0x7f7f3c0c5090 2023-05-10T04:20:09.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.732+0000 7f7f423ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0c3ff0 con 0x7f7f3c0ad820 2023-05-10T04:20:09.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f3c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f3c153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50126/0 (socket says 172.21.15.132:50126) 2023-05-10T04:20:09.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 -- 172.21.15.132:0/1309019725 learned_addr learned my addr 172.21.15.132:0/1309019725 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:09.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f4099c700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0ad820 0x7f7f3c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3b7fe700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f3c0c5090 0x7f7f3c0c36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 -- 172.21.15.132:0/1309019725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0ad820 msgr2=0x7f7f3c0c5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0ad820 0x7f7f3c0c5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 -- 172.21.15.132:0/1309019725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f3c0c5090 msgr2=0x7f7f3c0c36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:09.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f3c0c5090 0x7f7f3c0c36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:09.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 -- 172.21.15.132:0/1309019725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c06b0e0 con 0x7f7f24004d90 2023-05-10T04:20:09.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f3bfff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f3c153e70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c001200 tx=0x7f7f2c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:09.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f38ff9700 1 -- 172.21.15.132:0/1309019725 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c012590 con 0x7f7f24004d90 2023-05-10T04:20:09.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f38ff9700 1 -- 172.21.15.132:0/1309019725 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c0126f0 con 0x7f7f24004d90 2023-05-10T04:20:09.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.733+0000 7f7f38ff9700 1 -- 172.21.15.132:0/1309019725 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c012a60 con 0x7f7f24004d90 2023-05-10T04:20:09.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.734+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c06ae00 con 0x7f7f24004d90 2023-05-10T04:20:09.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.734+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c15ca20 con 0x7f7f24004d90 2023-05-10T04:20:09.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.735+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c0672e0 con 0x7f7f24004d90 2023-05-10T04:20:09.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.736+0000 7f7f38ff9700 1 -- 172.21.15.132:0/1309019725 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f2c012bc0 con 0x7f7f24004d90 2023-05-10T04:20:09.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.736+0000 7f7f38ff9700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7f2806ad10 0x7f7f2806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:09.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.736+0000 7f7f38ff9700 1 -- 172.21.15.132:0/1309019725 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7f2c089590 con 0x7f7f24004d90 2023-05-10T04:20:09.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.737+0000 7f7f3b7fe700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7f2806ad10 0x7f7f2806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:09.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.737+0000 7f7f3b7fe700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7f2806ad10 0x7f7f2806d1c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7f30007fd0 tx=0x7f7f30007ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:09.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:09.741+0000 7f7f38ff9700 1 -- 172.21.15.132:0/1309019725 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7f2c054340 con 0x7f7f24004d90 2023-05-10T04:20:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.017+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f7f3c06c510 con 0x7f7f24004d90 2023-05-10T04:20:10.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.625+0000 7f7f38ff9700 1 -- 172.21.15.132:0/1309019725 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v78) v1 ==== 147+0+0 (secure 0 0 0) 0x7f7f2c057960 con 0x7f7f24004d90 2023-05-10T04:20:10.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.627+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7f2806ad10 msgr2=0x7f7f2806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:10.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.627+0000 7f7f423ff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7f2806ad10 0x7f7f2806d1c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7f30007fd0 tx=0x7f7f30007ce0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.627+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 msgr2=0x7f7f3c153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:10.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.627+0000 7f7f423ff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f3c153e70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c001200 tx=0x7f7f2c00eb80 comp rx=0 tx=0).stop 2023-05-10T04:20:10.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.628+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 shutdown_connections 2023-05-10T04:20:10.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.628+0000 7f7f423ff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7f2806ad10 0x7f7f2806d1c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.628+0000 7f7f423ff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7f3c0ad820 0x7f7f3c0c5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.628+0000 7f7f423ff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f24004d90 0x7f7f3c153e70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.628+0000 7f7f423ff700 1 --2- 172.21.15.132:0/1309019725 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7f3c0c5090 0x7f7f3c0c36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.628+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 >> 172.21.15.132:0/1309019725 conn(0x7f7f3c06e980 msgr2=0x7f7f3c0ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:10.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.628+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 shutdown_connections 2023-05-10T04:20:10.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.628+0000 7f7f423ff700 1 -- 172.21.15.132:0/1309019725 wait complete. 2023-05-10T04:20:10.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-10T04:20:10.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.836+0000 7f6b563ff700 1 Processor -- start 2023-05-10T04:20:10.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.836+0000 7f6b563ff700 1 -- start start 2023-05-10T04:20:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b563ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b500afcd0 0x7f6b500ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b563ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b500ceee0 0x7f6b500b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b563ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b500b0cd0 con 0x7f6b5015a7e0 2023-05-10T04:20:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b563ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b500cf360 con 0x7f6b500afcd0 2023-05-10T04:20:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b563ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b500b03a0 con 0x7f6b500ceee0 2023-05-10T04:20:10.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b47fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b500afcd0 0x7f6b500ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:10.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b47fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b500afcd0 0x7f6b500ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50132/0 (socket says 172.21.15.132:50132) 2023-05-10T04:20:10.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b47fff700 1 -- 172.21.15.132:0/136823348 learned_addr learned my addr 172.21.15.132:0/136823348 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:10.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b5499c700 1 --2- 172.21.15.132:0/136823348 >> v2:172.21.15.154:3300/0 conn(0x7f6b500ceee0 0x7f6b500b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b47fff700 1 -- 172.21.15.132:0/136823348 >> v2:172.21.15.154:3300/0 conn(0x7f6b500ceee0 msgr2=0x7f6b500b1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:10.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b47fff700 1 --2- 172.21.15.132:0/136823348 >> v2:172.21.15.154:3300/0 conn(0x7f6b500ceee0 0x7f6b500b1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b47fff700 1 -- 172.21.15.132:0/136823348 >> v1:172.21.15.154:6789/0 conn(0x7f6b5015a7e0 legacy=0x7f6b500af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.838+0000 7f6b47fff700 1 -- 172.21.15.132:0/136823348 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500b0680 con 0x7f6b500afcd0 2023-05-10T04:20:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b47fff700 1 --2- 172.21.15.132:0/136823348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b500afcd0 0x7f6b500ce9a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b500cb3b0 tx=0x7f6b38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb18526c67391c26 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b4f7fe700 1 -- 172.21.15.132:0/136823348 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38005e30 con 0x7f6b500afcd0 2023-05-10T04:20:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b4f7fe700 1 -- 172.21.15.132:0/136823348 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b38004030 con 0x7f6b500afcd0 2023-05-10T04:20:10.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b4f7fe700 1 -- 172.21.15.132:0/136823348 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b380043e0 con 0x7f6b500afcd0 2023-05-10T04:20:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b563ff700 1 -- 172.21.15.132:0/136823348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b500afcd0 msgr2=0x7f6b500ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b563ff700 1 --2- 172.21.15.132:0/136823348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b500afcd0 0x7f6b500ce9a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6b500cb3b0 tx=0x7f6b38009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b563ff700 1 -- 172.21.15.132:0/136823348 shutdown_connections 2023-05-10T04:20:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b563ff700 1 --2- 172.21.15.132:0/136823348 >> v2:172.21.15.154:3300/0 conn(0x7f6b500ceee0 0x7f6b500b1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.839+0000 7f6b563ff700 1 --2- 172.21.15.132:0/136823348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b500afcd0 0x7f6b500ce9a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.840+0000 7f6b563ff700 1 -- 172.21.15.132:0/136823348 >> 172.21.15.132:0/136823348 conn(0x7f6b5009a0a0 msgr2=0x7f6b500d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.840+0000 7f6b563ff700 1 -- 172.21.15.132:0/136823348 shutdown_connections 2023-05-10T04:20:10.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.840+0000 7f6b563ff700 1 -- 172.21.15.132:0/136823348 wait complete. 2023-05-10T04:20:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.841+0000 7f6b563ff700 1 Processor -- start 2023-05-10T04:20:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.841+0000 7f6b563ff700 1 -- start start 2023-05-10T04:20:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.842+0000 7f6b563ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500afcd0 0x7f6b500c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.842+0000 7f6b563ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b500ceee0 0x7f6b500c5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.842+0000 7f6b563ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5015a7e0 0x7f6b500c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.842+0000 7f6b563ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500c77f0 con 0x7f6b5015a7e0 2023-05-10T04:20:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.842+0000 7f6b563ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500c4900 con 0x7f6b500afcd0 2023-05-10T04:20:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.842+0000 7f6b563ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b500b6c60 con 0x7f6b500ceee0 2023-05-10T04:20:10.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5015a7e0 0x7f6b500c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5015a7e0 0x7f6b500c57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50136/0 (socket says 172.21.15.132:50136) 2023-05-10T04:20:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 -- 172.21.15.132:0/319750135 learned_addr learned my addr 172.21.15.132:0/319750135 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b4ffff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500afcd0 0x7f6b500c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b47fff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b500ceee0 0x7f6b500c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 -- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b500ceee0 msgr2=0x7f6b500c5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b500ceee0 0x7f6b500c5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 -- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500afcd0 msgr2=0x7f6b500c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500afcd0 0x7f6b500c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 -- 172.21.15.132:0/319750135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b38009500 con 0x7f6b5015a7e0 2023-05-10T04:20:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b4ffff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500afcd0 0x7f6b500c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b5499c700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5015a7e0 0x7f6b500c57d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b48007e40 tx=0x7f6b4800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b4d7fa700 1 -- 172.21.15.132:0/319750135 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4800eea0 con 0x7f6b5015a7e0 2023-05-10T04:20:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b4d7fa700 1 -- 172.21.15.132:0/319750135 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48014420 con 0x7f6b5015a7e0 2023-05-10T04:20:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b500b16a0 con 0x7f6b5015a7e0 2023-05-10T04:20:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.843+0000 7f6b4d7fa700 1 -- 172.21.15.132:0/319750135 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b480147b0 con 0x7f6b5015a7e0 2023-05-10T04:20:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.844+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b500b0960 con 0x7f6b5015a7e0 2023-05-10T04:20:10.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.845+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b500b1830 con 0x7f6b5015a7e0 2023-05-10T04:20:10.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.845+0000 7f6b4d7fa700 1 -- 172.21.15.132:0/319750135 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b48014910 con 0x7f6b5015a7e0 2023-05-10T04:20:10.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.846+0000 7f6b4d7fa700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6b3006ace0 0x7f6b3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:10.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.846+0000 7f6b4d7fa700 1 -- 172.21.15.132:0/319750135 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6b48089f20 con 0x7f6b5015a7e0 2023-05-10T04:20:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.847+0000 7f6b4ffff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6b3006ace0 0x7f6b3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.847+0000 7f6b4ffff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6b3006ace0 0x7f6b3006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b40000f60 tx=0x7f6b40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:10.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:10.850+0000 7f6b4d7fa700 1 -- 172.21.15.132:0/319750135 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6b48054d70 con 0x7f6b5015a7e0 2023-05-10T04:20:11.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.047+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6b500d1000 con 0x7f6b5015a7e0 2023-05-10T04:20:11.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.051+0000 7f6b4d7fa700 1 -- 172.21.15.132:0/319750135 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6b48058390 con 0x7f6b5015a7e0 2023-05-10T04:20:11.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6b3006ace0 msgr2=0x7f6b3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6b3006ace0 0x7f6b3006d190 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b40000f60 tx=0x7f6b40009040 comp rx=0 tx=0).stop 2023-05-10T04:20:11.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5015a7e0 msgr2=0x7f6b500c57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5015a7e0 0x7f6b500c57d0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b48007e40 tx=0x7f6b4800e3c0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 shutdown_connections 2023-05-10T04:20:11.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6b3006ace0 0x7f6b3006d190 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5015a7e0 0x7f6b500c57d0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b500afcd0 0x7f6b500c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 --2- 172.21.15.132:0/319750135 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b500ceee0 0x7f6b500c5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 >> 172.21.15.132:0/319750135 conn(0x7f6b5009a0a0 msgr2=0x7f6b500cf4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:11.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 shutdown_connections 2023-05-10T04:20:11.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.054+0000 7f6b563ff700 1 -- 172.21.15.132:0/319750135 wait complete. 2023-05-10T04:20:11.074 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-10T04:20:11.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T04:20:11.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-10T04:20:11.275 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-10T04:20:11.276 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:20:11.276 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:11.315 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:20:11.316 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:11.394 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:11.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.615+0000 7f4cfadff700 1 Processor -- start 2023-05-10T04:20:11.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.615+0000 7f4cfadff700 1 -- start start 2023-05-10T04:20:11.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.616+0000 7f4cfadff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4cf40adf70 0x7f4cf40cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:11.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cfadff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf40cc9e0 con 0x7f4cf40cd760 2023-05-10T04:20:11.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cfadff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf415de20 con 0x7f4cf415cf10 2023-05-10T04:20:11.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cfadff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf415d860 con 0x7f4cf40adf70 2023-05-10T04:20:11.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf8b9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4cf40cd760 0x7f4cf40cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32962/0 (socket says 172.21.15.132:32962) 2023-05-10T04:20:11.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf8b9b700 1 -- 172.21.15.132:0/4181632434 learned_addr learned my addr 172.21.15.132:0/4181632434 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:11.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2167000841 0 0) 0x7f4cf40cc9e0 con 0x7f4cf40cd760 2023-05-10T04:20:11.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ce40035b0 con 0x7f4cf40cd760 2023-05-10T04:20:11.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf3fff700 1 --2- 172.21.15.132:0/4181632434 >> v2:172.21.15.154:3300/0 conn(0x7f4cf40adf70 0x7f4cf40cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:11.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2786606190 0 0) 0x7f4ce40035b0 con 0x7f4cf40cd760 2023-05-10T04:20:11.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 >> v2:172.21.15.154:3300/0 conn(0x7f4cf40adf70 msgr2=0x7f4cf40cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:11.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf37fe700 1 --2- 172.21.15.132:0/4181632434 >> v2:172.21.15.154:3300/0 conn(0x7f4cf40adf70 0x7f4cf40cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 >> v1:172.21.15.154:6789/0 conn(0x7f4cf415cf10 legacy=0x7f4cf406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf415db40 con 0x7f4cf40cd760 2023-05-10T04:20:11.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.617+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f4ce8001670 con 0x7f4cf40cd760 2023-05-10T04:20:11.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 >> v1:172.21.15.132:6789/0 conn(0x7f4cf40cd760 legacy=0x7f4cf40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf37fe700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ce4003a00 0x7f4ce4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:11.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf37fe700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4004850 0x7f4ce4004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:11.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf37fe700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce4005200 0x7f4ce400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:11.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf415d860 con 0x7f4ce4005200 2023-05-10T04:20:11.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce400c080 con 0x7f4ce4004850 2023-05-10T04:20:11.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce400c240 con 0x7f4ce4003a00 2023-05-10T04:20:11.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf939c700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce4005200 0x7f4ce400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:11.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf8b9b700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ce4003a00 0x7f4ce4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:11.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf3fff700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4004850 0x7f4ce4004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:11.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf939c700 1 -- 172.21.15.132:0/4181632434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ce4003a00 msgr2=0x7f4ce4003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:11.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf939c700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ce4003a00 0x7f4ce4003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf939c700 1 -- 172.21.15.132:0/4181632434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4004850 msgr2=0x7f4ce4004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:11.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf939c700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4004850 0x7f4ce4004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf939c700 1 -- 172.21.15.132:0/4181632434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce40035b0 con 0x7f4ce4005200 2023-05-10T04:20:11.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.618+0000 7f4cf939c700 1 -- 172.21.15.132:0/4181632434 reap_dead start 2023-05-10T04:20:11.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cf939c700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce4005200 0x7f4ce400ba10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4cec001f10 tx=0x7f4ce4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495bd635332a5c2a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:11.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00cd50 con 0x7f4ce4005200 2023-05-10T04:20:11.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec003a00 con 0x7f4ce4005200 2023-05-10T04:20:11.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cf37fe700 1 -- 172.21.15.132:0/4181632434 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec003db0 con 0x7f4ce4005200 2023-05-10T04:20:11.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cfadff700 1 -- 172.21.15.132:0/4181632434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce4005200 msgr2=0x7f4ce400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cfadff700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce4005200 0x7f4ce400ba10 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4cec001f10 tx=0x7f4ce4005880 comp rx=0 tx=0).stop 2023-05-10T04:20:11.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cfadff700 1 -- 172.21.15.132:0/4181632434 shutdown_connections 2023-05-10T04:20:11.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cfadff700 1 --2- 172.21.15.132:0/4181632434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce4005200 0x7f4ce400ba10 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cfadff700 1 -- 172.21.15.132:0/4181632434 >> 172.21.15.132:0/4181632434 conn(0x7f4cf40cf720 msgr2=0x7f4cf40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:11.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cfadff700 1 -- 172.21.15.132:0/4181632434 shutdown_connections 2023-05-10T04:20:11.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.619+0000 7f4cfadff700 1 -- 172.21.15.132:0/4181632434 wait complete. 2023-05-10T04:20:11.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.621+0000 7f4cfadff700 1 Processor -- start 2023-05-10T04:20:11.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.621+0000 7f4cfadff700 1 -- start start 2023-05-10T04:20:11.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.622+0000 7f4cfadff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4005200 0x7f4cf414cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:11.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.622+0000 7f4cfadff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf41e3d70 0x7f4cf41e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:11.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.622+0000 7f4cfadff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cf40b18c0 0x7f4cf40b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:11.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.622+0000 7f4cfadff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4156390 con 0x7f4cf40b18c0 2023-05-10T04:20:11.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.622+0000 7f4cfadff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf41e4720 con 0x7f4ce4005200 2023-05-10T04:20:11.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.622+0000 7f4cfadff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40b25b0 con 0x7f4cf41e3d70 2023-05-10T04:20:11.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cf40b18c0 0x7f4cf40b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:11.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cf40b18c0 0x7f4cf40b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50144/0 (socket says 172.21.15.132:50144) 2023-05-10T04:20:11.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 -- 172.21.15.132:0/734650275 learned_addr learned my addr 172.21.15.132:0/734650275 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:11.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf3fff700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf41e3d70 0x7f4cf41e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:11.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf8b9b700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4005200 0x7f4cf414cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:11.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 -- 172.21.15.132:0/734650275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf41e3d70 msgr2=0x7f4cf41e41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf41e3d70 0x7f4cf41e41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 -- 172.21.15.132:0/734650275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4005200 msgr2=0x7f4cf414cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4005200 0x7f4cf414cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 -- 172.21.15.132:0/734650275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf4071600 con 0x7f4cf40b18c0 2023-05-10T04:20:11.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf939c700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cf40b18c0 0x7f4cf40b1d60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4070480 tx=0x7f4cec0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:11.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf17fa700 1 -- 172.21.15.132:0/734650275 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0054e0 con 0x7f4cf40b18c0 2023-05-10T04:20:11.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cf17fa700 1 -- 172.21.15.132:0/734650275 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec005640 con 0x7f4cf40b18c0 2023-05-10T04:20:11.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.623+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf40cc670 con 0x7f4cf40b18c0 2023-05-10T04:20:11.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.624+0000 7f4cf17fa700 1 -- 172.21.15.132:0/734650275 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec011470 con 0x7f4cf40b18c0 2023-05-10T04:20:11.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.624+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf415d350 con 0x7f4cf40b18c0 2023-05-10T04:20:11.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.625+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf4071b50 con 0x7f4cf40b18c0 2023-05-10T04:20:11.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.628+0000 7f4cf17fa700 1 -- 172.21.15.132:0/734650275 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4cec0115d0 con 0x7f4cf40b18c0 2023-05-10T04:20:11.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.629+0000 7f4cf17fa700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cd806ace0 0x7f4cd806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:11.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.629+0000 7f4cf17fa700 1 -- 172.21.15.132:0/734650275 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4cec08b080 con 0x7f4cf40b18c0 2023-05-10T04:20:11.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.630+0000 7f4cf8b9b700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cd806ace0 0x7f4cd806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:11.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.630+0000 7f4cf8b9b700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cd806ace0 0x7f4cd806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:11.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.632+0000 7f4cf17fa700 1 -- 172.21.15.132:0/734650275 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4cec055e30 con 0x7f4cf40b18c0 2023-05-10T04:20:11.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.830+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cf40b4a10 con 0x7f4cf40b18c0 2023-05-10T04:20:11.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.831+0000 7f4cf17fa700 1 -- 172.21.15.132:0/734650275 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f4cec016020 con 0x7f4cf40b18c0 2023-05-10T04:20:11.834 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:11.835 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:11.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cd806ace0 msgr2=0x7f4cd806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cd806ace0 0x7f4cd806d190 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000c00 tx=0x7f4ce8009040 comp rx=0 tx=0).stop 2023-05-10T04:20:11.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cf40b18c0 msgr2=0x7f4cf40b1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:11.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cf40b18c0 0x7f4cf40b1d60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4070480 tx=0x7f4cec0014a0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 shutdown_connections 2023-05-10T04:20:11.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cd806ace0 0x7f4cd806d190 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4cf40b18c0 0x7f4cf40b1d60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ce4005200 0x7f4cf414cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 --2- 172.21.15.132:0/734650275 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4cf41e3d70 0x7f4cf41e41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:11.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 >> 172.21.15.132:0/734650275 conn(0x7f4cf40cf720 msgr2=0x7f4cf40cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:11.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 shutdown_connections 2023-05-10T04:20:11.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:11.834+0000 7f4cfadff700 1 -- 172.21.15.132:0/734650275 wait complete. 2023-05-10T04:20:11.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:11.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:12.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.039+0000 7f8fc55ff700 1 Processor -- start 2023-05-10T04:20:12.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.039+0000 7f8fc55ff700 1 -- start start 2023-05-10T04:20:12.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.040+0000 7f8fc55ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f8fc00d0b50 0x7f8fc00d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.040+0000 7f8fc55ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc015d480 con 0x7f8fc015a280 2023-05-10T04:20:12.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.040+0000 7f8fc55ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc015d6e0 con 0x7f8fc00cd640 2023-05-10T04:20:12.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.040+0000 7f8fc55ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc015d9c0 con 0x7f8fc00d0b50 2023-05-10T04:20:12.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbeffd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8fc015a280 0x7f8fc015cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:32964/0 (socket says 172.21.15.132:32964) 2023-05-10T04:20:12.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbeffd700 1 -- 172.21.15.132:0/1480525570 learned_addr learned my addr 172.21.15.132:0/1480525570 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:12.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/1480525570 >> v2:172.21.15.154:3300/0 conn(0x7f8fc00d0b50 0x7f8fc00d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408705340 0 0) 0x7f8fc015d480 con 0x7f8fc015a280 2023-05-10T04:20:12.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8fa80035b0 con 0x7f8fc015a280 2023-05-10T04:20:12.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 444377886 0 0) 0x7f8fa80035b0 con 0x7f8fc015a280 2023-05-10T04:20:12.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 >> v2:172.21.15.154:3300/0 conn(0x7f8fc00d0b50 msgr2=0x7f8fc00d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:12.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 --2- 172.21.15.132:0/1480525570 >> v2:172.21.15.154:3300/0 conn(0x7f8fc00d0b50 0x7f8fc00d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 >> v1:172.21.15.154:6789/0 conn(0x7f8fc00cd640 legacy=0x7f8fc00cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc015dca0 con 0x7f8fc015a280 2023-05-10T04:20:12.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f8fb0001670 con 0x7f8fc015a280 2023-05-10T04:20:12.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/1480525570 >> v2:172.21.15.154:3300/0 conn(0x7f8fc00d0b50 0x7f8fc00d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:12.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 >> v1:172.21.15.132:6789/0 conn(0x7f8fc015a280 legacy=0x7f8fc015cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa8003a50 0x7f8fa8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8004850 0x7f8fa8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fa8005200 0x7f8fa800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.041+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc015d9c0 con 0x7f8fa8005200 2023-05-10T04:20:12.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa800c0e0 con 0x7f8fa8003a50 2023-05-10T04:20:12.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa800c2a0 con 0x7f8fa8004850 2023-05-10T04:20:12.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fa8005200 0x7f8fa800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbeffd700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa8003a50 0x7f8fa8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbe7fc700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8004850 0x7f8fa8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbf7fe700 1 -- 172.21.15.132:0/1480525570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8004850 msgr2=0x7f8fa8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:12.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8004850 0x7f8fa8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbf7fe700 1 -- 172.21.15.132:0/1480525570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa8003a50 msgr2=0x7f8fa8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:12.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fa8003a50 0x7f8fa8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbf7fe700 1 -- 172.21.15.132:0/1480525570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa80035b0 con 0x7f8fa8005200 2023-05-10T04:20:12.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbf7fe700 1 -- 172.21.15.132:0/1480525570 reap_dead start 2023-05-10T04:20:12.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fa8005200 0x7f8fa800ba10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800e320 tx=0x7f8fa8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e01495714e7bcb2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb800edc0 con 0x7f8fa8005200 2023-05-10T04:20:12.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.042+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb800f040 con 0x7f8fa8005200 2023-05-10T04:20:12.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.043+0000 7f8fbdffb700 1 -- 172.21.15.132:0/1480525570 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb80146c0 con 0x7f8fa8005200 2023-05-10T04:20:12.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.043+0000 7f8fc55ff700 1 -- 172.21.15.132:0/1480525570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fa8005200 msgr2=0x7f8fa800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.043+0000 7f8fc55ff700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fa8005200 0x7f8fa800ba10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8fb800e320 tx=0x7f8fa8005880 comp rx=0 tx=0).stop 2023-05-10T04:20:12.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.043+0000 7f8fc55ff700 1 -- 172.21.15.132:0/1480525570 shutdown_connections 2023-05-10T04:20:12.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.043+0000 7f8fc55ff700 1 --2- 172.21.15.132:0/1480525570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fa8005200 0x7f8fa800ba10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.043+0000 7f8fc55ff700 1 -- 172.21.15.132:0/1480525570 >> 172.21.15.132:0/1480525570 conn(0x7f8fc0066260 msgr2=0x7f8fc0071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:12.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.043+0000 7f8fc55ff700 1 -- 172.21.15.132:0/1480525570 shutdown_connections 2023-05-10T04:20:12.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.043+0000 7f8fc55ff700 1 -- 172.21.15.132:0/1480525570 wait complete. 2023-05-10T04:20:12.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.045+0000 7f8fc55ff700 1 Processor -- start 2023-05-10T04:20:12.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.045+0000 7f8fc55ff700 1 -- start start 2023-05-10T04:20:12.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fc55ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8005200 0x7f8fc015c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fc55ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc01f2270 0x7f8fc014c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fc55ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fc00c8290 0x7f8fc00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fc55ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc015cdf0 con 0x7f8fc00c8290 2023-05-10T04:20:12.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fc55ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc01f2a50 con 0x7f8fc01f2270 2023-05-10T04:20:12.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fc55ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc01f2d30 con 0x7f8fa8005200 2023-05-10T04:20:12.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbf7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fc00c8290 0x7f8fc00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbf7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fc00c8290 0x7f8fc00b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50170/0 (socket says 172.21.15.132:50170) 2023-05-10T04:20:12.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbf7fe700 1 -- 172.21.15.132:0/56213985 learned_addr learned my addr 172.21.15.132:0/56213985 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:12.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbeffd700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8005200 0x7f8fc015c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbe7fc700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc01f2270 0x7f8fc014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbf7fe700 1 -- 172.21.15.132:0/56213985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8005200 msgr2=0x7f8fc015c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8005200 0x7f8fc015c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbf7fe700 1 -- 172.21.15.132:0/56213985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc01f2270 msgr2=0x7f8fc014c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.046+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc01f2270 0x7f8fc014c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.047+0000 7f8fbf7fe700 1 -- 172.21.15.132:0/56213985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc00cf650 con 0x7f8fc00c8290 2023-05-10T04:20:12.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.047+0000 7f8fbf7fe700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fc00c8290 0x7f8fc00b3aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8017040 tx=0x7f8fb8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.047+0000 7f8fa77fe700 1 -- 172.21.15.132:0/56213985 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8007000 con 0x7f8fc00c8290 2023-05-10T04:20:12.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.047+0000 7f8fa77fe700 1 -- 172.21.15.132:0/56213985 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb8004450 con 0x7f8fc00c8290 2023-05-10T04:20:12.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.047+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc00cf370 con 0x7f8fc00c8290 2023-05-10T04:20:12.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.047+0000 7f8fa77fe700 1 -- 172.21.15.132:0/56213985 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb8004800 con 0x7f8fc00c8290 2023-05-10T04:20:12.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.047+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc015a650 con 0x7f8fc00c8290 2023-05-10T04:20:12.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.048+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc01f3220 con 0x7f8fc00c8290 2023-05-10T04:20:12.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.049+0000 7f8fa77fe700 1 -- 172.21.15.132:0/56213985 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8fb8024070 con 0x7f8fc00c8290 2023-05-10T04:20:12.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.050+0000 7f8fa77fe700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8fac06ace0 0x7f8fac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.050+0000 7f8fa77fe700 1 -- 172.21.15.132:0/56213985 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8fb808adb0 con 0x7f8fc00c8290 2023-05-10T04:20:12.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.050+0000 7f8fbeffd700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8fac06ace0 0x7f8fac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.051+0000 7f8fbeffd700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8fac06ace0 0x7f8fac06d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0001050 tx=0x7f8fb0007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.055+0000 7f8fa77fe700 1 -- 172.21.15.132:0/56213985 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8fb808f070 con 0x7f8fc00c8290 2023-05-10T04:20:12.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.251+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8fc0159a80 con 0x7f8fc00c8290 2023-05-10T04:20:12.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.251+0000 7f8fa77fe700 1 -- 172.21.15.132:0/56213985 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8fb8055ae0 con 0x7f8fc00c8290 2023-05-10T04:20:12.254 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:12.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8fac06ace0 msgr2=0x7f8fac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8fac06ace0 0x7f8fac06d190 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0001050 tx=0x7f8fb0007040 comp rx=0 tx=0).stop 2023-05-10T04:20:12.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fc00c8290 msgr2=0x7f8fc00b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fc00c8290 0x7f8fc00b3aa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8017040 tx=0x7f8fb8009750 comp rx=0 tx=0).stop 2023-05-10T04:20:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 shutdown_connections 2023-05-10T04:20:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f8fac06ace0 0x7f8fac06d190 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8fc00c8290 0x7f8fc00b3aa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f8fa8005200 0x7f8fc015c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 --2- 172.21.15.132:0/56213985 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f8fc01f2270 0x7f8fc014c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 >> 172.21.15.132:0/56213985 conn(0x7f8fc0066260 msgr2=0x7f8fc00d17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:12.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 shutdown_connections 2023-05-10T04:20:12.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.254+0000 7f8fc55ff700 1 -- 172.21.15.132:0/56213985 wait complete. 2023-05-10T04:20:12.274 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.460+0000 7fa3cc7ff700 1 Processor -- start 2023-05-10T04:20:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.460+0000 7fa3cc7ff700 1 -- start start 2023-05-10T04:20:12.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3cc7ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3c40cf010 0x7fa3c4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3cc7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c40cff50 0x7fa3c40d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3cc7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c40cd520 con 0x7fa3c415c590 2023-05-10T04:20:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3cc7ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c40d2640 con 0x7fa3c40cf010 2023-05-10T04:20:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3cc7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41610d0 con 0x7fa3c40cff50 2023-05-10T04:20:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3c9d9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3c40cf010 0x7fa3c4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3c9d9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3c40cf010 0x7fa3c4160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50184/0 (socket says 172.21.15.132:50184) 2023-05-10T04:20:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3c9d9a700 1 -- 172.21.15.132:0/4083844279 learned_addr learned my addr 172.21.15.132:0/4083844279 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.461+0000 7fa3cad9c700 1 --2- 172.21.15.132:0/4083844279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c40cff50 0x7fa3c40d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.462+0000 7fa3c9d9a700 1 -- 172.21.15.132:0/4083844279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c40cff50 msgr2=0x7fa3c40d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.462+0000 7fa3c9d9a700 1 --2- 172.21.15.132:0/4083844279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c40cff50 0x7fa3c40d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.462+0000 7fa3c9d9a700 1 -- 172.21.15.132:0/4083844279 >> v1:172.21.15.154:6789/0 conn(0x7fa3c415c590 legacy=0x7fa3c40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.462+0000 7fa3c9d9a700 1 -- 172.21.15.132:0/4083844279 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c40b23c0 con 0x7fa3c40cf010 2023-05-10T04:20:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.462+0000 7fa3c9d9a700 1 --2- 172.21.15.132:0/4083844279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cf010 0x7fa3c4160b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40098f0 tx=0x7fa3b4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2de820a48dce4f70 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.462+0000 7fa3c9599700 1 -- 172.21.15.132:0/4083844279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011830 con 0x7fa3c40cf010 2023-05-10T04:20:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.462+0000 7fa3c9599700 1 -- 172.21.15.132:0/4083844279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4011990 con 0x7fa3c40cf010 2023-05-10T04:20:12.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.462+0000 7fa3c9599700 1 -- 172.21.15.132:0/4083844279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4011d20 con 0x7fa3c40cf010 2023-05-10T04:20:12.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.463+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/4083844279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cf010 msgr2=0x7fa3c4160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.463+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/4083844279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cf010 0x7fa3c4160b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40098f0 tx=0x7fa3b4009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:12.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.463+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/4083844279 shutdown_connections 2023-05-10T04:20:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.463+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/4083844279 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c40cff50 0x7fa3c40d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.463+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/4083844279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cf010 0x7fa3c4160b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.463+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/4083844279 >> 172.21.15.132:0/4083844279 conn(0x7fa3c4071b10 msgr2=0x7fa3c4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.463+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/4083844279 shutdown_connections 2023-05-10T04:20:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.463+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/4083844279 wait complete. 2023-05-10T04:20:12.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.464+0000 7fa3cc7ff700 1 Processor -- start 2023-05-10T04:20:12.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.465+0000 7fa3cc7ff700 1 -- start start 2023-05-10T04:20:12.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.465+0000 7fa3cc7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c40cf010 0x7fa3c40b8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.465+0000 7fa3cc7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cff50 0x7fa3c41e77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3cc7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c415c590 0x7fa3c415b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3cc7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40b61d0 con 0x7fa3c40cff50 2023-05-10T04:20:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3cc7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c415d220 con 0x7fa3c40cf010 2023-05-10T04:20:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3cc7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40b8660 con 0x7fa3c415c590 2023-05-10T04:20:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cff50 0x7fa3c41e77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cff50 0x7fa3c41e77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50188/0 (socket says 172.21.15.132:50188) 2023-05-10T04:20:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 -- 172.21.15.132:0/3897578408 learned_addr learned my addr 172.21.15.132:0/3897578408 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3ca59b700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c40cf010 0x7fa3c40b8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3cad9c700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c415c590 0x7fa3c415b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 -- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c415c590 msgr2=0x7fa3c415b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c415c590 0x7fa3c415b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 -- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c40cf010 msgr2=0x7fa3c40b8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c40cf010 0x7fa3c40b8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 -- 172.21.15.132:0/3897578408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4009550 con 0x7fa3c40cff50 2023-05-10T04:20:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3ca59b700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c40cf010 0x7fa3c40b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.466+0000 7fa3c9d9a700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cff50 0x7fa3c41e77f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4000c00 tx=0x7fa3b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.467+0000 7fa3baffd700 1 -- 172.21.15.132:0/3897578408 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4004570 con 0x7fa3c40cff50 2023-05-10T04:20:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.467+0000 7fa3baffd700 1 -- 172.21.15.132:0/3897578408 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b401f070 con 0x7fa3c40cff50 2023-05-10T04:20:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.467+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c40cd770 con 0x7fa3c40cff50 2023-05-10T04:20:12.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.467+0000 7fa3baffd700 1 -- 172.21.15.132:0/3897578408 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b40038c0 con 0x7fa3c40cff50 2023-05-10T04:20:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.467+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c40cf560 con 0x7fa3c40cff50 2023-05-10T04:20:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.468+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c415c960 con 0x7fa3c40cff50 2023-05-10T04:20:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.469+0000 7fa3baffd700 1 -- 172.21.15.132:0/3897578408 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3b4021030 con 0x7fa3c40cff50 2023-05-10T04:20:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.470+0000 7fa3baffd700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa3a806ace0 0x7fa3a806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.470+0000 7fa3baffd700 1 -- 172.21.15.132:0/3897578408 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa3b408aea0 con 0x7fa3c40cff50 2023-05-10T04:20:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.470+0000 7fa3ca59b700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa3a806ace0 0x7fa3a806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.470+0000 7fa3ca59b700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa3a806ace0 0x7fa3a806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0000f60 tx=0x7fa3c0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.474+0000 7fa3baffd700 1 -- 172.21.15.132:0/3897578408 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa3b4055d70 con 0x7fa3c40cff50 2023-05-10T04:20:12.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.671+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa3c40b6310 con 0x7fa3c40cff50 2023-05-10T04:20:12.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.672+0000 7fa3baffd700 1 -- 172.21.15.132:0/3897578408 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa3c40b6310 con 0x7fa3c40cff50 2023-05-10T04:20:12.675 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:12.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa3a806ace0 msgr2=0x7fa3a806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa3a806ace0 0x7fa3a806d190 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0000f60 tx=0x7fa3c0009040 comp rx=0 tx=0).stop 2023-05-10T04:20:12.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cff50 msgr2=0x7fa3c41e77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cff50 0x7fa3c41e77f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4000c00 tx=0x7fa3b4004750 comp rx=0 tx=0).stop 2023-05-10T04:20:12.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 shutdown_connections 2023-05-10T04:20:12.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa3a806ace0 0x7fa3a806d190 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa3c415c590 0x7fa3c415b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa3c40cf010 0x7fa3c40b8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 --2- 172.21.15.132:0/3897578408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3c40cff50 0x7fa3c41e77f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 >> 172.21.15.132:0/3897578408 conn(0x7fa3c4071b10 msgr2=0x7fa3c40b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:12.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 shutdown_connections 2023-05-10T04:20:12.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.674+0000 7fa3cc7ff700 1 -- 172.21.15.132:0/3897578408 wait complete. 2023-05-10T04:20:12.694 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:12.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.878+0000 7fc7765ff700 1 Processor -- start 2023-05-10T04:20:12.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.879+0000 7fc7765ff700 1 -- start start 2023-05-10T04:20:12.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc7765ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc77015a140 0x7fc7700cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc7765ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fc770160ba0 0x7fc7700cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc7765ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77015d660 con 0x7fc7700cfe20 2023-05-10T04:20:12.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc7765ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7700d02a0 con 0x7fc77015a140 2023-05-10T04:20:12.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc7765ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77015cd70 con 0x7fc770160ba0 2023-05-10T04:20:12.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc76ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc77015a140 0x7fc7700cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc76ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc77015a140 0x7fc7700cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45720/0 (socket says 172.21.15.132:45720) 2023-05-10T04:20:12.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc76ffff700 1 -- 172.21.15.132:0/1668732677 learned_addr learned my addr 172.21.15.132:0/1668732677 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:12.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc767fff700 1 --2- 172.21.15.132:0/1668732677 >> v2:172.21.15.154:3300/0 conn(0x7fc770160ba0 0x7fc7700cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc76ffff700 1 -- 172.21.15.132:0/1668732677 >> v2:172.21.15.154:3300/0 conn(0x7fc770160ba0 msgr2=0x7fc7700cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:12.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc76ffff700 1 --2- 172.21.15.132:0/1668732677 >> v2:172.21.15.154:3300/0 conn(0x7fc770160ba0 0x7fc7700cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc76ffff700 1 -- 172.21.15.132:0/1668732677 >> v1:172.21.15.154:6789/0 conn(0x7fc7700cfe20 legacy=0x7fc7700b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.880+0000 7fc76ffff700 1 -- 172.21.15.132:0/1668732677 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77015d010 con 0x7fc77015a140 2023-05-10T04:20:12.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.881+0000 7fc76ffff700 1 --2- 172.21.15.132:0/1668732677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc77015a140 0x7fc7700cd520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc7700d07b0 tx=0x7fc760009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737f487384e0d14 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.881+0000 7fc76f7fe700 1 -- 172.21.15.132:0/1668732677 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760011830 con 0x7fc77015a140 2023-05-10T04:20:12.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.881+0000 7fc76f7fe700 1 -- 172.21.15.132:0/1668732677 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc760011990 con 0x7fc77015a140 2023-05-10T04:20:12.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.881+0000 7fc76f7fe700 1 -- 172.21.15.132:0/1668732677 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760011d20 con 0x7fc77015a140 2023-05-10T04:20:12.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.881+0000 7fc7765ff700 1 -- 172.21.15.132:0/1668732677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc77015a140 msgr2=0x7fc7700cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.881+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1668732677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc77015a140 0x7fc7700cd520 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc7700d07b0 tx=0x7fc760009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.882+0000 7fc7765ff700 1 -- 172.21.15.132:0/1668732677 shutdown_connections 2023-05-10T04:20:12.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.882+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1668732677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc77015a140 0x7fc7700cd520 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.882+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1668732677 >> v2:172.21.15.154:3300/0 conn(0x7fc770160ba0 0x7fc7700cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.882+0000 7fc7765ff700 1 -- 172.21.15.132:0/1668732677 >> 172.21.15.132:0/1668732677 conn(0x7fc770071b10 msgr2=0x7fc770071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:12.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.882+0000 7fc7765ff700 1 -- 172.21.15.132:0/1668732677 shutdown_connections 2023-05-10T04:20:12.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.882+0000 7fc7765ff700 1 -- 172.21.15.132:0/1668732677 wait complete. 2023-05-10T04:20:12.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.883+0000 7fc7765ff700 1 Processor -- start 2023-05-10T04:20:12.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.884+0000 7fc7765ff700 1 -- start start 2023-05-10T04:20:12.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.884+0000 7fc7765ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7700cfe20 0x7fc7700b7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc7765ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc77015a140 0x7fc7700d2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc7765ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc770160ba0 0x7fc7700d3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc7765ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700b7840 con 0x7fc7700cfe20 2023-05-10T04:20:12.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc7765ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700b8690 con 0x7fc770160ba0 2023-05-10T04:20:12.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc7765ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7700b8b20 con 0x7fc77015a140 2023-05-10T04:20:12.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7700cfe20 0x7fc7700b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7700cfe20 0x7fc7700b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45728/0 (socket says 172.21.15.132:45728) 2023-05-10T04:20:12.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 -- 172.21.15.132:0/1707570233 learned_addr learned my addr 172.21.15.132:0/1707570233 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:12.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc774b9c700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc770160ba0 0x7fc7700d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 -- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc77015a140 msgr2=0x7fc7700d2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc767fff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc77015a140 0x7fc7700d2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc77015a140 0x7fc7700d2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 -- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc770160ba0 msgr2=0x7fc7700d3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:12.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc770160ba0 0x7fc7700d3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:12.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 -- 172.21.15.132:0/1707570233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc760009550 con 0x7fc7700cfe20 2023-05-10T04:20:12.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc774b9c700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc770160ba0 0x7fc7700d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:12.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc767fff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc77015a140 0x7fc7700d2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:12.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.885+0000 7fc76ffff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7700cfe20 0x7fc7700b7300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc760000c00 tx=0x7fc760004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.886+0000 7fc76d7fa700 1 -- 172.21.15.132:0/1707570233 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc760004480 con 0x7fc7700cfe20 2023-05-10T04:20:12.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.886+0000 7fc76d7fa700 1 -- 172.21.15.132:0/1707570233 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76001f070 con 0x7fc7700cfe20 2023-05-10T04:20:12.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.886+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77015daf0 con 0x7fc7700cfe20 2023-05-10T04:20:12.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.886+0000 7fc76d7fa700 1 -- 172.21.15.132:0/1707570233 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600038c0 con 0x7fc7700cfe20 2023-05-10T04:20:12.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.886+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77015d2f0 con 0x7fc7700cfe20 2023-05-10T04:20:12.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.887+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7700cdb00 con 0x7fc7700cfe20 2023-05-10T04:20:12.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.888+0000 7fc76d7fa700 1 -- 172.21.15.132:0/1707570233 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc760021030 con 0x7fc7700cfe20 2023-05-10T04:20:12.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.888+0000 7fc76d7fa700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc75006ace0 0x7fc75006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:12.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.889+0000 7fc76d7fa700 1 -- 172.21.15.132:0/1707570233 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc76008adb0 con 0x7fc7700cfe20 2023-05-10T04:20:12.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.889+0000 7fc767fff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc75006ace0 0x7fc75006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:12.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.890+0000 7fc767fff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc75006ace0 0x7fc75006d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7701e86b0 tx=0x7fc758008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:12.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:12.893+0000 7fc76d7fa700 1 -- 172.21.15.132:0/1707570233 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc760055d20 con 0x7fc7700cfe20 2023-05-10T04:20:13.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.089+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc7700b8970 con 0x7fc7700cfe20 2023-05-10T04:20:13.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.089+0000 7fc76d7fa700 1 -- 172.21.15.132:0/1707570233 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc760059340 con 0x7fc7700cfe20 2023-05-10T04:20:13.092 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:13.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc75006ace0 msgr2=0x7fc75006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc75006ace0 0x7fc75006d190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc7701e86b0 tx=0x7fc758008040 comp rx=0 tx=0).stop 2023-05-10T04:20:13.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7700cfe20 msgr2=0x7fc7700b7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7700cfe20 0x7fc7700b7300 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc760000c00 tx=0x7fc760004750 comp rx=0 tx=0).stop 2023-05-10T04:20:13.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 shutdown_connections 2023-05-10T04:20:13.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc75006ace0 0x7fc75006d190 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc770160ba0 0x7fc7700d3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7700cfe20 0x7fc7700b7300 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 --2- 172.21.15.132:0/1707570233 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc77015a140 0x7fc7700d2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 >> 172.21.15.132:0/1707570233 conn(0x7fc770071b10 msgr2=0x7fc77015a510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:13.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 shutdown_connections 2023-05-10T04:20:13.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.092+0000 7fc7765ff700 1 -- 172.21.15.132:0/1707570233 wait complete. 2023-05-10T04:20:13.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:13.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.295+0000 7fa751bff700 1 Processor -- start 2023-05-10T04:20:13.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.295+0000 7fa751bff700 1 -- start start 2023-05-10T04:20:13.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.296+0000 7fa751bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0d2110 0x7fa74c167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa751bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c161000 con 0x7fa74c0b87a0 2023-05-10T04:20:13.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa751bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74c0d0020 con 0x7fa74c0cfbf0 2023-05-10T04:20:13.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa751bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0d02d0 con 0x7fa74c0d2110 2023-05-10T04:20:13.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74b7fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa74c0b87a0 0x7fa74c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33838/0 (socket says 172.21.15.132:33838) 2023-05-10T04:20:13.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74b7fe700 1 -- 172.21.15.132:0/3099974689 learned_addr learned my addr 172.21.15.132:0/3099974689 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:13.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74bfff700 1 --2- 172.21.15.132:0/3099974689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0d2110 0x7fa74c167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74a7fc700 1 -- 172.21.15.132:0/3099974689 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2358746996 0 0) 0x7fa74c161000 con 0x7fa74c0b87a0 2023-05-10T04:20:13.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74a7fc700 1 -- 172.21.15.132:0/3099974689 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7340035b0 con 0x7fa74c0b87a0 2023-05-10T04:20:13.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74a7fc700 1 -- 172.21.15.132:0/3099974689 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369415610 0 0) 0x7fa74c0d0020 con 0x7fa74c0cfbf0 2023-05-10T04:20:13.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74a7fc700 1 -- 172.21.15.132:0/3099974689 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa74c161000 con 0x7fa74c0cfbf0 2023-05-10T04:20:13.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74bfff700 1 -- 172.21.15.132:0/3099974689 >> v1:172.21.15.154:6789/0 conn(0x7fa74c0cfbf0 legacy=0x7fa74c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74bfff700 1 -- 172.21.15.132:0/3099974689 >> v1:172.21.15.132:6789/0 conn(0x7fa74c0b87a0 legacy=0x7fa74c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.297+0000 7fa74bfff700 1 -- 172.21.15.132:0/3099974689 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c0cdc60 con 0x7fa74c0d2110 2023-05-10T04:20:13.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.298+0000 7fa74bfff700 1 --2- 172.21.15.132:0/3099974689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0d2110 0x7fa74c167550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa744009dc0 tx=0x7fa74400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b31ada7683908ea9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:13.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.298+0000 7fa74a7fc700 1 -- 172.21.15.132:0/3099974689 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400e070 con 0x7fa74c0d2110 2023-05-10T04:20:13.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.298+0000 7fa74a7fc700 1 -- 172.21.15.132:0/3099974689 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400bb20 con 0x7fa74c0d2110 2023-05-10T04:20:13.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.298+0000 7fa74a7fc700 1 -- 172.21.15.132:0/3099974689 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa744012430 con 0x7fa74c0d2110 2023-05-10T04:20:13.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.299+0000 7fa751bff700 1 -- 172.21.15.132:0/3099974689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0d2110 msgr2=0x7fa74c167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.299+0000 7fa751bff700 1 --2- 172.21.15.132:0/3099974689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0d2110 0x7fa74c167550 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa744009dc0 tx=0x7fa74400b330 comp rx=0 tx=0).stop 2023-05-10T04:20:13.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.299+0000 7fa751bff700 1 -- 172.21.15.132:0/3099974689 shutdown_connections 2023-05-10T04:20:13.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.299+0000 7fa751bff700 1 --2- 172.21.15.132:0/3099974689 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0d2110 0x7fa74c167550 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.299+0000 7fa751bff700 1 -- 172.21.15.132:0/3099974689 >> 172.21.15.132:0/3099974689 conn(0x7fa74c071b10 msgr2=0x7fa74c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:13.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.299+0000 7fa751bff700 1 -- 172.21.15.132:0/3099974689 shutdown_connections 2023-05-10T04:20:13.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.299+0000 7fa751bff700 1 -- 172.21.15.132:0/3099974689 wait complete. 2023-05-10T04:20:13.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.300+0000 7fa751bff700 1 Processor -- start 2023-05-10T04:20:13.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.300+0000 7fa751bff700 1 -- start start 2023-05-10T04:20:13.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.301+0000 7fa751bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0b87a0 0x7fa74c14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.301+0000 7fa751bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cfbf0 0x7fa74c0c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.301+0000 7fa751bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c0d2110 0x7fa74c14d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.301+0000 7fa751bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c155610 con 0x7fa74c0d2110 2023-05-10T04:20:13.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.301+0000 7fa751bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c154e00 con 0x7fa74c0b87a0 2023-05-10T04:20:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.301+0000 7fa751bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c155960 con 0x7fa74c0cfbf0 2023-05-10T04:20:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c0d2110 0x7fa74c14d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c0d2110 0x7fa74c14d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45736/0 (socket says 172.21.15.132:45736) 2023-05-10T04:20:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 -- 172.21.15.132:0/787341354 learned_addr learned my addr 172.21.15.132:0/787341354 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74affd700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cfbf0 0x7fa74c0c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74b7fe700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0b87a0 0x7fa74c14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 -- 172.21.15.132:0/787341354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cfbf0 msgr2=0x7fa74c0c90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cfbf0 0x7fa74c0c90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 -- 172.21.15.132:0/787341354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0b87a0 msgr2=0x7fa74c14d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0b87a0 0x7fa74c14d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 -- 172.21.15.132:0/787341354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa744009a70 con 0x7fa74c0d2110 2023-05-10T04:20:13.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa74bfff700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c0d2110 0x7fa74c14d0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa74400b370 tx=0x7fa744004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:13.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.302+0000 7fa733fff700 1 -- 172.21.15.132:0/787341354 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74401b810 con 0x7fa74c0d2110 2023-05-10T04:20:13.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.303+0000 7fa733fff700 1 -- 172.21.15.132:0/787341354 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa744020070 con 0x7fa74c0d2110 2023-05-10T04:20:13.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.303+0000 7fa733fff700 1 -- 172.21.15.132:0/787341354 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74401bbf0 con 0x7fa74c0d2110 2023-05-10T04:20:13.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.303+0000 7fa751bff700 1 -- 172.21.15.132:0/787341354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa74c0cd980 con 0x7fa74c0d2110 2023-05-10T04:20:13.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.303+0000 7fa751bff700 1 -- 172.21.15.132:0/787341354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa74c0cd6a0 con 0x7fa74c0d2110 2023-05-10T04:20:13.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.304+0000 7fa7327fc700 1 -- 172.21.15.132:0/787341354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7240052f0 con 0x7fa74c0d2110 2023-05-10T04:20:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.304+0000 7fa733fff700 1 -- 172.21.15.132:0/787341354 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa74401bd50 con 0x7fa74c0d2110 2023-05-10T04:20:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.305+0000 7fa733fff700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa73806ace0 0x7fa73806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.305+0000 7fa733fff700 1 -- 172.21.15.132:0/787341354 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa744022070 con 0x7fa74c0d2110 2023-05-10T04:20:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.306+0000 7fa74b7fe700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa73806ace0 0x7fa73806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.306+0000 7fa74b7fe700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa73806ace0 0x7fa73806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa73c000f60 tx=0x7fa73c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:13.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.310+0000 7fa733fff700 1 -- 172.21.15.132:0/787341354 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa744056950 con 0x7fa74c0d2110 2023-05-10T04:20:13.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.509+0000 7fa7327fc700 1 -- 172.21.15.132:0/787341354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa724005b20 con 0x7fa74c0d2110 2023-05-10T04:20:13.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.510+0000 7fa733fff700 1 -- 172.21.15.132:0/787341354 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa74402c0a0 con 0x7fa74c0d2110 2023-05-10T04:20:13.513 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 -- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa73806ace0 msgr2=0x7fa73806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa73806ace0 0x7fa73806d190 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa73c000f60 tx=0x7fa73c009040 comp rx=0 tx=0).stop 2023-05-10T04:20:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 -- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c0d2110 msgr2=0x7fa74c14d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c0d2110 0x7fa74c14d0c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa74400b370 tx=0x7fa744004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 -- 172.21.15.132:0/787341354 shutdown_connections 2023-05-10T04:20:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa73806ace0 0x7fa73806d190 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c0d2110 0x7fa74c14d0c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa74c0b87a0 0x7fa74c14d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 --2- 172.21.15.132:0/787341354 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa74c0cfbf0 0x7fa74c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 -- 172.21.15.132:0/787341354 >> 172.21.15.132:0/787341354 conn(0x7fa74c071b10 msgr2=0x7fa74c1582a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.512+0000 7fa7327fc700 1 -- 172.21.15.132:0/787341354 shutdown_connections 2023-05-10T04:20:13.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.513+0000 7fa7327fc700 1 -- 172.21.15.132:0/787341354 wait complete. 2023-05-10T04:20:13.533 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:13.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.719+0000 7f083ffff700 1 Processor -- start 2023-05-10T04:20:13.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.719+0000 7f083ffff700 1 -- start start 2023-05-10T04:20:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.720+0000 7f083ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f083815a5a0 0x7f083806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.720+0000 7f083ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f083806a920 0x7f0838070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.720+0000 7f083ffff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0838071030 0x7f083815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.720+0000 7f083ffff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083815a970 con 0x7f083815a5a0 2023-05-10T04:20:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.720+0000 7f083ffff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083806ad90 con 0x7f0838071030 2023-05-10T04:20:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.720+0000 7f083ffff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08380cb280 con 0x7f083806a920 2023-05-10T04:20:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f083815a5a0 0x7f083806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f083815a5a0 0x7f083806a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45740/0 (socket says 172.21.15.132:45740) 2023-05-10T04:20:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 -- 172.21.15.132:0/3836143065 learned_addr learned my addr 172.21.15.132:0/3836143065 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083d59a700 1 --2- 172.21.15.132:0/3836143065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f083806a920 0x7f0838070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083e59c700 1 --2- 172.21.15.132:0/3836143065 >> v2:172.21.15.154:3300/0 conn(0x7f0838071030 0x7f083815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 -- 172.21.15.132:0/3836143065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f083806a920 msgr2=0x7f0838070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 --2- 172.21.15.132:0/3836143065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f083806a920 0x7f0838070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 -- 172.21.15.132:0/3836143065 >> v2:172.21.15.154:3300/0 conn(0x7f0838071030 msgr2=0x7f083815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 --2- 172.21.15.132:0/3836143065 >> v2:172.21.15.154:3300/0 conn(0x7f0838071030 0x7f083815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 -- 172.21.15.132:0/3836143065 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08380714b0 con 0x7f083815a5a0 2023-05-10T04:20:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083dd9b700 1 --2- 172.21.15.132:0/3836143065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f083806a3e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f08380cbc90 tx=0x7f0834009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2b2248cb05b1e3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.721+0000 7f083cd99700 1 -- 172.21.15.132:0/3836143065 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400b860 con 0x7f083815a5a0 2023-05-10T04:20:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083cd99700 1 -- 172.21.15.132:0/3836143065 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f083400b9c0 con 0x7f083815a5a0 2023-05-10T04:20:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083cd99700 1 -- 172.21.15.132:0/3836143065 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083400bd50 con 0x7f083815a5a0 2023-05-10T04:20:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 -- 172.21.15.132:0/3836143065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 msgr2=0x7f083806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 --2- 172.21.15.132:0/3836143065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f083806a3e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f08380cbc90 tx=0x7f0834009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 -- 172.21.15.132:0/3836143065 shutdown_connections 2023-05-10T04:20:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 --2- 172.21.15.132:0/3836143065 >> v2:172.21.15.154:3300/0 conn(0x7f0838071030 0x7f083815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 --2- 172.21.15.132:0/3836143065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f083806a3e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 --2- 172.21.15.132:0/3836143065 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f083806a920 0x7f0838070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 -- 172.21.15.132:0/3836143065 >> 172.21.15.132:0/3836143065 conn(0x7f08380cf720 msgr2=0x7f08380cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 -- 172.21.15.132:0/3836143065 shutdown_connections 2023-05-10T04:20:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.722+0000 7f083ffff700 1 -- 172.21.15.132:0/3836143065 wait complete. 2023-05-10T04:20:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.724+0000 7f083ffff700 1 Processor -- start 2023-05-10T04:20:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.724+0000 7f083ffff700 1 -- start start 2023-05-10T04:20:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083ffff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f083806a920 0x7f0838148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0838071030 0x7f0838157e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083ffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f08381583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083ffff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08380c6dc0 con 0x7f083815a5a0 2023-05-10T04:20:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083ffff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08380c70a0 con 0x7f083806a920 2023-05-10T04:20:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083ffff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08380c7380 con 0x7f0838071030 2023-05-10T04:20:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f08381583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f08381583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45744/0 (socket says 172.21.15.132:45744) 2023-05-10T04:20:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083e59c700 1 -- 172.21.15.132:0/3276806950 learned_addr learned my addr 172.21.15.132:0/3276806950 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083dd9b700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f083806a920 0x7f0838148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083d59a700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0838071030 0x7f0838157e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083e59c700 1 -- 172.21.15.132:0/3276806950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0838071030 msgr2=0x7f0838157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083e59c700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0838071030 0x7f0838157e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083e59c700 1 -- 172.21.15.132:0/3276806950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f083806a920 msgr2=0x7f0838148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083e59c700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f083806a920 0x7f0838148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.725+0000 7f083e59c700 1 -- 172.21.15.132:0/3276806950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0834009550 con 0x7f083815a5a0 2023-05-10T04:20:13.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.726+0000 7f083e59c700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f08381583a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0830007e40 tx=0x7f083000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:13.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.726+0000 7f082e7fc700 1 -- 172.21.15.132:0/3276806950 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f083000ed80 con 0x7f083815a5a0 2023-05-10T04:20:13.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.726+0000 7f082e7fc700 1 -- 172.21.15.132:0/3276806950 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0830014420 con 0x7f083815a5a0 2023-05-10T04:20:13.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.726+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08380719e0 con 0x7f083815a5a0 2023-05-10T04:20:13.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.726+0000 7f082e7fc700 1 -- 172.21.15.132:0/3276806950 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08300147d0 con 0x7f083815a5a0 2023-05-10T04:20:13.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.726+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0838071700 con 0x7f083815a5a0 2023-05-10T04:20:13.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.727+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f083806c6c0 con 0x7f083815a5a0 2023-05-10T04:20:13.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.728+0000 7f082e7fc700 1 -- 172.21.15.132:0/3276806950 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0830014930 con 0x7f083815a5a0 2023-05-10T04:20:13.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.729+0000 7f082e7fc700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f081c06ace0 0x7f081c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:13.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.729+0000 7f082e7fc700 1 -- 172.21.15.132:0/3276806950 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0830089dd0 con 0x7f083815a5a0 2023-05-10T04:20:13.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.729+0000 7f083dd9b700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f081c06ace0 0x7f081c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:13.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.730+0000 7f083dd9b700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f081c06ace0 0x7f081c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0834000c00 tx=0x7f0834008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:13.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.733+0000 7f082e7fc700 1 -- 172.21.15.132:0/3276806950 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0830054c20 con 0x7f083815a5a0 2023-05-10T04:20:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.926+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f08380c7870 con 0x7f083815a5a0 2023-05-10T04:20:13.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.927+0000 7f082e7fc700 1 -- 172.21.15.132:0/3276806950 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f083008b020 con 0x7f083815a5a0 2023-05-10T04:20:13.930 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:13.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f081c06ace0 msgr2=0x7f081c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f081c06ace0 0x7f081c06d190 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0834000c00 tx=0x7f0834008030 comp rx=0 tx=0).stop 2023-05-10T04:20:13.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 msgr2=0x7f08381583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f08381583a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0830007e40 tx=0x7f083000e3c0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 shutdown_connections 2023-05-10T04:20:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f081c06ace0 0x7f081c06d190 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f083815a5a0 0x7f08381583a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f083806a920 0x7f0838148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 --2- 172.21.15.132:0/3276806950 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0838071030 0x7f0838157e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:13.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 >> 172.21.15.132:0/3276806950 conn(0x7f08380cf720 msgr2=0x7f08380ae820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.929+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 shutdown_connections 2023-05-10T04:20:13.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:13.930+0000 7f083ffff700 1 -- 172.21.15.132:0/3276806950 wait complete. 2023-05-10T04:20:13.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:20:14.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.133+0000 7feaf83ff700 1 Processor -- start 2023-05-10T04:20:14.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.134+0000 7feaf83ff700 1 -- start start 2023-05-10T04:20:14.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf83ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feaf00cd520 0x7feaf00cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf83ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf015d660 con 0x7feaf00cfe20 2023-05-10T04:20:14.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf83ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf015cd70 con 0x7feaf015a140 2023-05-10T04:20:14.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf83ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf00d02a0 con 0x7feaf00cd520 2023-05-10T04:20:14.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf599a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feaf00cd520 0x7feaf00cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf599a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feaf00cd520 0x7feaf00cf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45746/0 (socket says 172.21.15.132:45746) 2023-05-10T04:20:14.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf599a700 1 -- 172.21.15.132:0/4094525299 learned_addr learned my addr 172.21.15.132:0/4094525299 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:14.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf699c700 1 --1- 172.21.15.132:0/4094525299 >> v1:172.21.15.132:6789/0 conn(0x7feaf00cfe20 0x7feaf00b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33852/0 (socket says 172.21.15.132:33852) 2023-05-10T04:20:14.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf599a700 1 -- 172.21.15.132:0/4094525299 >> v1:172.21.15.154:6789/0 conn(0x7feaf015a140 legacy=0x7feaf0160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.135+0000 7feaf599a700 1 -- 172.21.15.132:0/4094525299 >> v1:172.21.15.132:6789/0 conn(0x7feaf00cfe20 legacy=0x7feaf00b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.136+0000 7feaf599a700 1 -- 172.21.15.132:0/4094525299 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf015d010 con 0x7feaf00cd520 2023-05-10T04:20:14.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.136+0000 7feaf5199700 1 -- 172.21.15.132:0/4094525299 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943384760 0 0) 0x7feaf015d660 con 0x7feaf00cfe20 2023-05-10T04:20:14.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.136+0000 7feaf599a700 1 --2- 172.21.15.132:0/4094525299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cd520 0x7feaf00cf8e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feae00098f0 tx=0x7feae0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b65480d3f2720c0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:14.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.136+0000 7feaf5199700 1 -- 172.21.15.132:0/4094525299 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000b8a0 con 0x7feaf00cd520 2023-05-10T04:20:14.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.136+0000 7feaf5199700 1 -- 172.21.15.132:0/4094525299 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae000ba00 con 0x7feaf00cd520 2023-05-10T04:20:14.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.136+0000 7feaf5199700 1 -- 172.21.15.132:0/4094525299 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae000bd90 con 0x7feaf00cd520 2023-05-10T04:20:14.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.136+0000 7feaf83ff700 1 -- 172.21.15.132:0/4094525299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cd520 msgr2=0x7feaf00cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.137+0000 7feaf83ff700 1 --2- 172.21.15.132:0/4094525299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cd520 0x7feaf00cf8e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7feae00098f0 tx=0x7feae0009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:14.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.137+0000 7feaf83ff700 1 -- 172.21.15.132:0/4094525299 shutdown_connections 2023-05-10T04:20:14.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.137+0000 7feaf83ff700 1 --2- 172.21.15.132:0/4094525299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cd520 0x7feaf00cf8e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.137+0000 7feaf83ff700 1 -- 172.21.15.132:0/4094525299 >> 172.21.15.132:0/4094525299 conn(0x7feaf0071b10 msgr2=0x7feaf0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:14.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.137+0000 7feaf83ff700 1 -- 172.21.15.132:0/4094525299 shutdown_connections 2023-05-10T04:20:14.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.137+0000 7feaf83ff700 1 -- 172.21.15.132:0/4094525299 wait complete. 2023-05-10T04:20:14.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.139+0000 7feaf83ff700 1 Processor -- start 2023-05-10T04:20:14.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.139+0000 7feaf83ff700 1 -- start start 2023-05-10T04:20:14.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.140+0000 7feaf83ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf00cd520 0x7feaf014e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.140+0000 7feaf83ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cfe20 0x7feaf00c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.140+0000 7feaf83ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf015a140 0x7feaf00b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.140+0000 7feaf83ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00cd0f0 con 0x7feaf00cfe20 2023-05-10T04:20:14.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.140+0000 7feaf83ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf014e860 con 0x7feaf015a140 2023-05-10T04:20:14.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.140+0000 7feaf83ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf00cc4e0 con 0x7feaf00cd520 2023-05-10T04:20:14.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cfe20 0x7feaf00c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cfe20 0x7feaf00c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45748/0 (socket says 172.21.15.132:45748) 2023-05-10T04:20:14.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 -- 172.21.15.132:0/3263732323 learned_addr learned my addr 172.21.15.132:0/3263732323 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:14.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf619b700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf00cd520 0x7feaf014e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf699c700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf015a140 0x7feaf00b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 -- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf00cd520 msgr2=0x7feaf014e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf00cd520 0x7feaf014e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 -- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf015a140 msgr2=0x7feaf00b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf015a140 0x7feaf00b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 -- 172.21.15.132:0/3263732323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae0009550 con 0x7feaf00cfe20 2023-05-10T04:20:14.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf699c700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf015a140 0x7feaf00b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:14.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.141+0000 7feaf599a700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cfe20 0x7feaf00c7d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feaf0072710 tx=0x7feae0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:14.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.142+0000 7feae6ffd700 1 -- 172.21.15.132:0/3263732323 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0011970 con 0x7feaf00cfe20 2023-05-10T04:20:14.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.142+0000 7feae6ffd700 1 -- 172.21.15.132:0/3263732323 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae001f070 con 0x7feaf00cfe20 2023-05-10T04:20:14.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.142+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf015daf0 con 0x7feaf00cfe20 2023-05-10T04:20:14.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.142+0000 7feae6ffd700 1 -- 172.21.15.132:0/3263732323 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae0011cd0 con 0x7feaf00cfe20 2023-05-10T04:20:14.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.142+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf015d2f0 con 0x7feaf00cfe20 2023-05-10T04:20:14.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.143+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf00cdb00 con 0x7feaf00cfe20 2023-05-10T04:20:14.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.144+0000 7feae6ffd700 1 -- 172.21.15.132:0/3263732323 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feae0026480 con 0x7feaf00cfe20 2023-05-10T04:20:14.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.145+0000 7feae6ffd700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fead406ace0 0x7fead406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.145+0000 7feae6ffd700 1 -- 172.21.15.132:0/3263732323 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feae0021070 con 0x7feaf00cfe20 2023-05-10T04:20:14.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.145+0000 7feaf619b700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fead406ace0 0x7fead406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.145+0000 7feaf619b700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fead406ace0 0x7fead406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaec007fd0 tx=0x7feaec009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:14.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.149+0000 7feae6ffd700 1 -- 172.21.15.132:0/3263732323 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7feae0055ea0 con 0x7feaf00cfe20 2023-05-10T04:20:14.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.359+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feaf00b51f0 con 0x7feaf00cfe20 2023-05-10T04:20:14.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.360+0000 7feae6ffd700 1 -- 172.21.15.132:0/3263732323 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7feae00594c0 con 0x7feaf00cfe20 2023-05-10T04:20:14.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fead406ace0 msgr2=0x7fead406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fead406ace0 0x7fead406d190 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7feaec007fd0 tx=0x7feaec009040 comp rx=0 tx=0).stop 2023-05-10T04:20:14.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cfe20 msgr2=0x7feaf00c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cfe20 0x7feaf00c7d80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7feaf0072710 tx=0x7feae0004750 comp rx=0 tx=0).stop 2023-05-10T04:20:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 shutdown_connections 2023-05-10T04:20:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fead406ace0 0x7fead406d190 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feaf015a140 0x7feaf00b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feaf00cd520 0x7feaf014e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 --2- 172.21.15.132:0/3263732323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feaf00cfe20 0x7feaf00c7d80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 >> 172.21.15.132:0/3263732323 conn(0x7feaf0071b10 msgr2=0x7feaf015dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 shutdown_connections 2023-05-10T04:20:14.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.362+0000 7feaf83ff700 1 -- 172.21.15.132:0/3263732323 wait complete. 2023-05-10T04:20:14.367 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:20:14.382 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:20:14.383 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:14.422 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.643+0000 7f81effff700 1 Processor -- start 2023-05-10T04:20:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.643+0000 7f81effff700 1 -- start start 2023-05-10T04:20:14.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.644+0000 7f81effff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81e815c590 0x7f81e8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.644+0000 7f81effff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f81e80cff50 0x7f81e80d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.644+0000 7f81effff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e80cd520 con 0x7f81e80cf010 2023-05-10T04:20:14.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.644+0000 7f81effff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e80d2640 con 0x7f81e80cff50 2023-05-10T04:20:14.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.644+0000 7f81effff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e81610d0 con 0x7f81e815c590 2023-05-10T04:20:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.644+0000 7f81ed59a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f81e80cf010 0x7f81e80cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33860/0 (socket says 172.21.15.132:33860) 2023-05-10T04:20:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.644+0000 7f81ed59a700 1 -- 172.21.15.132:0/2647707381 learned_addr learned my addr 172.21.15.132:0/2647707381 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.644+0000 7f81ee59c700 1 --2- 172.21.15.132:0/2647707381 >> v2:172.21.15.132:3300/0 conn(0x7f81e80cff50 0x7f81e80d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81edd9b700 1 --2- 172.21.15.132:0/2647707381 >> v2:172.21.15.154:3300/0 conn(0x7f81e815c590 0x7f81e8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ecd99700 1 -- 172.21.15.132:0/2647707381 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230693096 0 0) 0x7f81e80cd520 con 0x7f81e80cf010 2023-05-10T04:20:14.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ecd99700 1 -- 172.21.15.132:0/2647707381 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81d40035b0 con 0x7f81e80cf010 2023-05-10T04:20:14.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ee59c700 1 -- 172.21.15.132:0/2647707381 >> v2:172.21.15.154:3300/0 conn(0x7f81e815c590 msgr2=0x7f81e8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:14.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ee59c700 1 --2- 172.21.15.132:0/2647707381 >> v2:172.21.15.154:3300/0 conn(0x7f81e815c590 0x7f81e8160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ee59c700 1 -- 172.21.15.132:0/2647707381 >> v1:172.21.15.132:6789/0 conn(0x7f81e80cf010 legacy=0x7f81e80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ee59c700 1 -- 172.21.15.132:0/2647707381 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e80b23c0 con 0x7f81e80cff50 2023-05-10T04:20:14.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81edd9b700 1 --2- 172.21.15.132:0/2647707381 >> v2:172.21.15.154:3300/0 conn(0x7f81e815c590 0x7f81e8160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:14.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ee59c700 1 --2- 172.21.15.132:0/2647707381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cff50 0x7f81e80d2ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f81e80d0a50 tx=0x7f81e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b17b3d2d5e1d19 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:14.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ecd99700 1 -- 172.21.15.132:0/2647707381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e000e070 con 0x7f81e80cff50 2023-05-10T04:20:14.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ecd99700 1 -- 172.21.15.132:0/2647707381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e000bb20 con 0x7f81e80cff50 2023-05-10T04:20:14.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.645+0000 7f81ecd99700 1 -- 172.21.15.132:0/2647707381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e0012430 con 0x7f81e80cff50 2023-05-10T04:20:14.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.646+0000 7f81effff700 1 -- 172.21.15.132:0/2647707381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cff50 msgr2=0x7f81e80d2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.646+0000 7f81effff700 1 --2- 172.21.15.132:0/2647707381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cff50 0x7f81e80d2ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f81e80d0a50 tx=0x7f81e000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:14.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.646+0000 7f81effff700 1 -- 172.21.15.132:0/2647707381 shutdown_connections 2023-05-10T04:20:14.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.646+0000 7f81effff700 1 --2- 172.21.15.132:0/2647707381 >> v2:172.21.15.154:3300/0 conn(0x7f81e815c590 0x7f81e8160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.646+0000 7f81effff700 1 --2- 172.21.15.132:0/2647707381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cff50 0x7f81e80d2ad0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.646+0000 7f81effff700 1 -- 172.21.15.132:0/2647707381 >> 172.21.15.132:0/2647707381 conn(0x7f81e8071b10 msgr2=0x7f81e8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:14.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.646+0000 7f81effff700 1 -- 172.21.15.132:0/2647707381 shutdown_connections 2023-05-10T04:20:14.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.646+0000 7f81effff700 1 -- 172.21.15.132:0/2647707381 wait complete. 2023-05-10T04:20:14.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.648+0000 7f81effff700 1 Processor -- start 2023-05-10T04:20:14.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.648+0000 7f81effff700 1 -- start start 2023-05-10T04:20:14.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81effff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cf010 0x7f81e815f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81effff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81e80cff50 0x7f81e80b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81effff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81e815c590 0x7f81e814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81effff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b73d0 con 0x7f81e80cf010 2023-05-10T04:20:14.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81effff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b67c0 con 0x7f81e80cff50 2023-05-10T04:20:14.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81effff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e80b6aa0 con 0x7f81e815c590 2023-05-10T04:20:14.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81edd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cf010 0x7f81e815f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81edd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cf010 0x7f81e815f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45752/0 (socket says 172.21.15.132:45752) 2023-05-10T04:20:14.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81edd9b700 1 -- 172.21.15.132:0/258123435 learned_addr learned my addr 172.21.15.132:0/258123435 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:14.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81edd9b700 1 -- 172.21.15.132:0/258123435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81e815c590 msgr2=0x7f81e814cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81edd9b700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81e815c590 0x7f81e814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81edd9b700 1 -- 172.21.15.132:0/258123435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81e80cff50 msgr2=0x7f81e80b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81edd9b700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81e80cff50 0x7f81e80b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.649+0000 7f81edd9b700 1 -- 172.21.15.132:0/258123435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e0009a70 con 0x7f81e80cf010 2023-05-10T04:20:14.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.650+0000 7f81edd9b700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cf010 0x7f81e815f270 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e810 tx=0x7f81e400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:14.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.650+0000 7f81de7fc700 1 -- 172.21.15.132:0/258123435 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4013610 con 0x7f81e80cf010 2023-05-10T04:20:14.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.650+0000 7f81de7fc700 1 -- 172.21.15.132:0/258123435 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81e4013770 con 0x7f81e80cf010 2023-05-10T04:20:14.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.650+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e80cd770 con 0x7f81e80cf010 2023-05-10T04:20:14.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.650+0000 7f81de7fc700 1 -- 172.21.15.132:0/258123435 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81e4013b20 con 0x7f81e80cf010 2023-05-10T04:20:14.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.650+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e80cf560 con 0x7f81e80cf010 2023-05-10T04:20:14.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.651+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e815c960 con 0x7f81e80cf010 2023-05-10T04:20:14.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.652+0000 7f81de7fc700 1 -- 172.21.15.132:0/258123435 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81e4013c80 con 0x7f81e80cf010 2023-05-10T04:20:14.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.653+0000 7f81de7fc700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81cc06ace0 0x7f81cc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:14.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.653+0000 7f81de7fc700 1 -- 172.21.15.132:0/258123435 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f81e4089560 con 0x7f81e80cf010 2023-05-10T04:20:14.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.653+0000 7f81ed59a700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81cc06ace0 0x7f81cc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:14.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.654+0000 7f81ed59a700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81cc06ace0 0x7f81cc06d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f81e8160ef0 tx=0x7f81d80079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:14.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.657+0000 7f81de7fc700 1 -- 172.21.15.132:0/258123435 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f81e4054280 con 0x7f81e80cf010 2023-05-10T04:20:14.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.856+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81e80d0830 con 0x7f81e80cf010 2023-05-10T04:20:14.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.858+0000 7f81de7fc700 1 -- 172.21.15.132:0/258123435 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f81e40578a0 con 0x7f81e80cf010 2023-05-10T04:20:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:14.861 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:14.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81cc06ace0 msgr2=0x7f81cc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81cc06ace0 0x7f81cc06d190 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f81e8160ef0 tx=0x7f81d80079c0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cf010 msgr2=0x7f81e815f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:14.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cf010 0x7f81e815f270 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f81e400e810 tx=0x7f81e400ebd0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 shutdown_connections 2023-05-10T04:20:14.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81cc06ace0 0x7f81cc06d190 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81e815c590 0x7f81e814cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81e80cf010 0x7f81e815f270 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 --2- 172.21.15.132:0/258123435 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81e80cff50 0x7f81e80b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:14.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 >> 172.21.15.132:0/258123435 conn(0x7f81e8071b10 msgr2=0x7f81e80d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:14.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 shutdown_connections 2023-05-10T04:20:14.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:14.860+0000 7f81effff700 1 -- 172.21.15.132:0/258123435 wait complete. 2023-05-10T04:20:14.881 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:14.882 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:15.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.066+0000 7f84317ff700 1 Processor -- start 2023-05-10T04:20:15.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.066+0000 7f84317ff700 1 -- start start 2023-05-10T04:20:15.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.067+0000 7f84317ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f842c06aaf0 0x7f842c070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f84317ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f842c071030 0x7f842c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f84317ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f842c0cb280 con 0x7f842c15a5a0 2023-05-10T04:20:15.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f84317ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c15a970 con 0x7f842c06aaf0 2023-05-10T04:20:15.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f84317ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f842c071700 con 0x7f842c071030 2023-05-10T04:20:15.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f8423fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f842c06aaf0 0x7f842c070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f842affd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f842c15a5a0 0x7f842c06a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33864/0 (socket says 172.21.15.132:33864) 2023-05-10T04:20:15.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f842affd700 1 -- 172.21.15.132:0/2098630675 learned_addr learned my addr 172.21.15.132:0/2098630675 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:15.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f842b7fe700 1 --2- 172.21.15.132:0/2098630675 >> v2:172.21.15.154:3300/0 conn(0x7f842c071030 0x7f842c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f8423fff700 1 -- 172.21.15.132:0/2098630675 >> v2:172.21.15.154:3300/0 conn(0x7f842c071030 msgr2=0x7f842c06d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:15.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f8423fff700 1 --2- 172.21.15.132:0/2098630675 >> v2:172.21.15.154:3300/0 conn(0x7f842c071030 0x7f842c06d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f8423fff700 1 -- 172.21.15.132:0/2098630675 >> v1:172.21.15.132:6789/0 conn(0x7f842c15a5a0 legacy=0x7f842c06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f8423fff700 1 -- 172.21.15.132:0/2098630675 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0719e0 con 0x7f842c06aaf0 2023-05-10T04:20:15.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f842b7fe700 1 --2- 172.21.15.132:0/2098630675 >> v2:172.21.15.154:3300/0 conn(0x7f842c071030 0x7f842c06d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:15.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.068+0000 7f842a7fc700 1 -- 172.21.15.132:0/2098630675 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 946672419 0 0) 0x7f841c001110 con 0x7f842c15a5a0 2023-05-10T04:20:15.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f8423fff700 1 --2- 172.21.15.132:0/2098630675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c06aaf0 0x7f842c070af0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f842c0cbc90 tx=0x7f8414009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c289a28cac549b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f842a7fc700 1 -- 172.21.15.132:0/2098630675 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414005e30 con 0x7f842c06aaf0 2023-05-10T04:20:15.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f842a7fc700 1 -- 172.21.15.132:0/2098630675 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8414006030 con 0x7f842c06aaf0 2023-05-10T04:20:15.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f842a7fc700 1 -- 172.21.15.132:0/2098630675 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84140063c0 con 0x7f842c06aaf0 2023-05-10T04:20:15.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f84317ff700 1 -- 172.21.15.132:0/2098630675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c06aaf0 msgr2=0x7f842c070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f84317ff700 1 --2- 172.21.15.132:0/2098630675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c06aaf0 0x7f842c070af0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f842c0cbc90 tx=0x7f8414009b00 comp rx=0 tx=0).stop 2023-05-10T04:20:15.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f84317ff700 1 -- 172.21.15.132:0/2098630675 shutdown_connections 2023-05-10T04:20:15.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f84317ff700 1 --2- 172.21.15.132:0/2098630675 >> v2:172.21.15.154:3300/0 conn(0x7f842c071030 0x7f842c06d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f84317ff700 1 --2- 172.21.15.132:0/2098630675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c06aaf0 0x7f842c070af0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f84317ff700 1 -- 172.21.15.132:0/2098630675 >> 172.21.15.132:0/2098630675 conn(0x7f842c0cf720 msgr2=0x7f842c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:15.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f84317ff700 1 -- 172.21.15.132:0/2098630675 shutdown_connections 2023-05-10T04:20:15.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.069+0000 7f84317ff700 1 -- 172.21.15.132:0/2098630675 wait complete. 2023-05-10T04:20:15.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.071+0000 7f84317ff700 1 Processor -- start 2023-05-10T04:20:15.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.071+0000 7f84317ff700 1 -- start start 2023-05-10T04:20:15.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f84317ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f842c06aaf0 0x7f842c0ce1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f84317ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f842c071030 0x7f842c155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f84317ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c15a5a0 0x7f842c0ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f84317ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0ac2c0 con 0x7f842c15a5a0 2023-05-10T04:20:15.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f84317ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0ac560 con 0x7f842c071030 2023-05-10T04:20:15.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f84317ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f842c0cd370 con 0x7f842c06aaf0 2023-05-10T04:20:15.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f842b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c15a5a0 0x7f842c0ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f842b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c15a5a0 0x7f842c0ac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45772/0 (socket says 172.21.15.132:45772) 2023-05-10T04:20:15.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f842b7fe700 1 -- 172.21.15.132:0/1805055397 learned_addr learned my addr 172.21.15.132:0/1805055397 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:15.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f8423fff700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f842c071030 0x7f842c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.072+0000 7f842affd700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f842c06aaf0 0x7f842c0ce1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f842b7fe700 1 -- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f842c06aaf0 msgr2=0x7f842c0ce1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f842b7fe700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f842c06aaf0 0x7f842c0ce1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f842b7fe700 1 -- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f842c071030 msgr2=0x7f842c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f842b7fe700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f842c071030 0x7f842c155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f842b7fe700 1 -- 172.21.15.132:0/1805055397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414009430 con 0x7f842c15a5a0 2023-05-10T04:20:15.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f842affd700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f842c06aaf0 0x7f842c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:15.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f842b7fe700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c15a5a0 0x7f842c0ac9f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8424007ef0 tx=0x7f842400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f84237fe700 1 -- 172.21.15.132:0/1805055397 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400de30 con 0x7f842c15a5a0 2023-05-10T04:20:15.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f84237fe700 1 -- 172.21.15.132:0/1805055397 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842400f040 con 0x7f842c15a5a0 2023-05-10T04:20:15.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842c06c9a0 con 0x7f842c15a5a0 2023-05-10T04:20:15.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f84237fe700 1 -- 172.21.15.132:0/1805055397 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424003c60 con 0x7f842c15a5a0 2023-05-10T04:20:15.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.073+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f842c06c6c0 con 0x7f842c15a5a0 2023-05-10T04:20:15.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.074+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842c06cc80 con 0x7f842c15a5a0 2023-05-10T04:20:15.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.075+0000 7f84237fe700 1 -- 172.21.15.132:0/1805055397 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8424004030 con 0x7f842c15a5a0 2023-05-10T04:20:15.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.076+0000 7f84237fe700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f840c06ace0 0x7f840c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.076+0000 7f84237fe700 1 -- 172.21.15.132:0/1805055397 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f84240898a0 con 0x7f842c15a5a0 2023-05-10T04:20:15.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.076+0000 7f842affd700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f840c06ace0 0x7f840c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.077+0000 7f842affd700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f840c06ace0 0x7f840c06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f841c000f60 tx=0x7f841c007d30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.081+0000 7f84237fe700 1 -- 172.21.15.132:0/1805055397 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8424054660 con 0x7f842c15a5a0 2023-05-10T04:20:15.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.273+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f842c0ac6d0 con 0x7f842c15a5a0 2023-05-10T04:20:15.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.274+0000 7f84237fe700 1 -- 172.21.15.132:0/1805055397 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8424057c80 con 0x7f842c15a5a0 2023-05-10T04:20:15.277 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:15.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f840c06ace0 msgr2=0x7f840c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f840c06ace0 0x7f840c06d190 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f841c000f60 tx=0x7f841c007d30 comp rx=0 tx=0).stop 2023-05-10T04:20:15.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c15a5a0 msgr2=0x7f842c0ac9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c15a5a0 0x7f842c0ac9f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f8424007ef0 tx=0x7f842400d3b0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 shutdown_connections 2023-05-10T04:20:15.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f840c06ace0 0x7f840c06d190 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f842c15a5a0 0x7f842c0ac9f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f842c06aaf0 0x7f842c0ce1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 --2- 172.21.15.132:0/1805055397 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f842c071030 0x7f842c155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 >> 172.21.15.132:0/1805055397 conn(0x7f842c0cf720 msgr2=0x7f842c06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:15.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 shutdown_connections 2023-05-10T04:20:15.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.276+0000 7f84317ff700 1 -- 172.21.15.132:0/1805055397 wait complete. 2023-05-10T04:20:15.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:15.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.480+0000 7f68159ff700 1 Processor -- start 2023-05-10T04:20:15.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.480+0000 7f68159ff700 1 -- start start 2023-05-10T04:20:15.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.481+0000 7f68159ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f68100cfbf0 0x7f68101608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.481+0000 7f68159ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f68100d1100 0x7f68100d1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.481+0000 7f68159ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68100d0020 con 0x7f68100b87a0 2023-05-10T04:20:15.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.481+0000 7f68159ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68100d02d0 con 0x7f68100d1100 2023-05-10T04:20:15.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.481+0000 7f68159ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68100d0cb0 con 0x7f68100cfbf0 2023-05-10T04:20:15.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.481+0000 7f680f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f68100d1100 0x7f68100d1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f68100d1100 0x7f68100d1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45786/0 (socket says 172.21.15.132:45786) 2023-05-10T04:20:15.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680f7fe700 1 -- 172.21.15.132:0/3128030614 learned_addr learned my addr 172.21.15.132:0/3128030614 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:15.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680e7fc700 1 --2- 172.21.15.132:0/3128030614 >> v2:172.21.15.154:3300/0 conn(0x7f68100cfbf0 0x7f68101608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680f7fe700 1 -- 172.21.15.132:0/3128030614 >> v2:172.21.15.154:3300/0 conn(0x7f68100cfbf0 msgr2=0x7f68101608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:15.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680f7fe700 1 --2- 172.21.15.132:0/3128030614 >> v2:172.21.15.154:3300/0 conn(0x7f68100cfbf0 0x7f68101608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680f7fe700 1 -- 172.21.15.132:0/3128030614 >> v1:172.21.15.154:6789/0 conn(0x7f68100b87a0 legacy=0x7f68101601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:15.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680f7fe700 1 -- 172.21.15.132:0/3128030614 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68100cdc60 con 0x7f68100d1100 2023-05-10T04:20:15.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680e7fc700 1 --2- 172.21.15.132:0/3128030614 >> v2:172.21.15.154:3300/0 conn(0x7f68100cfbf0 0x7f68101608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:15.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680f7fe700 1 --2- 172.21.15.132:0/3128030614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100d1100 0x7f68100d1520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f68100b8f60 tx=0x7f680800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f3a49f99aea29b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.482+0000 7f680dffb700 1 -- 172.21.15.132:0/3128030614 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680800e070 con 0x7f68100d1100 2023-05-10T04:20:15.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f680dffb700 1 -- 172.21.15.132:0/3128030614 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6808003a20 con 0x7f68100d1100 2023-05-10T04:20:15.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f680dffb700 1 -- 172.21.15.132:0/3128030614 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6808003dd0 con 0x7f68100d1100 2023-05-10T04:20:15.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f68159ff700 1 -- 172.21.15.132:0/3128030614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100d1100 msgr2=0x7f68100d1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f68159ff700 1 --2- 172.21.15.132:0/3128030614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100d1100 0x7f68100d1520 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f68100b8f60 tx=0x7f680800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:15.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f68159ff700 1 -- 172.21.15.132:0/3128030614 shutdown_connections 2023-05-10T04:20:15.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f68159ff700 1 --2- 172.21.15.132:0/3128030614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100d1100 0x7f68100d1520 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f68159ff700 1 --2- 172.21.15.132:0/3128030614 >> v2:172.21.15.154:3300/0 conn(0x7f68100cfbf0 0x7f68101608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f68159ff700 1 -- 172.21.15.132:0/3128030614 >> 172.21.15.132:0/3128030614 conn(0x7f6810071b10 msgr2=0x7f6810071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:15.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f68159ff700 1 -- 172.21.15.132:0/3128030614 shutdown_connections 2023-05-10T04:20:15.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.483+0000 7f68159ff700 1 -- 172.21.15.132:0/3128030614 wait complete. 2023-05-10T04:20:15.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.485+0000 7f68159ff700 1 Processor -- start 2023-05-10T04:20:15.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.485+0000 7f68159ff700 1 -- start start 2023-05-10T04:20:15.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f68159ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100b87a0 0x7f6810154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f68159ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68100cfbf0 0x7f681015e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f68159ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68100d1100 0x7f681015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f68159ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68101f5520 con 0x7f68100b87a0 2023-05-10T04:20:15.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f68159ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68101f57c0 con 0x7f68100cfbf0 2023-05-10T04:20:15.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f68159ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68101f5aa0 con 0x7f68100d1100 2023-05-10T04:20:15.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f680effd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100b87a0 0x7f6810154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f680effd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100b87a0 0x7f6810154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45794/0 (socket says 172.21.15.132:45794) 2023-05-10T04:20:15.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f680effd700 1 -- 172.21.15.132:0/1847123171 learned_addr learned my addr 172.21.15.132:0/1847123171 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:15.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f680f7fe700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68100d1100 0x7f681015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.486+0000 7f680e7fc700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68100cfbf0 0x7f681015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f680effd700 1 -- 172.21.15.132:0/1847123171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68100d1100 msgr2=0x7f681015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f680effd700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68100d1100 0x7f681015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f680effd700 1 -- 172.21.15.132:0/1847123171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68100cfbf0 msgr2=0x7f681015e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f680effd700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68100cfbf0 0x7f681015e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f680effd700 1 -- 172.21.15.132:0/1847123171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6808009b30 con 0x7f68100b87a0 2023-05-10T04:20:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f680effd700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100b87a0 0x7f6810154680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f680000b4a0 tx=0x7f680000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f67f7fff700 1 -- 172.21.15.132:0/1847123171 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800011830 con 0x7f68100b87a0 2023-05-10T04:20:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f67f7fff700 1 -- 172.21.15.132:0/1847123171 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6800011990 con 0x7f68100b87a0 2023-05-10T04:20:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68100cd980 con 0x7f68100b87a0 2023-05-10T04:20:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f67f7fff700 1 -- 172.21.15.132:0/1847123171 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6800011d40 con 0x7f68100b87a0 2023-05-10T04:20:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.487+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68100cd6a0 con 0x7f68100b87a0 2023-05-10T04:20:15.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.488+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6810160e30 con 0x7f68100b87a0 2023-05-10T04:20:15.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.489+0000 7f67f7fff700 1 -- 172.21.15.132:0/1847123171 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f680001a400 con 0x7f68100b87a0 2023-05-10T04:20:15.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.491+0000 7f67f7fff700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f67fc06ace0 0x7f67fc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.491+0000 7f67f7fff700 1 -- 172.21.15.132:0/1847123171 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6800089390 con 0x7f68100b87a0 2023-05-10T04:20:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.491+0000 7f680e7fc700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f67fc06ace0 0x7f67fc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.491+0000 7f680e7fc700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f67fc06ace0 0x7f67fc06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6804006fd0 tx=0x7f6804008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.495+0000 7f67f7fff700 1 -- 172.21.15.132:0/1847123171 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6800054140 con 0x7f68100b87a0 2023-05-10T04:20:15.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.693+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f68100c69a0 con 0x7f68100b87a0 2023-05-10T04:20:15.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.693+0000 7f67f7fff700 1 -- 172.21.15.132:0/1847123171 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6800057760 con 0x7f68100b87a0 2023-05-10T04:20:15.699 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:15.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f67fc06ace0 msgr2=0x7f67fc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f67fc06ace0 0x7f67fc06d190 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6804006fd0 tx=0x7f6804008040 comp rx=0 tx=0).stop 2023-05-10T04:20:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100b87a0 msgr2=0x7f6810154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100b87a0 0x7f6810154680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f680000b4a0 tx=0x7f680000b7b0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 shutdown_connections 2023-05-10T04:20:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f67fc06ace0 0x7f67fc06d190 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f68100d1100 0x7f681015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f68100b87a0 0x7f6810154680 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 --2- 172.21.15.132:0/1847123171 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f68100cfbf0 0x7f681015e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 >> 172.21.15.132:0/1847123171 conn(0x7f6810071b10 msgr2=0x7f68100b4070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 shutdown_connections 2023-05-10T04:20:15.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.696+0000 7f68159ff700 1 -- 172.21.15.132:0/1847123171 wait complete. 2023-05-10T04:20:15.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:15.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.899+0000 7fc7a09ff700 1 Processor -- start 2023-05-10T04:20:15.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.899+0000 7fc7a09ff700 1 -- start start 2023-05-10T04:20:15.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.900+0000 7fc7a09ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c0ccfa0 0x7fc79c1676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.900+0000 7fc7a09ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c0b26f0 con 0x7fc79c0d0130 2023-05-10T04:20:15.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.900+0000 7fc7a09ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc79c0cfb60 con 0x7fc79c06b4f0 2023-05-10T04:20:15.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.900+0000 7fc7a09ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0cfe40 con 0x7fc79c0ccfa0 2023-05-10T04:20:15.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.900+0000 7fc799d9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc79c0d0130 0x7fc79c0cf350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33868/0 (socket says 172.21.15.132:33868) 2023-05-10T04:20:15.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.900+0000 7fc799d9b700 1 -- 172.21.15.132:0/3758969296 learned_addr learned my addr 172.21.15.132:0/3758969296 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:15.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79ad9d700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c0ccfa0 0x7fc79c1676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 155956024 0 0) 0x7fc79c0b26f0 con 0x7fc79c0d0130 2023-05-10T04:20:15.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7840035b0 con 0x7fc79c0d0130 2023-05-10T04:20:15.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1676873497 0 0) 0x7fc7840035b0 con 0x7fc79c0d0130 2023-05-10T04:20:15.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c0ccfa0 msgr2=0x7fc79c1676c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:15.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c0ccfa0 0x7fc79c1676c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 >> v1:172.21.15.154:6789/0 conn(0x7fc79c06b4f0 legacy=0x7fc79c06b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0cb4b0 con 0x7fc79c0d0130 2023-05-10T04:20:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fc790001670 con 0x7fc79c0d0130 2023-05-10T04:20:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 >> v1:172.21.15.132:6789/0 conn(0x7fc79c0d0130 legacy=0x7fc79c0cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c0ccfa0 0x7fc784003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc784003fb0 0x7fc784004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784004d90 0x7fc784005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c0cfe40 con 0x7fc784003fb0 2023-05-10T04:20:15.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc78400bc20 con 0x7fc784004d90 2023-05-10T04:20:15.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78400bde0 con 0x7fc79c0ccfa0 2023-05-10T04:20:15.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc799d9b700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc784003fb0 0x7fc784004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.901+0000 7fc79a59c700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c0ccfa0 0x7fc784003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc79ad9d700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784004d90 0x7fc784005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc799d9b700 1 -- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c0ccfa0 msgr2=0x7fc784003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:15.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc799d9b700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c0ccfa0 0x7fc784003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc799d9b700 1 -- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784004d90 msgr2=0x7fc784005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:15.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc799d9b700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784004d90 0x7fc784005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc799d9b700 1 -- 172.21.15.132:0/3758969296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7840035b0 con 0x7fc784003fb0 2023-05-10T04:20:15.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc799d9b700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc784003fb0 0x7fc784004850 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc79000c210 tx=0x7fc784005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e48d5e866862c33 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790007c10 con 0x7fc784003fb0 2023-05-10T04:20:15.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79000cdb0 con 0x7fc784003fb0 2023-05-10T04:20:15.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.902+0000 7fc79959a700 1 -- 172.21.15.132:0/3758969296 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc790005ba0 con 0x7fc784003fb0 2023-05-10T04:20:15.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.903+0000 7fc7a09ff700 1 -- 172.21.15.132:0/3758969296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc784003fb0 msgr2=0x7fc784004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.903+0000 7fc7a09ff700 1 --2- 172.21.15.132:0/3758969296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc784003fb0 0x7fc784004850 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc79000c210 tx=0x7fc784005880 comp rx=0 tx=0).stop 2023-05-10T04:20:15.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.903+0000 7fc79ad9d700 1 -- 172.21.15.132:0/3758969296 reap_dead start 2023-05-10T04:20:15.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.903+0000 7fc7a09ff700 1 -- 172.21.15.132:0/3758969296 shutdown_connections 2023-05-10T04:20:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.903+0000 7fc7a09ff700 1 -- 172.21.15.132:0/3758969296 >> 172.21.15.132:0/3758969296 conn(0x7fc79c09a090 msgr2=0x7fc79c0d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.903+0000 7fc7a09ff700 1 -- 172.21.15.132:0/3758969296 shutdown_connections 2023-05-10T04:20:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.903+0000 7fc7a09ff700 1 -- 172.21.15.132:0/3758969296 wait complete. 2023-05-10T04:20:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.905+0000 7fc7a09ff700 1 Processor -- start 2023-05-10T04:20:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.905+0000 7fc7a09ff700 1 -- start start 2023-05-10T04:20:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc7a09ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784003fb0 0x7fc79c156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc7a09ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c157ae0 0x7fc79c0c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc7a09ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc79c0c6610 0x7fc79c1e5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc7a09ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c157fc0 con 0x7fc79c0c6610 2023-05-10T04:20:15.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc7a09ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c1582a0 con 0x7fc784003fb0 2023-05-10T04:20:15.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc7a09ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c158580 con 0x7fc79c157ae0 2023-05-10T04:20:15.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79ad9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc79c0c6610 0x7fc79c1e5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79ad9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc79c0c6610 0x7fc79c1e5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45810/0 (socket says 172.21.15.132:45810) 2023-05-10T04:20:15.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79ad9d700 1 -- 172.21.15.132:0/41691731 learned_addr learned my addr 172.21.15.132:0/41691731 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:15.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc799d9b700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c157ae0 0x7fc79c0c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79a59c700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784003fb0 0x7fc79c156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79ad9d700 1 -- 172.21.15.132:0/41691731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c157ae0 msgr2=0x7fc79c0c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79ad9d700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c157ae0 0x7fc79c0c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79ad9d700 1 -- 172.21.15.132:0/41691731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784003fb0 msgr2=0x7fc79c156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:15.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79ad9d700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784003fb0 0x7fc79c156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:15.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.906+0000 7fc79ad9d700 1 -- 172.21.15.132:0/41691731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c0cba70 con 0x7fc79c0c6610 2023-05-10T04:20:15.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.907+0000 7fc79ad9d700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc79c0c6610 0x7fc79c1e5790 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0d0500 tx=0x7fc794011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.907+0000 7fc78affd700 1 -- 172.21.15.132:0/41691731 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400e040 con 0x7fc79c0c6610 2023-05-10T04:20:15.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.907+0000 7fc78affd700 1 -- 172.21.15.132:0/41691731 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc79400f040 con 0x7fc79c0c6610 2023-05-10T04:20:15.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.907+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc79c0cb790 con 0x7fc79c0c6610 2023-05-10T04:20:15.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.907+0000 7fc78affd700 1 -- 172.21.15.132:0/41691731 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc79400fc40 con 0x7fc79c0c6610 2023-05-10T04:20:15.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.907+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc79c15ced0 con 0x7fc79c0c6610 2023-05-10T04:20:15.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.908+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79c158aa0 con 0x7fc79c0c6610 2023-05-10T04:20:15.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.909+0000 7fc78affd700 1 -- 172.21.15.132:0/41691731 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc794022460 con 0x7fc79c0c6610 2023-05-10T04:20:15.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.910+0000 7fc78affd700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc77c06ace0 0x7fc77c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:15.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.910+0000 7fc78affd700 1 -- 172.21.15.132:0/41691731 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc794089d10 con 0x7fc79c0c6610 2023-05-10T04:20:15.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.910+0000 7fc79a59c700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc77c06ace0 0x7fc77c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:15.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.911+0000 7fc79a59c700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc77c06ace0 0x7fc77c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc78c007fd0 tx=0x7fc78c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:15.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:15.914+0000 7fc78affd700 1 -- 172.21.15.132:0/41691731 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fc794058430 con 0x7fc79c0c6610 2023-05-10T04:20:16.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.109+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc79c0d1280 con 0x7fc79c0c6610 2023-05-10T04:20:16.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.110+0000 7fc78affd700 1 -- 172.21.15.132:0/41691731 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc7940890a0 con 0x7fc79c0c6610 2023-05-10T04:20:16.113 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:16.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc77c06ace0 msgr2=0x7fc77c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc77c06ace0 0x7fc77c06d190 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc78c007fd0 tx=0x7fc78c009040 comp rx=0 tx=0).stop 2023-05-10T04:20:16.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc79c0c6610 msgr2=0x7fc79c1e5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc79c0c6610 0x7fc79c1e5790 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc79c0d0500 tx=0x7fc794011ed0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 shutdown_connections 2023-05-10T04:20:16.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fc77c06ace0 0x7fc77c06d190 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc79c0c6610 0x7fc79c1e5790 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fc784003fb0 0x7fc79c156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 --2- 172.21.15.132:0/41691731 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fc79c157ae0 0x7fc79c0c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 >> 172.21.15.132:0/41691731 conn(0x7fc79c09a090 msgr2=0x7fc79c0cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:16.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 shutdown_connections 2023-05-10T04:20:16.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.112+0000 7fc7a09ff700 1 -- 172.21.15.132:0/41691731 wait complete. 2023-05-10T04:20:16.132 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:16.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.315+0000 7fbc667ff700 1 Processor -- start 2023-05-10T04:20:16.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.315+0000 7fbc667ff700 1 -- start start 2023-05-10T04:20:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.316+0000 7fbc667ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc600cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.316+0000 7fbc667ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc601601e0 0x7fbc60160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.316+0000 7fbc667ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fbc60160b70 0x7fbc600d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.316+0000 7fbc667ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600d02d0 con 0x7fbc601601e0 2023-05-10T04:20:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.316+0000 7fbc667ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600d0cb0 con 0x7fbc60160b70 2023-05-10T04:20:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.316+0000 7fbc667ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600b2730 con 0x7fbc600b87a0 2023-05-10T04:20:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc601601e0 0x7fbc60160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc601601e0 0x7fbc60160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45822/0 (socket says 172.21.15.132:45822) 2023-05-10T04:20:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 -- 172.21.15.132:0/2003036631 learned_addr learned my addr 172.21.15.132:0/2003036631 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5ffff700 1 --2- 172.21.15.132:0/2003036631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc600cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc64d9c700 1 --2- 172.21.15.132:0/2003036631 >> v2:172.21.15.154:3300/0 conn(0x7fbc60160b70 0x7fbc600d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 -- 172.21.15.132:0/2003036631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 msgr2=0x7fbc600cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:16.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 --2- 172.21.15.132:0/2003036631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc600cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 -- 172.21.15.132:0/2003036631 >> v2:172.21.15.154:3300/0 conn(0x7fbc60160b70 msgr2=0x7fbc600d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:16.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 --2- 172.21.15.132:0/2003036631 >> v2:172.21.15.154:3300/0 conn(0x7fbc60160b70 0x7fbc600d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 -- 172.21.15.132:0/2003036631 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc60160ff0 con 0x7fbc601601e0 2023-05-10T04:20:16.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc64d9c700 1 --2- 172.21.15.132:0/2003036631 >> v2:172.21.15.154:3300/0 conn(0x7fbc60160b70 0x7fbc600d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:16.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.317+0000 7fbc5f7fe700 1 --2- 172.21.15.132:0/2003036631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc60160630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc6008be30 tx=0x7fbc54009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3221616196827 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:16.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc5effd700 1 -- 172.21.15.132:0/2003036631 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54011830 con 0x7fbc601601e0 2023-05-10T04:20:16.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc5effd700 1 -- 172.21.15.132:0/2003036631 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc54011990 con 0x7fbc601601e0 2023-05-10T04:20:16.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc5effd700 1 -- 172.21.15.132:0/2003036631 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54011d20 con 0x7fbc601601e0 2023-05-10T04:20:16.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 -- 172.21.15.132:0/2003036631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 msgr2=0x7fbc60160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 --2- 172.21.15.132:0/2003036631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc60160630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbc6008be30 tx=0x7fbc54009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 -- 172.21.15.132:0/2003036631 shutdown_connections 2023-05-10T04:20:16.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 --2- 172.21.15.132:0/2003036631 >> v2:172.21.15.154:3300/0 conn(0x7fbc60160b70 0x7fbc600d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 --2- 172.21.15.132:0/2003036631 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc600cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 --2- 172.21.15.132:0/2003036631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc60160630 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 -- 172.21.15.132:0/2003036631 >> 172.21.15.132:0/2003036631 conn(0x7fbc60071b10 msgr2=0x7fbc60071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:16.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 -- 172.21.15.132:0/2003036631 shutdown_connections 2023-05-10T04:20:16.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.318+0000 7fbc667ff700 1 -- 172.21.15.132:0/2003036631 wait complete. 2023-05-10T04:20:16.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.320+0000 7fbc667ff700 1 Processor -- start 2023-05-10T04:20:16.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.320+0000 7fbc667ff700 1 -- start start 2023-05-10T04:20:16.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc667ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc601f1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc667ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc600b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc667ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc60160b70 0x7fbc600b7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc667ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc60154ca0 con 0x7fbc601601e0 2023-05-10T04:20:16.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc667ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc601f1e70 con 0x7fbc60160b70 2023-05-10T04:20:16.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc667ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6015f060 con 0x7fbc600b87a0 2023-05-10T04:20:16.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc600b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc5f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc600b6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45830/0 (socket says 172.21.15.132:45830) 2023-05-10T04:20:16.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.321+0000 7fbc5f7fe700 1 -- 172.21.15.132:0/733881134 learned_addr learned my addr 172.21.15.132:0/733881134 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:16.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5ffff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc601f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5f7fe700 1 -- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 msgr2=0x7fbc601f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5f7fe700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc601f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5f7fe700 1 -- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc60160b70 msgr2=0x7fbc600b7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc64d9c700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc60160b70 0x7fbc600b7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5f7fe700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc60160b70 0x7fbc600b7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5f7fe700 1 -- 172.21.15.132:0/733881134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc54009550 con 0x7fbc601601e0 2023-05-10T04:20:16.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5ffff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc601f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:16.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc64d9c700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc60160b70 0x7fbc600b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:16.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5f7fe700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc600b6d30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009c10 tx=0x7fbc54004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:16.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5cff9700 1 -- 172.21.15.132:0/733881134 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc54004380 con 0x7fbc601601e0 2023-05-10T04:20:16.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5cff9700 1 -- 172.21.15.132:0/733881134 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5401f070 con 0x7fbc601601e0 2023-05-10T04:20:16.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600cd6a0 con 0x7fbc601601e0 2023-05-10T04:20:16.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.322+0000 7fbc5cff9700 1 -- 172.21.15.132:0/733881134 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc540036a0 con 0x7fbc601601e0 2023-05-10T04:20:16.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.323+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc600cdc60 con 0x7fbc601601e0 2023-05-10T04:20:16.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.324+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc600cd980 con 0x7fbc601601e0 2023-05-10T04:20:16.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.324+0000 7fbc5cff9700 1 -- 172.21.15.132:0/733881134 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbc54021030 con 0x7fbc601601e0 2023-05-10T04:20:16.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.326+0000 7fbc5cff9700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbc4c06ace0 0x7fbc4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.326+0000 7fbc5cff9700 1 -- 172.21.15.132:0/733881134 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbc5408aa80 con 0x7fbc601601e0 2023-05-10T04:20:16.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.326+0000 7fbc5ffff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbc4c06ace0 0x7fbc4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.327+0000 7fbc5ffff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbc4c06ace0 0x7fbc4c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009a40 tx=0x7fbc50008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:16.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.330+0000 7fbc5cff9700 1 -- 172.21.15.132:0/733881134 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fbc54055830 con 0x7fbc601601e0 2023-05-10T04:20:16.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.528+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc601f2040 con 0x7fbc601601e0 2023-05-10T04:20:16.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.528+0000 7fbc5cff9700 1 -- 172.21.15.132:0/733881134 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc54015020 con 0x7fbc601601e0 2023-05-10T04:20:16.531 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:16.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbc4c06ace0 msgr2=0x7fbc4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbc4c06ace0 0x7fbc4c06d190 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009a40 tx=0x7fbc50008040 comp rx=0 tx=0).stop 2023-05-10T04:20:16.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 msgr2=0x7fbc600b6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc600b6d30 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009c10 tx=0x7fbc54004750 comp rx=0 tx=0).stop 2023-05-10T04:20:16.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 shutdown_connections 2023-05-10T04:20:16.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fbc4c06ace0 0x7fbc4c06d190 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fbc60160b70 0x7fbc600b7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fbc600b87a0 0x7fbc601f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 --2- 172.21.15.132:0/733881134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc601601e0 0x7fbc600b6d30 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 >> 172.21.15.132:0/733881134 conn(0x7fbc60071b10 msgr2=0x7fbc600d1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:16.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 shutdown_connections 2023-05-10T04:20:16.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.531+0000 7fbc667ff700 1 -- 172.21.15.132:0/733881134 wait complete. 2023-05-10T04:20:16.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:16.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.735+0000 7f1b587ff700 1 Processor -- start 2023-05-10T04:20:16.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.735+0000 7f1b587ff700 1 -- start start 2023-05-10T04:20:16.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.736+0000 7f1b587ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b5015a5a0 0x7f1b5006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.736+0000 7f1b587ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b50071200 0x7f1b5006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.736+0000 7f1b587ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b500cb280 con 0x7f1b5006a920 2023-05-10T04:20:16.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.736+0000 7f1b587ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b5006adc0 con 0x7f1b5015a5a0 2023-05-10T04:20:16.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.736+0000 7f1b587ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5015a970 con 0x7f1b50071200 2023-05-10T04:20:16.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b56d9c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b50071200 0x7f1b5006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b5659b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1b5015a5a0 0x7f1b5006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b56d9c700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b50071200 0x7f1b5006d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:47358/0 (socket says 172.21.15.132:47358) 2023-05-10T04:20:16.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b56d9c700 1 -- 172.21.15.132:0/2040411902 learned_addr learned my addr 172.21.15.132:0/2040411902 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:16.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b55599700 1 -- 172.21.15.132:0/2040411902 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763213020 0 0) 0x7f1b40001160 con 0x7f1b5006a920 2023-05-10T04:20:16.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b55599700 1 -- 172.21.15.132:0/2040411902 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b3c0035b0 con 0x7f1b5006a920 2023-05-10T04:20:16.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b56d9c700 1 -- 172.21.15.132:0/2040411902 >> v2:172.21.15.154:3300/0 conn(0x7f1b5015a5a0 msgr2=0x7f1b5006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:16.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b56d9c700 1 --2- 172.21.15.132:0/2040411902 >> v2:172.21.15.154:3300/0 conn(0x7f1b5015a5a0 0x7f1b5006a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b56d9c700 1 -- 172.21.15.132:0/2040411902 >> v1:172.21.15.154:6789/0 conn(0x7f1b5006a920 legacy=0x7f1b50070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b56d9c700 1 -- 172.21.15.132:0/2040411902 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b50071700 con 0x7f1b50071200 2023-05-10T04:20:16.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.737+0000 7f1b5659b700 1 --2- 172.21.15.132:0/2040411902 >> v2:172.21.15.154:3300/0 conn(0x7f1b5015a5a0 0x7f1b5006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:16.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b56d9c700 1 --2- 172.21.15.132:0/2040411902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b50071200 0x7f1b5006d1a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009e50 tx=0x7f1b4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51bf2f85f696a92f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:16.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b55599700 1 -- 172.21.15.132:0/2040411902 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800e070 con 0x7f1b50071200 2023-05-10T04:20:16.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b55599700 1 -- 172.21.15.132:0/2040411902 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b4800b910 con 0x7f1b50071200 2023-05-10T04:20:16.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b55599700 1 -- 172.21.15.132:0/2040411902 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b4800bcc0 con 0x7f1b50071200 2023-05-10T04:20:16.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b587ff700 1 -- 172.21.15.132:0/2040411902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b50071200 msgr2=0x7f1b5006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2040411902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b50071200 0x7f1b5006d1a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009e50 tx=0x7f1b4800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:16.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b587ff700 1 -- 172.21.15.132:0/2040411902 shutdown_connections 2023-05-10T04:20:16.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2040411902 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b50071200 0x7f1b5006d1a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2040411902 >> v2:172.21.15.154:3300/0 conn(0x7f1b5015a5a0 0x7f1b5006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.738+0000 7f1b587ff700 1 -- 172.21.15.132:0/2040411902 >> 172.21.15.132:0/2040411902 conn(0x7f1b500cf720 msgr2=0x7f1b500cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:16.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.739+0000 7f1b587ff700 1 -- 172.21.15.132:0/2040411902 shutdown_connections 2023-05-10T04:20:16.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.739+0000 7f1b587ff700 1 -- 172.21.15.132:0/2040411902 wait complete. 2023-05-10T04:20:16.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.740+0000 7f1b587ff700 1 Processor -- start 2023-05-10T04:20:16.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.740+0000 7f1b587ff700 1 -- start start 2023-05-10T04:20:16.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.741+0000 7f1b587ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b5006a920 0x7f1b50155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.741+0000 7f1b587ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b50071200 0x7f1b500c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.741+0000 7f1b587ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5015a5a0 0x7f1b500b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.741+0000 7f1b587ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500af6b0 con 0x7f1b50071200 2023-05-10T04:20:16.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.741+0000 7f1b587ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500af900 con 0x7f1b5006a920 2023-05-10T04:20:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.741+0000 7f1b587ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b500afbe0 con 0x7f1b5015a5a0 2023-05-10T04:20:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.741+0000 7f1b55d9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b50071200 0x7f1b500c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.741+0000 7f1b55d9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b50071200 0x7f1b500c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45844/0 (socket says 172.21.15.132:45844) 2023-05-10T04:20:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b55d9a700 1 -- 172.21.15.132:0/2287579778 learned_addr learned my addr 172.21.15.132:0/2287579778 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b56d9c700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5015a5a0 0x7f1b500b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b5659b700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b5006a920 0x7f1b50155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b55d9a700 1 -- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5015a5a0 msgr2=0x7f1b500b2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b55d9a700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5015a5a0 0x7f1b500b2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b55d9a700 1 -- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b5006a920 msgr2=0x7f1b50155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b55d9a700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b5006a920 0x7f1b50155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b55d9a700 1 -- 172.21.15.132:0/2287579778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4c0094a0 con 0x7f1b50071200 2023-05-10T04:20:16.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b5659b700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b5006a920 0x7f1b50155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:16.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b55d9a700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b50071200 0x7f1b500c7be0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c520 tx=0x7f1b4000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:16.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b46ffd700 1 -- 172.21.15.132:0/2287579778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b400052d0 con 0x7f1b50071200 2023-05-10T04:20:16.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b46ffd700 1 -- 172.21.15.132:0/2287579778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b40005430 con 0x7f1b50071200 2023-05-10T04:20:16.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b48009b30 con 0x7f1b50071200 2023-05-10T04:20:16.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.742+0000 7f1b46ffd700 1 -- 172.21.15.132:0/2287579778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b40003910 con 0x7f1b50071200 2023-05-10T04:20:16.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.743+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b5006c6c0 con 0x7f1b50071200 2023-05-10T04:20:16.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.744+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b500719e0 con 0x7f1b50071200 2023-05-10T04:20:16.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.744+0000 7f1b46ffd700 1 -- 172.21.15.132:0/2287579778 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1b40003a70 con 0x7f1b50071200 2023-05-10T04:20:16.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.745+0000 7f1b46ffd700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:16.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.745+0000 7f1b46ffd700 1 -- 172.21.15.132:0/2287579778 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1b40088c40 con 0x7f1b50071200 2023-05-10T04:20:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.746+0000 7f1b5659b700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.746+0000 7f1b5659b700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009c50 tx=0x7f1b4c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.750+0000 7f1b46ffd700 1 -- 172.21.15.132:0/2287579778 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1b400538d0 con 0x7f1b50071200 2023-05-10T04:20:16.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.945+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1b5006c9a0 con 0x7f1b50071200 2023-05-10T04:20:16.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.946+0000 7f1b46ffd700 1 -- 172.21.15.132:0/2287579778 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1b40017020 con 0x7f1b50071200 2023-05-10T04:20:16.949 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:16.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 msgr2=0x7f1b3406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1b4c009c50 tx=0x7f1b4c008040 comp rx=0 tx=0).stop 2023-05-10T04:20:16.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b50071200 msgr2=0x7f1b500c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:16.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b50071200 0x7f1b500c7be0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1b4000c520 tx=0x7f1b4000c8e0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 shutdown_connections 2023-05-10T04:20:16.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1b3406ace0 0x7f1b3406d190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1b5015a5a0 0x7f1b500b2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1b5006a920 0x7f1b50155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 --2- 172.21.15.132:0/2287579778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b50071200 0x7f1b500c7be0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:16.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 >> 172.21.15.132:0/2287579778 conn(0x7f1b500cf720 msgr2=0x7f1b500b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:16.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 shutdown_connections 2023-05-10T04:20:16.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:16.948+0000 7f1b587ff700 1 -- 172.21.15.132:0/2287579778 wait complete. 2023-05-10T04:20:16.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:20:17.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.152+0000 7fe87f1ff700 1 Processor -- start 2023-05-10T04:20:17.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.152+0000 7fe87f1ff700 1 -- start start 2023-05-10T04:20:17.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.153+0000 7fe87f1ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe87815a140 0x7fe8780cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.153+0000 7fe87f1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8780cfff0 0x7fe8780b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.153+0000 7fe87f1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe87815d660 con 0x7fe878160ba0 2023-05-10T04:20:17.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.153+0000 7fe87f1ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87815cd70 con 0x7fe87815a140 2023-05-10T04:20:17.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.153+0000 7fe87f1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe87815d010 con 0x7fe8780cfff0 2023-05-10T04:20:17.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87cf9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe87815a140 0x7fe8780cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87cf9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe87815a140 0x7fe8780cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45846/0 (socket says 172.21.15.132:45846) 2023-05-10T04:20:17.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87cf9b700 1 -- 172.21.15.132:0/4096521880 learned_addr learned my addr 172.21.15.132:0/4096521880 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:17.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87d79c700 1 --2- 172.21.15.132:0/4096521880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8780cfff0 0x7fe8780b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87cf9b700 1 -- 172.21.15.132:0/4096521880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8780cfff0 msgr2=0x7fe8780b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:17.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87cf9b700 1 --2- 172.21.15.132:0/4096521880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8780cfff0 0x7fe8780b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87cf9b700 1 -- 172.21.15.132:0/4096521880 >> v1:172.21.15.154:6789/0 conn(0x7fe878160ba0 legacy=0x7fe8780cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87cf9b700 1 -- 172.21.15.132:0/4096521880 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87815d2f0 con 0x7fe87815a140 2023-05-10T04:20:17.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.154+0000 7fe87cf9b700 1 --2- 172.21.15.132:0/4096521880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87815a140 0x7fe8780cd520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0098f0 tx=0x7fe86c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc70c828cf0b3fb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:17.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe8777fe700 1 -- 172.21.15.132:0/4096521880 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00b8a0 con 0x7fe87815a140 2023-05-10T04:20:17.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe8777fe700 1 -- 172.21.15.132:0/4096521880 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c00ba00 con 0x7fe87815a140 2023-05-10T04:20:17.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe8777fe700 1 -- 172.21.15.132:0/4096521880 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00bd90 con 0x7fe87815a140 2023-05-10T04:20:17.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe87f1ff700 1 -- 172.21.15.132:0/4096521880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87815a140 msgr2=0x7fe8780cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/4096521880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87815a140 0x7fe8780cd520 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe86c0098f0 tx=0x7fe86c009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:17.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe87f1ff700 1 -- 172.21.15.132:0/4096521880 shutdown_connections 2023-05-10T04:20:17.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/4096521880 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe8780cfff0 0x7fe8780b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/4096521880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe87815a140 0x7fe8780cd520 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe87f1ff700 1 -- 172.21.15.132:0/4096521880 >> 172.21.15.132:0/4096521880 conn(0x7fe878071b10 msgr2=0x7fe878071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:17.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe87f1ff700 1 -- 172.21.15.132:0/4096521880 shutdown_connections 2023-05-10T04:20:17.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.155+0000 7fe87f1ff700 1 -- 172.21.15.132:0/4096521880 wait complete. 2023-05-10T04:20:17.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.157+0000 7fe87f1ff700 1 Processor -- start 2023-05-10T04:20:17.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.157+0000 7fe87f1ff700 1 -- start start 2023-05-10T04:20:17.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87f1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8780cfff0 0x7fe8780c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87f1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87815a140 0x7fe8781569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87f1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe878160ba0 0x7fe878156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87f1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780ca980 con 0x7fe8780cfff0 2023-05-10T04:20:17.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87f1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780cac60 con 0x7fe87815a140 2023-05-10T04:20:17.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87f1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8780caf40 con 0x7fe878160ba0 2023-05-10T04:20:17.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87cf9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8780cfff0 0x7fe8780c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87cf9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8780cfff0 0x7fe8780c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45850/0 (socket says 172.21.15.132:45850) 2023-05-10T04:20:17.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.158+0000 7fe87cf9b700 1 -- 172.21.15.132:0/1879127317 learned_addr learned my addr 172.21.15.132:0/1879127317 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:17.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87d79c700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe878160ba0 0x7fe878156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe877fff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87815a140 0x7fe8781569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87cf9b700 1 -- 172.21.15.132:0/1879127317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe878160ba0 msgr2=0x7fe878156f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87cf9b700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe878160ba0 0x7fe878156f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87cf9b700 1 -- 172.21.15.132:0/1879127317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87815a140 msgr2=0x7fe8781569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87cf9b700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87815a140 0x7fe8781569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87cf9b700 1 -- 172.21.15.132:0/1879127317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c009550 con 0x7fe8780cfff0 2023-05-10T04:20:17.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87cf9b700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8780cfff0 0x7fe8780c9fa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe86c000c00 tx=0x7fe86c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:17.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe8757fa700 1 -- 172.21.15.132:0/1879127317 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c004480 con 0x7fe8780cfff0 2023-05-10T04:20:17.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe8757fa700 1 -- 172.21.15.132:0/1879127317 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86c01f070 con 0x7fe8780cfff0 2023-05-10T04:20:17.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8780cdb00 con 0x7fe8780cfff0 2023-05-10T04:20:17.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe8757fa700 1 -- 172.21.15.132:0/1879127317 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86c0038c0 con 0x7fe8780cfff0 2023-05-10T04:20:17.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.159+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe87815daf0 con 0x7fe8780cfff0 2023-05-10T04:20:17.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.160+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe878161020 con 0x7fe8780cfff0 2023-05-10T04:20:17.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.161+0000 7fe8757fa700 1 -- 172.21.15.132:0/1879127317 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe86c021030 con 0x7fe8780cfff0 2023-05-10T04:20:17.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.162+0000 7fe8757fa700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe85c06ace0 0x7fe85c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.162+0000 7fe8757fa700 1 -- 172.21.15.132:0/1879127317 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe86c08ad00 con 0x7fe8780cfff0 2023-05-10T04:20:17.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.163+0000 7fe877fff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe85c06ace0 0x7fe85c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.163+0000 7fe877fff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe85c06ace0 0x7fe85c06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8780b4c70 tx=0x7fe864009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:17.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.167+0000 7fe8757fa700 1 -- 172.21.15.132:0/1879127317 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe86c055c70 con 0x7fe8780cfff0 2023-05-10T04:20:17.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.379+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe87815ca40 con 0x7fe8780cfff0 2023-05-10T04:20:17.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.379+0000 7fe8757fa700 1 -- 172.21.15.132:0/1879127317 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe86c059290 con 0x7fe8780cfff0 2023-05-10T04:20:17.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe85c06ace0 msgr2=0x7fe85c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe85c06ace0 0x7fe85c06d190 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe8780b4c70 tx=0x7fe864009040 comp rx=0 tx=0).stop 2023-05-10T04:20:17.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8780cfff0 msgr2=0x7fe8780c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8780cfff0 0x7fe8780c9fa0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fe86c000c00 tx=0x7fe86c004750 comp rx=0 tx=0).stop 2023-05-10T04:20:17.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 shutdown_connections 2023-05-10T04:20:17.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe85c06ace0 0x7fe85c06d190 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe878160ba0 0x7fe878156f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8780cfff0 0x7fe8780c9fa0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 --2- 172.21.15.132:0/1879127317 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe87815a140 0x7fe8781569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 >> 172.21.15.132:0/1879127317 conn(0x7fe878071b10 msgr2=0x7fe8780d0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:17.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.381+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 shutdown_connections 2023-05-10T04:20:17.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.382+0000 7fe87f1ff700 1 -- 172.21.15.132:0/1879127317 wait complete. 2023-05-10T04:20:17.386 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:20:17.401 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-05-10T04:20:17.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:20:17.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-05-10T04:20:17.464 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:20:17.464 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T04:20:17.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:20:17.465 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-10T04:20:17.504 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:20:17.505 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:17.549 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:20:17.549 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:17.630 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:17.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.812+0000 7fad0d7ff700 1 Processor -- start 2023-05-10T04:20:17.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.812+0000 7fad0d7ff700 1 -- start start 2023-05-10T04:20:17.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.813+0000 7fad0d7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fad0815a5a0 0x7fad0806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.813+0000 7fad0d7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad080cb280 con 0x7fad0806a920 2023-05-10T04:20:17.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.813+0000 7fad0d7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad08071700 con 0x7fad08071200 2023-05-10T04:20:17.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.813+0000 7fad0d7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0806adc0 con 0x7fad0815a5a0 2023-05-10T04:20:17.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad067fc700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fad0806a920 0x7fad08070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33878/0 (socket says 172.21.15.132:33878) 2023-05-10T04:20:17.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad067fc700 1 -- 172.21.15.132:0/3760896043 learned_addr learned my addr 172.21.15.132:0/3760896043 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:17.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad06ffd700 1 --2- 172.21.15.132:0/3760896043 >> v2:172.21.15.154:3300/0 conn(0x7fad0815a5a0 0x7fad0806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad05ffb700 1 -- 172.21.15.132:0/3760896043 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022605089 0 0) 0x7facfc001290 con 0x7fad0806a920 2023-05-10T04:20:17.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad05ffb700 1 -- 172.21.15.132:0/3760896043 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf00035b0 con 0x7fad0806a920 2023-05-10T04:20:17.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad06ffd700 1 -- 172.21.15.132:0/3760896043 >> v1:172.21.15.154:6789/0 conn(0x7fad08071200 legacy=0x7fad0806d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad05ffb700 1 -- 172.21.15.132:0/3760896043 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980411200 0 0) 0x7fad08071700 con 0x7fad08071200 2023-05-10T04:20:17.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad06ffd700 1 -- 172.21.15.132:0/3760896043 >> v1:172.21.15.132:6789/0 conn(0x7fad0806a920 legacy=0x7fad08070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.814+0000 7fad06ffd700 1 -- 172.21.15.132:0/3760896043 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080719e0 con 0x7fad0815a5a0 2023-05-10T04:20:17.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad06ffd700 1 --2- 172.21.15.132:0/3760896043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 0x7fad0806a3e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7facf8009840 tx=0x7facf8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84773a404d47e9eb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:17.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad05ffb700 1 -- 172.21.15.132:0/3760896043 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8004230 con 0x7fad0815a5a0 2023-05-10T04:20:17.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad05ffb700 1 -- 172.21.15.132:0/3760896043 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf8004390 con 0x7fad0815a5a0 2023-05-10T04:20:17.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad05ffb700 1 -- 172.21.15.132:0/3760896043 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf80036a0 con 0x7fad0815a5a0 2023-05-10T04:20:17.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad0d7ff700 1 -- 172.21.15.132:0/3760896043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 msgr2=0x7fad0806a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad0d7ff700 1 --2- 172.21.15.132:0/3760896043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 0x7fad0806a3e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7facf8009840 tx=0x7facf8009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:17.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad0d7ff700 1 -- 172.21.15.132:0/3760896043 shutdown_connections 2023-05-10T04:20:17.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad0d7ff700 1 --2- 172.21.15.132:0/3760896043 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 0x7fad0806a3e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad0d7ff700 1 -- 172.21.15.132:0/3760896043 >> 172.21.15.132:0/3760896043 conn(0x7fad080cf720 msgr2=0x7fad080cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:17.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad0d7ff700 1 -- 172.21.15.132:0/3760896043 shutdown_connections 2023-05-10T04:20:17.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.815+0000 7fad0d7ff700 1 -- 172.21.15.132:0/3760896043 wait complete. 2023-05-10T04:20:17.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.817+0000 7fad0d7ff700 1 Processor -- start 2023-05-10T04:20:17.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.817+0000 7fad0d7ff700 1 -- start start 2023-05-10T04:20:17.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad0d7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0806a920 0x7fad0815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad0d7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08071200 0x7fad080ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad0d7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 0x7fad081578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad0d7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815bd10 con 0x7fad0806a920 2023-05-10T04:20:17.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad0d7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0815b340 con 0x7fad0815a5a0 2023-05-10T04:20:17.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad0d7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad08158660 con 0x7fad08071200 2023-05-10T04:20:17.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad06ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0806a920 0x7fad0815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad06ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0806a920 0x7fad0815b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45862/0 (socket says 172.21.15.132:45862) 2023-05-10T04:20:17.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad06ffd700 1 -- 172.21.15.132:0/51117170 learned_addr learned my addr 172.21.15.132:0/51117170 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:17.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.818+0000 7fad077fe700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 0x7fad081578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7fad067fc700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08071200 0x7fad080ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7fad06ffd700 1 -- 172.21.15.132:0/51117170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08071200 msgr2=0x7fad080ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7fad06ffd700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08071200 0x7fad080ac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7fad06ffd700 1 -- 172.21.15.132:0/51117170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 msgr2=0x7fad081578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:17.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7fad06ffd700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 0x7fad081578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:17.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7fad06ffd700 1 -- 172.21.15.132:0/51117170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf80094a0 con 0x7fad0806a920 2023-05-10T04:20:17.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7fad06ffd700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0806a920 0x7fad0815b7d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7facf800a010 tx=0x7facf8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:17.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7facef7fe700 1 -- 172.21.15.132:0/51117170 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8003c50 con 0x7fad0806a920 2023-05-10T04:20:17.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7facef7fe700 1 -- 172.21.15.132:0/51117170 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf801f070 con 0x7fad0806a920 2023-05-10T04:20:17.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0806c9a0 con 0x7fad0806a920 2023-05-10T04:20:17.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.819+0000 7facef7fe700 1 -- 172.21.15.132:0/51117170 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf8011630 con 0x7fad0806a920 2023-05-10T04:20:17.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.820+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0806c6c0 con 0x7fad0806a920 2023-05-10T04:20:17.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.820+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0806cc80 con 0x7fad0806a920 2023-05-10T04:20:17.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.821+0000 7facef7fe700 1 -- 172.21.15.132:0/51117170 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7facf8021030 con 0x7fad0806a920 2023-05-10T04:20:17.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.822+0000 7facef7fe700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7facf406ad10 0x7facf406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:17.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.822+0000 7facef7fe700 1 -- 172.21.15.132:0/51117170 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7facf808ac50 con 0x7fad0806a920 2023-05-10T04:20:17.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.822+0000 7fad067fc700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7facf406ad10 0x7facf406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:17.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.823+0000 7fad067fc700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7facf406ad10 0x7facf406d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fad081f5a80 tx=0x7facfc0019d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:17.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:17.827+0000 7facef7fe700 1 -- 172.21.15.132:0/51117170 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7facf8055a10 con 0x7fad0806a920 2023-05-10T04:20:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.028+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad0806cc80 con 0x7fad0806a920 2023-05-10T04:20:18.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.029+0000 7facef7fe700 1 -- 172.21.15.132:0/51117170 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7facf8059030 con 0x7fad0806a920 2023-05-10T04:20:18.032 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:18.032 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:18.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7facf406ad10 msgr2=0x7facf406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7facf406ad10 0x7facf406d1c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fad081f5a80 tx=0x7facfc0019d0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0806a920 msgr2=0x7fad0815b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0806a920 0x7fad0815b7d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7facf800a010 tx=0x7facf8004750 comp rx=0 tx=0).stop 2023-05-10T04:20:18.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 shutdown_connections 2023-05-10T04:20:18.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7facf406ad10 0x7facf406d1c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fad0815a5a0 0x7fad081578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad0806a920 0x7fad0815b7d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 --2- 172.21.15.132:0/51117170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fad08071200 0x7fad080ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 >> 172.21.15.132:0/51117170 conn(0x7fad080cf720 msgr2=0x7fad0806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:18.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 shutdown_connections 2023-05-10T04:20:18.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.032+0000 7fad0d7ff700 1 -- 172.21.15.132:0/51117170 wait complete. 2023-05-10T04:20:18.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:18.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.236+0000 7f4e5bbff700 1 Processor -- start 2023-05-10T04:20:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.236+0000 7f4e5bbff700 1 -- start start 2023-05-10T04:20:18.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.237+0000 7f4e5bbff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e540cff50 0x7f4e54160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.237+0000 7f4e5bbff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540cd520 con 0x7f4e540cf010 2023-05-10T04:20:18.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.237+0000 7f4e5bbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540d2640 con 0x7f4e5415c590 2023-05-10T04:20:18.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.237+0000 7f4e5bbff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e541610d0 con 0x7f4e540cff50 2023-05-10T04:20:18.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.237+0000 7f4e5a19c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e540cff50 0x7f4e54160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.237+0000 7f4e5919a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4e540cf010 0x7f4e540d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33884/0 (socket says 172.21.15.132:33884) 2023-05-10T04:20:18.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.237+0000 7f4e5919a700 1 -- 172.21.15.132:0/2959964595 learned_addr learned my addr 172.21.15.132:0/2959964595 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:18.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.238+0000 7f4e5a19c700 1 -- 172.21.15.132:0/2959964595 >> v1:172.21.15.154:6789/0 conn(0x7f4e5415c590 legacy=0x7f4e540cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.238+0000 7f4e5a19c700 1 -- 172.21.15.132:0/2959964595 >> v1:172.21.15.132:6789/0 conn(0x7f4e540cf010 legacy=0x7f4e540d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.238+0000 7f4e5a19c700 1 -- 172.21.15.132:0/2959964595 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540b23c0 con 0x7f4e540cff50 2023-05-10T04:20:18.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.238+0000 7f4e58999700 1 -- 172.21.15.132:0/2959964595 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717648011 0 0) 0x7f4e540cd520 con 0x7f4e540cf010 2023-05-10T04:20:18.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.238+0000 7f4e5a19c700 1 --2- 172.21.15.132:0/2959964595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cff50 0x7f4e54160b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009d90 tx=0x7f4e4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5c1b697ea83ef2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:18.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.238+0000 7f4e58999700 1 -- 172.21.15.132:0/2959964595 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c00e070 con 0x7f4e540cff50 2023-05-10T04:20:18.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.238+0000 7f4e58999700 1 -- 172.21.15.132:0/2959964595 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00bbd0 con 0x7f4e540cff50 2023-05-10T04:20:18.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.238+0000 7f4e58999700 1 -- 172.21.15.132:0/2959964595 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c012430 con 0x7f4e540cff50 2023-05-10T04:20:18.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.239+0000 7f4e5bbff700 1 -- 172.21.15.132:0/2959964595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cff50 msgr2=0x7f4e54160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.239+0000 7f4e5bbff700 1 --2- 172.21.15.132:0/2959964595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cff50 0x7f4e54160b90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009d90 tx=0x7f4e4c00b330 comp rx=0 tx=0).stop 2023-05-10T04:20:18.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.239+0000 7f4e5bbff700 1 -- 172.21.15.132:0/2959964595 shutdown_connections 2023-05-10T04:20:18.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.239+0000 7f4e5bbff700 1 --2- 172.21.15.132:0/2959964595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cff50 0x7f4e54160b90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.239+0000 7f4e5bbff700 1 -- 172.21.15.132:0/2959964595 >> 172.21.15.132:0/2959964595 conn(0x7f4e54071b10 msgr2=0x7f4e54071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:18.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.239+0000 7f4e5bbff700 1 -- 172.21.15.132:0/2959964595 shutdown_connections 2023-05-10T04:20:18.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.239+0000 7f4e5bbff700 1 -- 172.21.15.132:0/2959964595 wait complete. 2023-05-10T04:20:18.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.240+0000 7f4e5bbff700 1 Processor -- start 2023-05-10T04:20:18.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.241+0000 7f4e5bbff700 1 -- start start 2023-05-10T04:20:18.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.241+0000 7f4e5bbff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cf010 0x7f4e5414a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.241+0000 7f4e5bbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e540cff50 0x7f4e540b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.241+0000 7f4e5bbff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5415c590 0x7f4e540c8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.241+0000 7f4e5bbff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540a9930 con 0x7f4e540cf010 2023-05-10T04:20:18.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.241+0000 7f4e5bbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5414ad30 con 0x7f4e540cff50 2023-05-10T04:20:18.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.241+0000 7f4e5bbff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540b8660 con 0x7f4e5415c590 2023-05-10T04:20:18.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cf010 0x7f4e5414a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cf010 0x7f4e5414a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45872/0 (socket says 172.21.15.132:45872) 2023-05-10T04:20:18.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 -- 172.21.15.132:0/4203128240 learned_addr learned my addr 172.21.15.132:0/4203128240 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:18.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 -- 172.21.15.132:0/4203128240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5415c590 msgr2=0x7f4e540c8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5415c590 0x7f4e540c8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 -- 172.21.15.132:0/4203128240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e540cff50 msgr2=0x7f4e540b7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e540cff50 0x7f4e540b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 -- 172.21.15.132:0/4203128240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e4c009a70 con 0x7f4e540cf010 2023-05-10T04:20:18.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5999b700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cf010 0x7f4e5414a470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000c450 tx=0x7f4e5000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:18.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e4a7fc700 1 -- 172.21.15.132:0/4203128240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500052d0 con 0x7f4e540cf010 2023-05-10T04:20:18.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e4a7fc700 1 -- 172.21.15.132:0/4203128240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e50005430 con 0x7f4e540cf010 2023-05-10T04:20:18.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e4a7fc700 1 -- 172.21.15.132:0/4203128240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e500038c0 con 0x7f4e540cf010 2023-05-10T04:20:18.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.242+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e540cd770 con 0x7f4e540cf010 2023-05-10T04:20:18.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.243+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e540cf560 con 0x7f4e540cf010 2023-05-10T04:20:18.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.244+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5415c960 con 0x7f4e540cf010 2023-05-10T04:20:18.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.244+0000 7f4e4a7fc700 1 -- 172.21.15.132:0/4203128240 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4e50003a20 con 0x7f4e540cf010 2023-05-10T04:20:18.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.245+0000 7f4e4a7fc700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4e3806ace0 0x7f4e3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.245+0000 7f4e4a7fc700 1 -- 172.21.15.132:0/4203128240 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4e50088b30 con 0x7f4e540cf010 2023-05-10T04:20:18.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.246+0000 7f4e5919a700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4e3806ace0 0x7f4e3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.246+0000 7f4e5919a700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4e3806ace0 0x7f4e3806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e44000c00 tx=0x7f4e44007990 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:18.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.250+0000 7f4e4a7fc700 1 -- 172.21.15.132:0/4203128240 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4e50053860 con 0x7f4e540cf010 2023-05-10T04:20:18.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.446+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e5414ab00 con 0x7f4e540cf010 2023-05-10T04:20:18.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.446+0000 7f4e4a7fc700 1 -- 172.21.15.132:0/4203128240 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e5414ab00 con 0x7f4e540cf010 2023-05-10T04:20:18.448 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:18.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4e3806ace0 msgr2=0x7f4e3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4e3806ace0 0x7f4e3806d190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4e44000c00 tx=0x7f4e44007990 comp rx=0 tx=0).stop 2023-05-10T04:20:18.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cf010 msgr2=0x7f4e5414a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cf010 0x7f4e5414a470 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4e5000c450 tx=0x7f4e5000c810 comp rx=0 tx=0).stop 2023-05-10T04:20:18.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 shutdown_connections 2023-05-10T04:20:18.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4e3806ace0 0x7f4e3806d190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4e5415c590 0x7f4e540c8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e540cf010 0x7f4e5414a470 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 --2- 172.21.15.132:0/4203128240 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4e540cff50 0x7f4e540b7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.448+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 >> 172.21.15.132:0/4203128240 conn(0x7f4e54071b10 msgr2=0x7f4e540b3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:18.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.449+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 shutdown_connections 2023-05-10T04:20:18.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.449+0000 7f4e5bbff700 1 -- 172.21.15.132:0/4203128240 wait complete. 2023-05-10T04:20:18.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:18.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.653+0000 7f5d3edff700 1 Processor -- start 2023-05-10T04:20:18.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.653+0000 7f5d3edff700 1 -- start start 2023-05-10T04:20:18.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d3edff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d381608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d3edff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5d380d1100 0x7f5d380d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d3edff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d380d0020 con 0x7f5d380b87a0 2023-05-10T04:20:18.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d3edff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380d02d0 con 0x7f5d380d1100 2023-05-10T04:20:18.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d3edff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380d0cb0 con 0x7f5d380cfbf0 2023-05-10T04:20:18.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d3cb9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5d380b87a0 0x7f5d381601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33888/0 (socket says 172.21.15.132:33888) 2023-05-10T04:20:18.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d3cb9b700 1 -- 172.21.15.132:0/21478241 learned_addr learned my addr 172.21.15.132:0/21478241 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:18.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d3d39c700 1 --2- 172.21.15.132:0/21478241 >> v2:172.21.15.132:3300/0 conn(0x7f5d380d1100 0x7f5d380d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.654+0000 7f5d37fff700 1 --2- 172.21.15.132:0/21478241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d381608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.655+0000 7f5d3d39c700 1 -- 172.21.15.132:0/21478241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 msgr2=0x7f5d381608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:18.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.655+0000 7f5d3d39c700 1 --2- 172.21.15.132:0/21478241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d381608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.655+0000 7f5d3d39c700 1 -- 172.21.15.132:0/21478241 >> v1:172.21.15.132:6789/0 conn(0x7f5d380b87a0 legacy=0x7f5d381601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.655+0000 7f5d3d39c700 1 -- 172.21.15.132:0/21478241 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d380cdc60 con 0x7f5d380d1100 2023-05-10T04:20:18.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.655+0000 7f5d3d39c700 1 --2- 172.21.15.132:0/21478241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380d1580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009d90 tx=0x7f5d3000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973bc528cd2d5f86 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:18.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.657+0000 7f5d377fe700 1 -- 172.21.15.132:0/21478241 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3000e070 con 0x7f5d380d1100 2023-05-10T04:20:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.657+0000 7f5d377fe700 1 -- 172.21.15.132:0/21478241 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d3000bb20 con 0x7f5d380d1100 2023-05-10T04:20:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.657+0000 7f5d377fe700 1 -- 172.21.15.132:0/21478241 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30012430 con 0x7f5d380d1100 2023-05-10T04:20:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.657+0000 7f5d3edff700 1 -- 172.21.15.132:0/21478241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 msgr2=0x7f5d380d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.657+0000 7f5d3edff700 1 --2- 172.21.15.132:0/21478241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380d1580 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009d90 tx=0x7f5d3000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.658+0000 7f5d3edff700 1 -- 172.21.15.132:0/21478241 shutdown_connections 2023-05-10T04:20:18.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.658+0000 7f5d3edff700 1 --2- 172.21.15.132:0/21478241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380d1580 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.658+0000 7f5d3edff700 1 --2- 172.21.15.132:0/21478241 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d381608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.658+0000 7f5d3edff700 1 -- 172.21.15.132:0/21478241 >> 172.21.15.132:0/21478241 conn(0x7f5d38071b10 msgr2=0x7f5d38071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.658+0000 7f5d3edff700 1 -- 172.21.15.132:0/21478241 shutdown_connections 2023-05-10T04:20:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.658+0000 7f5d3edff700 1 -- 172.21.15.132:0/21478241 wait complete. 2023-05-10T04:20:18.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.659+0000 7f5d3edff700 1 Processor -- start 2023-05-10T04:20:18.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.659+0000 7f5d3edff700 1 -- start start 2023-05-10T04:20:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.660+0000 7f5d3edff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380b87a0 0x7f5d381513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.660+0000 7f5d3edff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d380c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.660+0000 7f5d3edff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380cbc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.660+0000 7f5d3edff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380a9970 con 0x7f5d380d1100 2023-05-10T04:20:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.660+0000 7f5d3edff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380c8ae0 con 0x7f5d380b87a0 2023-05-10T04:20:18.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.660+0000 7f5d3edff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d380cc160 con 0x7f5d380cfbf0 2023-05-10T04:20:18.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.660+0000 7f5d3d39c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380cbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3d39c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380cbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45904/0 (socket says 172.21.15.132:45904) 2023-05-10T04:20:18.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3d39c700 1 -- 172.21.15.132:0/3125409598 learned_addr learned my addr 172.21.15.132:0/3125409598 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:18.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d37fff700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d380c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3cb9b700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380b87a0 0x7f5d381513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3d39c700 1 -- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 msgr2=0x7f5d380c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3d39c700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d380c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3d39c700 1 -- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380b87a0 msgr2=0x7f5d381513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3d39c700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380b87a0 0x7f5d381513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3d39c700 1 -- 172.21.15.132:0/3125409598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d30009a70 con 0x7f5d380d1100 2023-05-10T04:20:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d37fff700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d380c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:18.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3d39c700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380cbc20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5d30014040 tx=0x7f5d30004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d357fa700 1 -- 172.21.15.132:0/3125409598 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30012430 con 0x7f5d380d1100 2023-05-10T04:20:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d357fa700 1 -- 172.21.15.132:0/3125409598 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d30020070 con 0x7f5d380d1100 2023-05-10T04:20:18.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d380cd980 con 0x7f5d380d1100 2023-05-10T04:20:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.661+0000 7f5d357fa700 1 -- 172.21.15.132:0/3125409598 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30003ea0 con 0x7f5d380d1100 2023-05-10T04:20:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.662+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d380cd6a0 con 0x7f5d380d1100 2023-05-10T04:20:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.663+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d38160e30 con 0x7f5d380d1100 2023-05-10T04:20:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.663+0000 7f5d357fa700 1 -- 172.21.15.132:0/3125409598 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5d30004280 con 0x7f5d380d1100 2023-05-10T04:20:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.664+0000 7f5d357fa700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5d1c06ace0 0x7f5d1c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.665+0000 7f5d357fa700 1 -- 172.21.15.132:0/3125409598 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5d30022070 con 0x7f5d380d1100 2023-05-10T04:20:18.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.665+0000 7f5d3cb9b700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5d1c06ace0 0x7f5d1c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:18.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.665+0000 7f5d3cb9b700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5d1c06ace0 0x7f5d1c06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c005910 tx=0x7f5d2c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.668+0000 7f5d357fa700 1 -- 172.21.15.132:0/3125409598 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f5d300562f0 con 0x7f5d380d1100 2023-05-10T04:20:18.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.865+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5d38074430 con 0x7f5d380d1100 2023-05-10T04:20:18.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.865+0000 7f5d357fa700 1 -- 172.21.15.132:0/3125409598 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5d3002c020 con 0x7f5d380d1100 2023-05-10T04:20:18.867 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.867+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5d1c06ace0 msgr2=0x7f5d1c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.867+0000 7f5d3edff700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5d1c06ace0 0x7f5d1c06d190 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c005910 tx=0x7f5d2c009040 comp rx=0 tx=0).stop 2023-05-10T04:20:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.867+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 msgr2=0x7f5d380cbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.867+0000 7f5d3edff700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380cbc20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5d30014040 tx=0x7f5d30004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.867+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 shutdown_connections 2023-05-10T04:20:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.867+0000 7f5d3edff700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f5d1c06ace0 0x7f5d1c06d190 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.867+0000 7f5d3edff700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d380d1100 0x7f5d380cbc20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.867+0000 7f5d3edff700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f5d380b87a0 0x7f5d381513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.868+0000 7f5d3edff700 1 --2- 172.21.15.132:0/3125409598 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f5d380cfbf0 0x7f5d380c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:18.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.868+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 >> 172.21.15.132:0/3125409598 conn(0x7f5d38071b10 msgr2=0x7f5d380b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:18.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.868+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 shutdown_connections 2023-05-10T04:20:18.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:18.868+0000 7f5d3edff700 1 -- 172.21.15.132:0/3125409598 wait complete. 2023-05-10T04:20:18.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:19.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.071+0000 7f83459ff700 1 Processor -- start 2023-05-10T04:20:19.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.071+0000 7f83459ff700 1 -- start start 2023-05-10T04:20:19.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.072+0000 7f83459ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f834015a5a0 0x7f834006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.072+0000 7f83459ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f834006a920 0x7f8340070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.072+0000 7f83459ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83400cb280 con 0x7f8340071030 2023-05-10T04:20:19.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.072+0000 7f83459ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834006adc0 con 0x7f834006a920 2023-05-10T04:20:19.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.072+0000 7f83459ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834015a970 con 0x7f834015a5a0 2023-05-10T04:20:19.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.072+0000 7f833e7fc700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f834006a920 0x7f8340070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833e7fc700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f834006a920 0x7f8340070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45918/0 (socket says 172.21.15.132:45918) 2023-05-10T04:20:19.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833e7fc700 1 -- 172.21.15.132:0/2173329423 learned_addr learned my addr 172.21.15.132:0/2173329423 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:19.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833effd700 1 --2- 172.21.15.132:0/2173329423 >> v2:172.21.15.154:3300/0 conn(0x7f834015a5a0 0x7f834006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833e7fc700 1 -- 172.21.15.132:0/2173329423 >> v2:172.21.15.154:3300/0 conn(0x7f834015a5a0 msgr2=0x7f834006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:19.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833e7fc700 1 --2- 172.21.15.132:0/2173329423 >> v2:172.21.15.154:3300/0 conn(0x7f834015a5a0 0x7f834006a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833e7fc700 1 -- 172.21.15.132:0/2173329423 >> v1:172.21.15.154:6789/0 conn(0x7f8340071030 legacy=0x7f834015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833e7fc700 1 -- 172.21.15.132:0/2173329423 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8340071470 con 0x7f834006a920 2023-05-10T04:20:19.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833e7fc700 1 --2- 172.21.15.132:0/2173329423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f834006a920 0x7f8340070af0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8340067990 tx=0x7f8334009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ff22c2608998d96 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.073+0000 7f833dffb700 1 -- 172.21.15.132:0/2173329423 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334005e30 con 0x7f834006a920 2023-05-10T04:20:19.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f833dffb700 1 -- 172.21.15.132:0/2173329423 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8334004030 con 0x7f834006a920 2023-05-10T04:20:19.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f833dffb700 1 -- 172.21.15.132:0/2173329423 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83340043e0 con 0x7f834006a920 2023-05-10T04:20:19.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f83459ff700 1 -- 172.21.15.132:0/2173329423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f834006a920 msgr2=0x7f8340070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f83459ff700 1 --2- 172.21.15.132:0/2173329423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f834006a920 0x7f8340070af0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8340067990 tx=0x7f8334009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f83459ff700 1 -- 172.21.15.132:0/2173329423 shutdown_connections 2023-05-10T04:20:19.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f83459ff700 1 --2- 172.21.15.132:0/2173329423 >> v2:172.21.15.154:3300/0 conn(0x7f834015a5a0 0x7f834006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f83459ff700 1 --2- 172.21.15.132:0/2173329423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f834006a920 0x7f8340070af0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f83459ff700 1 -- 172.21.15.132:0/2173329423 >> 172.21.15.132:0/2173329423 conn(0x7f83400cf720 msgr2=0x7f83400cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:19.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f83459ff700 1 -- 172.21.15.132:0/2173329423 shutdown_connections 2023-05-10T04:20:19.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.074+0000 7f83459ff700 1 -- 172.21.15.132:0/2173329423 wait complete. 2023-05-10T04:20:19.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.076+0000 7f83459ff700 1 Processor -- start 2023-05-10T04:20:19.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.076+0000 7f83459ff700 1 -- start start 2023-05-10T04:20:19.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f83459ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f834006a920 0x7f834014f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f83459ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8340071030 0x7f83400b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f83459ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f834015a5a0 0x7f834015bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f83459ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834014f830 con 0x7f8340071030 2023-05-10T04:20:19.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f83459ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400b2970 con 0x7f834006a920 2023-05-10T04:20:19.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f83459ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400b2c10 con 0x7f834015a5a0 2023-05-10T04:20:19.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833e7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8340071030 0x7f83400b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833e7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8340071030 0x7f83400b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45934/0 (socket says 172.21.15.132:45934) 2023-05-10T04:20:19.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833e7fc700 1 -- 172.21.15.132:0/790765170 learned_addr learned my addr 172.21.15.132:0/790765170 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:19.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833effd700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f834006a920 0x7f834014f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833f7fe700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f834015a5a0 0x7f834015bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833e7fc700 1 -- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f834015a5a0 msgr2=0x7f834015bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833e7fc700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f834015a5a0 0x7f834015bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833e7fc700 1 -- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f834006a920 msgr2=0x7f834014f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.077+0000 7f833e7fc700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f834006a920 0x7f834014f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f833e7fc700 1 -- 172.21.15.132:0/790765170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8334009500 con 0x7f8340071030 2023-05-10T04:20:19.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f833effd700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f834006a920 0x7f834014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:19.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f833f7fe700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f834015a5a0 0x7f834015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:19.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f833e7fc700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8340071030 0x7f83400b4100 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8334000c00 tx=0x7f8334004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f8327fff700 1 -- 172.21.15.132:0/790765170 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334011620 con 0x7f8340071030 2023-05-10T04:20:19.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f8327fff700 1 -- 172.21.15.132:0/790765170 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8334011780 con 0x7f8340071030 2023-05-10T04:20:19.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f8327fff700 1 -- 172.21.15.132:0/790765170 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8334011b70 con 0x7f8340071030 2023-05-10T04:20:19.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83400719e0 con 0x7f8340071030 2023-05-10T04:20:19.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.078+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8340071700 con 0x7f8340071030 2023-05-10T04:20:19.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.079+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834006c6c0 con 0x7f8340071030 2023-05-10T04:20:19.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.080+0000 7f8327fff700 1 -- 172.21.15.132:0/790765170 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8334018070 con 0x7f8340071030 2023-05-10T04:20:19.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.081+0000 7f8327fff700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f832c06ace0 0x7f832c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.081+0000 7f8327fff700 1 -- 172.21.15.132:0/790765170 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8334089ff0 con 0x7f8340071030 2023-05-10T04:20:19.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.081+0000 7f833effd700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f832c06ace0 0x7f832c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.082+0000 7f833effd700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f832c06ace0 0x7f832c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f83400b4090 tx=0x7f8330008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.085+0000 7f8327fff700 1 -- 172.21.15.132:0/790765170 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8334054da0 con 0x7f8340071030 2023-05-10T04:20:19.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.281+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83401e2c90 con 0x7f8340071030 2023-05-10T04:20:19.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.281+0000 7f8327fff700 1 -- 172.21.15.132:0/790765170 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8334016020 con 0x7f8340071030 2023-05-10T04:20:19.283 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.283+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f832c06ace0 msgr2=0x7f832c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.283+0000 7f83459ff700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f832c06ace0 0x7f832c06d190 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f83400b4090 tx=0x7f8330008040 comp rx=0 tx=0).stop 2023-05-10T04:20:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.283+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8340071030 msgr2=0x7f83400b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.283+0000 7f83459ff700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8340071030 0x7f83400b4100 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8334000c00 tx=0x7f8334004750 comp rx=0 tx=0).stop 2023-05-10T04:20:19.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.284+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 shutdown_connections 2023-05-10T04:20:19.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.284+0000 7f83459ff700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f832c06ace0 0x7f832c06d190 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.284+0000 7f83459ff700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f834015a5a0 0x7f834015bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.284+0000 7f83459ff700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f834006a920 0x7f834014f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.284+0000 7f83459ff700 1 --2- 172.21.15.132:0/790765170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8340071030 0x7f83400b4100 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.284+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 >> 172.21.15.132:0/790765170 conn(0x7f83400cf720 msgr2=0x7f83400af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:19.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.284+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 shutdown_connections 2023-05-10T04:20:19.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.284+0000 7f83459ff700 1 -- 172.21.15.132:0/790765170 wait complete. 2023-05-10T04:20:19.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:19.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.488+0000 7f0d34fff700 1 Processor -- start 2023-05-10T04:20:19.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.488+0000 7f0d34fff700 1 -- start start 2023-05-10T04:20:19.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.489+0000 7f0d34fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d300cd760 0x7f0d300cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.489+0000 7f0d34fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d300cc9e0 con 0x7f0d300adf70 2023-05-10T04:20:19.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.489+0000 7f0d34fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d3015de20 con 0x7f0d3015cf10 2023-05-10T04:20:19.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.489+0000 7f0d34fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d300cd580 con 0x7f0d300cd760 2023-05-10T04:20:19.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.489+0000 7f0d2e59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d300cd760 0x7f0d300cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.489+0000 7f0d2e59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d300cd760 0x7f0d300cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45942/0 (socket says 172.21.15.132:45942) 2023-05-10T04:20:19.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.489+0000 7f0d2e59c700 1 -- 172.21.15.132:0/1676165070 learned_addr learned my addr 172.21.15.132:0/1676165070 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:19.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.489+0000 7f0d2dd9b700 1 --1- 172.21.15.132:0/1676165070 >> v1:172.21.15.132:6789/0 conn(0x7f0d300adf70 0x7f0d300cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33892/0 (socket says 172.21.15.132:33892) 2023-05-10T04:20:19.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.490+0000 7f0d2e59c700 1 -- 172.21.15.132:0/1676165070 >> v1:172.21.15.154:6789/0 conn(0x7f0d3015cf10 legacy=0x7f0d3006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:19.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.490+0000 7f0d2e59c700 1 -- 172.21.15.132:0/1676165070 >> v1:172.21.15.132:6789/0 conn(0x7f0d300adf70 legacy=0x7f0d300cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.490+0000 7f0d2e59c700 1 -- 172.21.15.132:0/1676165070 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d300ce070 con 0x7f0d300cd760 2023-05-10T04:20:19.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.490+0000 7f0d2d59a700 1 -- 172.21.15.132:0/1676165070 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1101506609 0 0) 0x7f0d300cc9e0 con 0x7f0d300adf70 2023-05-10T04:20:19.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.490+0000 7f0d2e59c700 1 --2- 172.21.15.132:0/1676165070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300cdb30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0d200098f0 tx=0x7f0d20009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de33348c6ed498a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.490+0000 7f0d2d59a700 1 -- 172.21.15.132:0/1676165070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d20004230 con 0x7f0d300cd760 2023-05-10T04:20:19.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.490+0000 7f0d2d59a700 1 -- 172.21.15.132:0/1676165070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d20004390 con 0x7f0d300cd760 2023-05-10T04:20:19.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.490+0000 7f0d2d59a700 1 -- 172.21.15.132:0/1676165070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200036a0 con 0x7f0d300cd760 2023-05-10T04:20:19.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.491+0000 7f0d34fff700 1 -- 172.21.15.132:0/1676165070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 msgr2=0x7f0d300cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.491+0000 7f0d34fff700 1 --2- 172.21.15.132:0/1676165070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300cdb30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0d200098f0 tx=0x7f0d20009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:19.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.491+0000 7f0d34fff700 1 -- 172.21.15.132:0/1676165070 shutdown_connections 2023-05-10T04:20:19.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.491+0000 7f0d34fff700 1 --2- 172.21.15.132:0/1676165070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300cdb30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.491+0000 7f0d34fff700 1 -- 172.21.15.132:0/1676165070 >> 172.21.15.132:0/1676165070 conn(0x7f0d300cf720 msgr2=0x7f0d300cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:19.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.491+0000 7f0d34fff700 1 -- 172.21.15.132:0/1676165070 shutdown_connections 2023-05-10T04:20:19.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.491+0000 7f0d34fff700 1 -- 172.21.15.132:0/1676165070 wait complete. 2023-05-10T04:20:19.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.493+0000 7f0d34fff700 1 Processor -- start 2023-05-10T04:20:19.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.493+0000 7f0d34fff700 1 -- start start 2023-05-10T04:20:19.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d34fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d300adf70 0x7f0d301f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d34fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300c2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d34fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d3015cf10 0x7f0d301572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d34fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d30152650 con 0x7f0d300cd760 2023-05-10T04:20:19.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d34fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d301f2540 con 0x7f0d3015cf10 2023-05-10T04:20:19.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d34fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300b1a60 con 0x7f0d300adf70 2023-05-10T04:20:19.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300c2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45946/0 (socket says 172.21.15.132:45946) 2023-05-10T04:20:19.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 -- 172.21.15.132:0/4180165472 learned_addr learned my addr 172.21.15.132:0/4180165472 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:19.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2e59c700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d300adf70 0x7f0d301f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2ed9d700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d3015cf10 0x7f0d301572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 -- 172.21.15.132:0/4180165472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d300adf70 msgr2=0x7f0d301f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d300adf70 0x7f0d301f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 -- 172.21.15.132:0/4180165472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d3015cf10 msgr2=0x7f0d301572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d3015cf10 0x7f0d301572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 -- 172.21.15.132:0/4180165472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d20009550 con 0x7f0d300cd760 2023-05-10T04:20:19.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.494+0000 7f0d2dd9b700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300c2670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c520 tx=0x7f0d2400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.495+0000 7f0d1effd700 1 -- 172.21.15.132:0/4180165472 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d240074e0 con 0x7f0d300cd760 2023-05-10T04:20:19.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.495+0000 7f0d1effd700 1 -- 172.21.15.132:0/4180165472 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d24007640 con 0x7f0d300cd760 2023-05-10T04:20:19.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.495+0000 7f0d1effd700 1 -- 172.21.15.132:0/4180165472 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d24005a50 con 0x7f0d300cd760 2023-05-10T04:20:19.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.495+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d3015db40 con 0x7f0d300cd760 2023-05-10T04:20:19.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.495+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3015d860 con 0x7f0d300cd760 2023-05-10T04:20:19.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.496+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d300cc670 con 0x7f0d300cd760 2023-05-10T04:20:19.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.497+0000 7f0d1effd700 1 -- 172.21.15.132:0/4180165472 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0d24005bb0 con 0x7f0d300cd760 2023-05-10T04:20:19.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.498+0000 7f0d1effd700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d1006ad10 0x7f0d1006d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.498+0000 7f0d1effd700 1 -- 172.21.15.132:0/4180165472 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0d24088e30 con 0x7f0d300cd760 2023-05-10T04:20:19.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.498+0000 7f0d2e59c700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d1006ad10 0x7f0d1006d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.499+0000 7f0d2e59c700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d1006ad10 0x7f0d1006d1c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009130 tx=0x7f0d20008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.502+0000 7f0d1effd700 1 -- 172.21.15.132:0/4180165472 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0d24053ac0 con 0x7f0d300cd760 2023-05-10T04:20:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.700+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0d30071b50 con 0x7f0d300cd760 2023-05-10T04:20:19.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.700+0000 7f0d1effd700 1 -- 172.21.15.132:0/4180165472 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0d24017070 con 0x7f0d300cd760 2023-05-10T04:20:19.703 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:19.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d1006ad10 msgr2=0x7f0d1006d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d1006ad10 0x7f0d1006d1c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009130 tx=0x7f0d20008030 comp rx=0 tx=0).stop 2023-05-10T04:20:19.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 msgr2=0x7f0d300c2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300c2670 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0d2400c520 tx=0x7f0d2400c8e0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 shutdown_connections 2023-05-10T04:20:19.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0d1006ad10 0x7f0d1006d1c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0d3015cf10 0x7f0d301572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0d300adf70 0x7f0d301f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 --2- 172.21.15.132:0/4180165472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d300cd760 0x7f0d300c2670 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 >> 172.21.15.132:0/4180165472 conn(0x7f0d300cf720 msgr2=0x7f0d300cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:19.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 shutdown_connections 2023-05-10T04:20:19.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.703+0000 7f0d34fff700 1 -- 172.21.15.132:0/4180165472 wait complete. 2023-05-10T04:20:19.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:19.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.906+0000 7f4ed51ff700 1 Processor -- start 2023-05-10T04:20:19.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.906+0000 7f4ed51ff700 1 -- start start 2023-05-10T04:20:19.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.907+0000 7f4ed51ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ed00cf010 0x7f4ed0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.907+0000 7f4ed51ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4ed00cff50 0x7f4ed00d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.907+0000 7f4ed51ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ed00cd520 con 0x7f4ed015c590 2023-05-10T04:20:19.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.907+0000 7f4ed51ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed00d2640 con 0x7f4ed00cf010 2023-05-10T04:20:19.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.907+0000 7f4ed51ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ed01610d0 con 0x7f4ed00cff50 2023-05-10T04:20:19.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4ec7fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ed00cf010 0x7f4ed0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4eced9d700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4ed015c590 0x7f4ed00cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33898/0 (socket says 172.21.15.132:33898) 2023-05-10T04:20:19.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4eced9d700 1 -- 172.21.15.132:0/2678041280 learned_addr learned my addr 172.21.15.132:0/2678041280 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:19.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4ecf59e700 1 --2- 172.21.15.132:0/2678041280 >> v2:172.21.15.154:3300/0 conn(0x7f4ed00cff50 0x7f4ed00d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4ec7fff700 1 -- 172.21.15.132:0/2678041280 >> v2:172.21.15.154:3300/0 conn(0x7f4ed00cff50 msgr2=0x7f4ed00d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:19.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4ec7fff700 1 --2- 172.21.15.132:0/2678041280 >> v2:172.21.15.154:3300/0 conn(0x7f4ed00cff50 0x7f4ed00d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4ec7fff700 1 -- 172.21.15.132:0/2678041280 >> v1:172.21.15.132:6789/0 conn(0x7f4ed015c590 legacy=0x7f4ed00cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4ec7fff700 1 -- 172.21.15.132:0/2678041280 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed00b23c0 con 0x7f4ed00cf010 2023-05-10T04:20:19.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4ece59c700 1 -- 172.21.15.132:0/2678041280 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716646817 0 0) 0x7f4ed00cd520 con 0x7f4ed015c590 2023-05-10T04:20:19.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.908+0000 7f4ec7fff700 1 --2- 172.21.15.132:0/2678041280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed00cf010 0x7f4ed0160b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00b20b0 tx=0x7f4eb8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc3b4e5542730db server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ece59c700 1 -- 172.21.15.132:0/2678041280 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8011830 con 0x7f4ed00cf010 2023-05-10T04:20:19.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ece59c700 1 -- 172.21.15.132:0/2678041280 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb8011990 con 0x7f4ed00cf010 2023-05-10T04:20:19.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ece59c700 1 -- 172.21.15.132:0/2678041280 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8011d20 con 0x7f4ed00cf010 2023-05-10T04:20:19.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ed51ff700 1 -- 172.21.15.132:0/2678041280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed00cf010 msgr2=0x7f4ed0160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/2678041280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed00cf010 0x7f4ed0160b90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4ed00b20b0 tx=0x7f4eb8009b20 comp rx=0 tx=0).stop 2023-05-10T04:20:19.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ed51ff700 1 -- 172.21.15.132:0/2678041280 shutdown_connections 2023-05-10T04:20:19.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/2678041280 >> v2:172.21.15.154:3300/0 conn(0x7f4ed00cff50 0x7f4ed00d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/2678041280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed00cf010 0x7f4ed0160b90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ed51ff700 1 -- 172.21.15.132:0/2678041280 >> 172.21.15.132:0/2678041280 conn(0x7f4ed0071b10 msgr2=0x7f4ed0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:19.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ed51ff700 1 -- 172.21.15.132:0/2678041280 shutdown_connections 2023-05-10T04:20:19.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.909+0000 7f4ed51ff700 1 -- 172.21.15.132:0/2678041280 wait complete. 2023-05-10T04:20:19.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.911+0000 7f4ed51ff700 1 Processor -- start 2023-05-10T04:20:19.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.911+0000 7f4ed51ff700 1 -- start start 2023-05-10T04:20:19.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.912+0000 7f4ed51ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed00cf010 0x7f4ed0155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.912+0000 7f4ed51ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed00cff50 0x7f4ed00c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.912+0000 7f4ed51ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed015c590 0x7f4ed0154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.912+0000 7f4ed51ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00c8520 con 0x7f4ed015c590 2023-05-10T04:20:19.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.912+0000 7f4ed51ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00c8800 con 0x7f4ed00cff50 2023-05-10T04:20:19.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.912+0000 7f4ed51ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ed00c8ae0 con 0x7f4ed00cf010 2023-05-10T04:20:19.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.912+0000 7f4ecf59e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed015c590 0x7f4ed0154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.912+0000 7f4ecf59e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed015c590 0x7f4ed0154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45954/0 (socket says 172.21.15.132:45954) 2023-05-10T04:20:19.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ecf59e700 1 -- 172.21.15.132:0/4207313957 learned_addr learned my addr 172.21.15.132:0/4207313957 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:19.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4eced9d700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed00cf010 0x7f4ed0155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ec7fff700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed00cff50 0x7f4ed00c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ecf59e700 1 -- 172.21.15.132:0/4207313957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed00cf010 msgr2=0x7f4ed0155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ecf59e700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed00cf010 0x7f4ed0155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ecf59e700 1 -- 172.21.15.132:0/4207313957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed00cff50 msgr2=0x7f4ed00c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:19.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ecf59e700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed00cff50 0x7f4ed00c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:19.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ecf59e700 1 -- 172.21.15.132:0/4207313957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80094a0 con 0x7f4ed015c590 2023-05-10T04:20:19.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ecf59e700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed015c590 0x7f4ed0154aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8007e40 tx=0x7f4ec800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ec77fe700 1 -- 172.21.15.132:0/4207313957 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec800ed30 con 0x7f4ed015c590 2023-05-10T04:20:19.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ec77fe700 1 -- 172.21.15.132:0/4207313957 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec8014420 con 0x7f4ed015c590 2023-05-10T04:20:19.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed00cd770 con 0x7f4ed015c590 2023-05-10T04:20:19.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.913+0000 7f4ec77fe700 1 -- 172.21.15.132:0/4207313957 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec80147d0 con 0x7f4ed015c590 2023-05-10T04:20:19.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.914+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed00cf560 con 0x7f4ed015c590 2023-05-10T04:20:19.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.915+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ed015c960 con 0x7f4ed015c590 2023-05-10T04:20:19.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.915+0000 7f4ec77fe700 1 -- 172.21.15.132:0/4207313957 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4ec8014930 con 0x7f4ed015c590 2023-05-10T04:20:19.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.916+0000 7f4ec77fe700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4eb006ace0 0x7f4eb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:19.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.916+0000 7f4ec77fe700 1 -- 172.21.15.132:0/4207313957 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4ec8089e70 con 0x7f4ed015c590 2023-05-10T04:20:19.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.917+0000 7f4eced9d700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4eb006ace0 0x7f4eb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:19.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.917+0000 7f4eced9d700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4eb006ace0 0x7f4eb006d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0007fd0 tx=0x7f4ec0007de0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:19.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:19.921+0000 7f4ec77fe700 1 -- 172.21.15.132:0/4207313957 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4ec8054cd0 con 0x7f4ed015c590 2023-05-10T04:20:20.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.114+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4ed00b51f0 con 0x7f4ed015c590 2023-05-10T04:20:20.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.115+0000 7f4ec77fe700 1 -- 172.21.15.132:0/4207313957 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4ec80582f0 con 0x7f4ed015c590 2023-05-10T04:20:20.117 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:20.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4eb006ace0 msgr2=0x7f4eb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4eb006ace0 0x7f4eb006d190 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0007fd0 tx=0x7f4ec0007de0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed015c590 msgr2=0x7f4ed0154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed015c590 0x7f4ed0154aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8007e40 tx=0x7f4ec800e3c0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 shutdown_connections 2023-05-10T04:20:20.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4eb006ace0 0x7f4eb006d190 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ed015c590 0x7f4ed0154aa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ed00cf010 0x7f4ed0155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 --2- 172.21.15.132:0/4207313957 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4ed00cff50 0x7f4ed00c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 >> 172.21.15.132:0/4207313957 conn(0x7f4ed0071b10 msgr2=0x7f4ed00d2ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:20.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 shutdown_connections 2023-05-10T04:20:20.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.117+0000 7f4ed51ff700 1 -- 172.21.15.132:0/4207313957 wait complete. 2023-05-10T04:20:20.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:20:20.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.319+0000 7f14a15ff700 1 Processor -- start 2023-05-10T04:20:20.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.319+0000 7f14a15ff700 1 -- start start 2023-05-10T04:20:20.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.320+0000 7f14a15ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c0cd760 0x7f149c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.320+0000 7f14a15ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c0cc9e0 con 0x7f149c0adf70 2023-05-10T04:20:20.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.320+0000 7f14a15ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149c15de20 con 0x7f149c15cf10 2023-05-10T04:20:20.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.320+0000 7f14a15ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0cd580 con 0x7f149c0cd760 2023-05-10T04:20:20.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.320+0000 7f149a7fc700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f149c0adf70 0x7f149c0cce70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33902/0 (socket says 172.21.15.132:33902) 2023-05-10T04:20:20.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.320+0000 7f149a7fc700 1 -- 172.21.15.132:0/265467357 learned_addr learned my addr 172.21.15.132:0/265467357 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:20.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f149affd700 1 --2- 172.21.15.132:0/265467357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c0cd760 0x7f149c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f1499ffb700 1 -- 172.21.15.132:0/265467357 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316821206 0 0) 0x7f149c0cc9e0 con 0x7f149c0adf70 2023-05-10T04:20:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f1499ffb700 1 -- 172.21.15.132:0/265467357 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14840035b0 con 0x7f149c0adf70 2023-05-10T04:20:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f1499ffb700 1 -- 172.21.15.132:0/265467357 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910801090 0 0) 0x7f149c15de20 con 0x7f149c15cf10 2023-05-10T04:20:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f1499ffb700 1 -- 172.21.15.132:0/265467357 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f149c0cc9e0 con 0x7f149c15cf10 2023-05-10T04:20:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f1499ffb700 1 -- 172.21.15.132:0/265467357 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3517806986 0 0) 0x7f14840035b0 con 0x7f149c0adf70 2023-05-10T04:20:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f149affd700 1 -- 172.21.15.132:0/265467357 >> v1:172.21.15.154:6789/0 conn(0x7f149c15cf10 legacy=0x7f149c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f149affd700 1 -- 172.21.15.132:0/265467357 >> v1:172.21.15.132:6789/0 conn(0x7f149c0adf70 legacy=0x7f149c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.321+0000 7f149affd700 1 -- 172.21.15.132:0/265467357 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c0ce070 con 0x7f149c0cd760 2023-05-10T04:20:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f149affd700 1 --2- 172.21.15.132:0/265467357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c0cd760 0x7f149c0cdb30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f148c009870 tx=0x7f148c009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed08525dc6916ccc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:20.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f1499ffb700 1 -- 172.21.15.132:0/265467357 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14900017f0 con 0x7f149c0cd760 2023-05-10T04:20:20.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f1499ffb700 1 -- 172.21.15.132:0/265467357 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c004030 con 0x7f149c0cd760 2023-05-10T04:20:20.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f1499ffb700 1 -- 172.21.15.132:0/265467357 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0043c0 con 0x7f149c0cd760 2023-05-10T04:20:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f14a15ff700 1 -- 172.21.15.132:0/265467357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c0cd760 msgr2=0x7f149c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f14a15ff700 1 --2- 172.21.15.132:0/265467357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c0cd760 0x7f149c0cdb30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f148c009870 tx=0x7f148c009b80 comp rx=0 tx=0).stop 2023-05-10T04:20:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f14a15ff700 1 -- 172.21.15.132:0/265467357 shutdown_connections 2023-05-10T04:20:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f14a15ff700 1 --2- 172.21.15.132:0/265467357 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c0cd760 0x7f149c0cdb30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f14a15ff700 1 -- 172.21.15.132:0/265467357 >> 172.21.15.132:0/265467357 conn(0x7f149c0cf720 msgr2=0x7f149c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f14a15ff700 1 -- 172.21.15.132:0/265467357 shutdown_connections 2023-05-10T04:20:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.322+0000 7f14a15ff700 1 -- 172.21.15.132:0/265467357 wait complete. 2023-05-10T04:20:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.324+0000 7f14a15ff700 1 Processor -- start 2023-05-10T04:20:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.324+0000 7f14a15ff700 1 -- start start 2023-05-10T04:20:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f14a15ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f149c0adf70 0x7f149c0c76d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f14a15ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f149c0cd760 0x7f149c14b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f14a15ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c15cf10 0x7f149c0c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f14a15ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c14e710 con 0x7f149c0cd760 2023-05-10T04:20:20.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f14a15ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c0c7c10 con 0x7f149c0adf70 2023-05-10T04:20:20.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f14a15ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149c06c6c0 con 0x7f149c15cf10 2023-05-10T04:20:20.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f149a7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f149c0cd760 0x7f149c14b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f149a7fc700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f149c0cd760 0x7f149c14b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45966/0 (socket says 172.21.15.132:45966) 2023-05-10T04:20:20.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f149a7fc700 1 -- 172.21.15.132:0/462560811 learned_addr learned my addr 172.21.15.132:0/462560811 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:20.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.325+0000 7f149affd700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f149c0adf70 0x7f149c0c76d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f149b7fe700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c15cf10 0x7f149c0c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f149a7fc700 1 -- 172.21.15.132:0/462560811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c15cf10 msgr2=0x7f149c0c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f149a7fc700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c15cf10 0x7f149c0c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f149a7fc700 1 -- 172.21.15.132:0/462560811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f149c0adf70 msgr2=0x7f149c0c76d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f149a7fc700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f149c0adf70 0x7f149c0c76d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f149a7fc700 1 -- 172.21.15.132:0/462560811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0094a0 con 0x7f149c0cd760 2023-05-10T04:20:20.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f149a7fc700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f149c0cd760 0x7f149c14b610 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f149000c4d0 tx=0x7f149000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:20.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f14837fe700 1 -- 172.21.15.132:0/462560811 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14900074e0 con 0x7f149c0cd760 2023-05-10T04:20:20.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f14837fe700 1 -- 172.21.15.132:0/462560811 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490007660 con 0x7f149c0cd760 2023-05-10T04:20:20.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c15db40 con 0x7f149c0cd760 2023-05-10T04:20:20.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f14837fe700 1 -- 172.21.15.132:0/462560811 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490005a70 con 0x7f149c0cd760 2023-05-10T04:20:20.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.326+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c15d860 con 0x7f149c0cd760 2023-05-10T04:20:20.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.327+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c0cc670 con 0x7f149c0cd760 2023-05-10T04:20:20.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.328+0000 7f14837fe700 1 -- 172.21.15.132:0/462560811 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1490005bd0 con 0x7f149c0cd760 2023-05-10T04:20:20.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.329+0000 7f14837fe700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f148806ad10 0x7f148806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.329+0000 7f14837fe700 1 -- 172.21.15.132:0/462560811 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1490088d10 con 0x7f149c0cd760 2023-05-10T04:20:20.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.329+0000 7f149affd700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f148806ad10 0x7f148806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.330+0000 7f149affd700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f148806ad10 0x7f148806d1c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f148c0090b0 tx=0x7f148c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:20.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.334+0000 7f14837fe700 1 -- 172.21.15.132:0/462560811 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f149008e020 con 0x7f149c0cd760 2023-05-10T04:20:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.543+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f149c071690 con 0x7f149c0cd760 2023-05-10T04:20:20.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.543+0000 7f14837fe700 1 -- 172.21.15.132:0/462560811 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1490017070 con 0x7f149c0cd760 2023-05-10T04:20:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f148806ad10 msgr2=0x7f148806d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f148806ad10 0x7f148806d1c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f148c0090b0 tx=0x7f148c008030 comp rx=0 tx=0).stop 2023-05-10T04:20:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f149c0cd760 msgr2=0x7f149c14b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f149c0cd760 0x7f149c14b610 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f149000c4d0 tx=0x7f149000c7e0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 shutdown_connections 2023-05-10T04:20:20.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f148806ad10 0x7f148806d1c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f149c15cf10 0x7f149c0c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f149c0adf70 0x7f149c0c76d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 --2- 172.21.15.132:0/462560811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f149c0cd760 0x7f149c14b610 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 >> 172.21.15.132:0/462560811 conn(0x7f149c0cf720 msgr2=0x7f149c06a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 shutdown_connections 2023-05-10T04:20:20.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.546+0000 7f14a15ff700 1 -- 172.21.15.132:0/462560811 wait complete. 2023-05-10T04:20:20.550 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:20:20.565 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:20:20.566 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:20.610 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.792+0000 7f2b4a1ff700 1 Processor -- start 2023-05-10T04:20:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.792+0000 7f2b4a1ff700 1 -- start start 2023-05-10T04:20:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.793+0000 7f2b4a1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f2b440d2110 0x7f2b44167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.793+0000 7f2b4a1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b44161000 con 0x7f2b440b87a0 2023-05-10T04:20:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.793+0000 7f2b4a1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b440d0020 con 0x7f2b440cfbf0 2023-05-10T04:20:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.793+0000 7f2b4a1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b440d02d0 con 0x7f2b440d2110 2023-05-10T04:20:20.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b437fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2b440b87a0 0x7f2b441601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33904/0 (socket says 172.21.15.132:33904) 2023-05-10T04:20:20.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b437fe700 1 -- 172.21.15.132:0/3509446146 learned_addr learned my addr 172.21.15.132:0/3509446146 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:20.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b43fff700 1 --2- 172.21.15.132:0/3509446146 >> v2:172.21.15.154:3300/0 conn(0x7f2b440d2110 0x7f2b44167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b427fc700 1 -- 172.21.15.132:0/3509446146 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1379509538 0 0) 0x7f2b44161000 con 0x7f2b440b87a0 2023-05-10T04:20:20.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b427fc700 1 -- 172.21.15.132:0/3509446146 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b2c0035b0 con 0x7f2b440b87a0 2023-05-10T04:20:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b427fc700 1 -- 172.21.15.132:0/3509446146 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1678526140 0 0) 0x7f2b2c0035b0 con 0x7f2b440b87a0 2023-05-10T04:20:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b43fff700 1 -- 172.21.15.132:0/3509446146 >> v1:172.21.15.154:6789/0 conn(0x7f2b440cfbf0 legacy=0x7f2b441608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b43fff700 1 -- 172.21.15.132:0/3509446146 >> v1:172.21.15.132:6789/0 conn(0x7f2b440b87a0 legacy=0x7f2b441601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.794+0000 7f2b43fff700 1 -- 172.21.15.132:0/3509446146 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b440cdc60 con 0x7f2b440d2110 2023-05-10T04:20:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b43fff700 1 --2- 172.21.15.132:0/3509446146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440d2110 0x7f2b44167550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009d90 tx=0x7f2b3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49e11e808dafe506 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b427fc700 1 -- 172.21.15.132:0/3509446146 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b3c00e070 con 0x7f2b440d2110 2023-05-10T04:20:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b427fc700 1 -- 172.21.15.132:0/3509446146 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b3c003a20 con 0x7f2b440d2110 2023-05-10T04:20:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b427fc700 1 -- 172.21.15.132:0/3509446146 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b34001670 con 0x7f2b440d2110 2023-05-10T04:20:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/3509446146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440d2110 msgr2=0x7f2b44167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b4a1ff700 1 --2- 172.21.15.132:0/3509446146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440d2110 0x7f2b44167550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009d90 tx=0x7f2b3c00b330 comp rx=0 tx=0).stop 2023-05-10T04:20:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/3509446146 shutdown_connections 2023-05-10T04:20:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b4a1ff700 1 --2- 172.21.15.132:0/3509446146 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440d2110 0x7f2b44167550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.795+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/3509446146 >> 172.21.15.132:0/3509446146 conn(0x7f2b44071b10 msgr2=0x7f2b44071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.796+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/3509446146 shutdown_connections 2023-05-10T04:20:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.796+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/3509446146 wait complete. 2023-05-10T04:20:20.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.797+0000 7f2b4a1ff700 1 Processor -- start 2023-05-10T04:20:20.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.797+0000 7f2b4a1ff700 1 -- start start 2023-05-10T04:20:20.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.798+0000 7f2b4a1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440b87a0 0x7f2b440b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.798+0000 7f2b4a1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b440cfbf0 0x7f2b4415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.798+0000 7f2b4a1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b440d2110 0x7f2b4415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.798+0000 7f2b4a1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44152e50 con 0x7f2b440cfbf0 2023-05-10T04:20:20.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.798+0000 7f2b4a1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44152090 con 0x7f2b440b87a0 2023-05-10T04:20:20.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.798+0000 7f2b4a1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b44152370 con 0x7f2b440d2110 2023-05-10T04:20:20.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b440cfbf0 0x7f2b4415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b440cfbf0 0x7f2b4415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45970/0 (socket says 172.21.15.132:45970) 2023-05-10T04:20:20.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 -- 172.21.15.132:0/1733413916 learned_addr learned my addr 172.21.15.132:0/1733413916 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:20.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b437fe700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440b87a0 0x7f2b440b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b43fff700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b440d2110 0x7f2b4415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 -- 172.21.15.132:0/1733413916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b440d2110 msgr2=0x7f2b4415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b440d2110 0x7f2b4415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 -- 172.21.15.132:0/1733413916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440b87a0 msgr2=0x7f2b440b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:20.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440b87a0 0x7f2b440b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:20.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 -- 172.21.15.132:0/1733413916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b3c009a70 con 0x7f2b440cfbf0 2023-05-10T04:20:20.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b42ffd700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b440cfbf0 0x7f2b4415cce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c4e0 tx=0x7f2b3800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:20.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.799+0000 7f2b2bfff700 1 -- 172.21.15.132:0/1733413916 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380052d0 con 0x7f2b440cfbf0 2023-05-10T04:20:20.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.800+0000 7f2b2bfff700 1 -- 172.21.15.132:0/1733413916 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b38005430 con 0x7f2b440cfbf0 2023-05-10T04:20:20.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.800+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b440cd980 con 0x7f2b440cfbf0 2023-05-10T04:20:20.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.800+0000 7f2b2bfff700 1 -- 172.21.15.132:0/1733413916 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b380038c0 con 0x7f2b440cfbf0 2023-05-10T04:20:20.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.800+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b440cd6a0 con 0x7f2b440cfbf0 2023-05-10T04:20:20.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.801+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b44167a90 con 0x7f2b440cfbf0 2023-05-10T04:20:20.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.802+0000 7f2b2bfff700 1 -- 172.21.15.132:0/1733413916 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2b38003a20 con 0x7f2b440cfbf0 2023-05-10T04:20:20.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.802+0000 7f2b2bfff700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b3006ace0 0x7f2b3006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:20.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.803+0000 7f2b2bfff700 1 -- 172.21.15.132:0/1733413916 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2b38088b80 con 0x7f2b440cfbf0 2023-05-10T04:20:20.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.803+0000 7f2b437fe700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b3006ace0 0x7f2b3006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:20.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.803+0000 7f2b437fe700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b3006ace0 0x7f2b3006d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2b340011e0 tx=0x7f2b34001da0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:20.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:20.807+0000 7f2b2bfff700 1 -- 172.21.15.132:0/1733413916 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2b380538a0 con 0x7f2b440cfbf0 2023-05-10T04:20:21.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.005+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b440b52f0 con 0x7f2b440cfbf0 2023-05-10T04:20:21.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.007+0000 7f2b2bfff700 1 -- 172.21.15.132:0/1733413916 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f2b38056ec0 con 0x7f2b440cfbf0 2023-05-10T04:20:21.009 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:21.009 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:21.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b3006ace0 msgr2=0x7f2b3006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b3006ace0 0x7f2b3006d190 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2b340011e0 tx=0x7f2b34001da0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b440cfbf0 msgr2=0x7f2b4415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b440cfbf0 0x7f2b4415cce0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2b3800c4e0 tx=0x7f2b3800c7f0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 shutdown_connections 2023-05-10T04:20:21.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2b3006ace0 0x7f2b3006d190 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2b440d2110 0x7f2b4415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2b440b87a0 0x7f2b440b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 --2- 172.21.15.132:0/1733413916 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b440cfbf0 0x7f2b4415cce0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 >> 172.21.15.132:0/1733413916 conn(0x7f2b44071b10 msgr2=0x7f2b440b6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:21.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.009+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 shutdown_connections 2023-05-10T04:20:21.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.010+0000 7f2b4a1ff700 1 -- 172.21.15.132:0/1733413916 wait complete. 2023-05-10T04:20:21.029 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:21.030 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:21.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.214+0000 7f7a223ff700 1 Processor -- start 2023-05-10T04:20:21.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.214+0000 7f7a223ff700 1 -- start start 2023-05-10T04:20:21.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.215+0000 7f7a223ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f7a1c15c590 0x7f7a1c160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.215+0000 7f7a223ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0cd520 con 0x7f7a1c0cff50 2023-05-10T04:20:21.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.215+0000 7f7a223ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1c0d2640 con 0x7f7a1c0cf010 2023-05-10T04:20:21.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.215+0000 7f7a223ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a1c1610d0 con 0x7f7a1c15c590 2023-05-10T04:20:21.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a2099c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7a1c0cff50 0x7f7a1c0d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33916/0 (socket says 172.21.15.132:33916) 2023-05-10T04:20:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a2099c700 1 -- 172.21.15.132:0/1482297283 learned_addr learned my addr 172.21.15.132:0/1482297283 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a1bfff700 1 --2- 172.21.15.132:0/1482297283 >> v2:172.21.15.154:3300/0 conn(0x7f7a1c15c590 0x7f7a1c160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a1affd700 1 -- 172.21.15.132:0/1482297283 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 145132783 0 0) 0x7f7a1c0cd520 con 0x7f7a1c0cff50 2023-05-10T04:20:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a1affd700 1 -- 172.21.15.132:0/1482297283 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a040035b0 con 0x7f7a1c0cff50 2023-05-10T04:20:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a1affd700 1 -- 172.21.15.132:0/1482297283 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3137431093 0 0) 0x7f7a040035b0 con 0x7f7a1c0cff50 2023-05-10T04:20:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a1bfff700 1 -- 172.21.15.132:0/1482297283 >> v1:172.21.15.154:6789/0 conn(0x7f7a1c0cf010 legacy=0x7f7a1c0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a1bfff700 1 -- 172.21.15.132:0/1482297283 >> v1:172.21.15.132:6789/0 conn(0x7f7a1c0cff50 legacy=0x7f7a1c0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.216+0000 7f7a1bfff700 1 -- 172.21.15.132:0/1482297283 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c0b23c0 con 0x7f7a1c15c590 2023-05-10T04:20:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a1bfff700 1 --2- 172.21.15.132:0/1482297283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15c590 0x7f7a1c160b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009840 tx=0x7f7a0c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5291290ca5f89e67 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a1affd700 1 -- 172.21.15.132:0/1482297283 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140019f0 con 0x7f7a1c15c590 2023-05-10T04:20:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a1affd700 1 -- 172.21.15.132:0/1482297283 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a0c004030 con 0x7f7a1c15c590 2023-05-10T04:20:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a1affd700 1 -- 172.21.15.132:0/1482297283 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0043c0 con 0x7f7a1c15c590 2023-05-10T04:20:21.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a223ff700 1 -- 172.21.15.132:0/1482297283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15c590 msgr2=0x7f7a1c160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a223ff700 1 --2- 172.21.15.132:0/1482297283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15c590 0x7f7a1c160b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c009840 tx=0x7f7a0c009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:21.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a223ff700 1 -- 172.21.15.132:0/1482297283 shutdown_connections 2023-05-10T04:20:21.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a223ff700 1 --2- 172.21.15.132:0/1482297283 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c15c590 0x7f7a1c160b90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.217+0000 7f7a223ff700 1 -- 172.21.15.132:0/1482297283 >> 172.21.15.132:0/1482297283 conn(0x7f7a1c071b10 msgr2=0x7f7a1c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.218+0000 7f7a223ff700 1 -- 172.21.15.132:0/1482297283 shutdown_connections 2023-05-10T04:20:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.218+0000 7f7a223ff700 1 -- 172.21.15.132:0/1482297283 wait complete. 2023-05-10T04:20:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.220+0000 7f7a223ff700 1 Processor -- start 2023-05-10T04:20:21.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.220+0000 7f7a223ff700 1 -- start start 2023-05-10T04:20:21.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.221+0000 7f7a223ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0cf010 0x7f7a1c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.221+0000 7f7a223ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c0cff50 0x7f7a1c0b6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.221+0000 7f7a223ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c15c590 0x7f7a1c0b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.221+0000 7f7a223ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c155630 con 0x7f7a1c15c590 2023-05-10T04:20:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.221+0000 7f7a223ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c158190 con 0x7f7a1c0cff50 2023-05-10T04:20:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.221+0000 7f7a223ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a1c158470 con 0x7f7a1c0cf010 2023-05-10T04:20:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c15c590 0x7f7a1c0b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c15c590 0x7f7a1c0b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45974/0 (socket says 172.21.15.132:45974) 2023-05-10T04:20:21.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 -- 172.21.15.132:0/3433454206 learned_addr learned my addr 172.21.15.132:0/3433454206 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a1bfff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0cf010 0x7f7a1c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a1b7fe700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c0cff50 0x7f7a1c0b6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 -- 172.21.15.132:0/3433454206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0cf010 msgr2=0x7f7a1c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0cf010 0x7f7a1c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 -- 172.21.15.132:0/3433454206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c0cff50 msgr2=0x7f7a1c0b6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c0cff50 0x7f7a1c0b6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 -- 172.21.15.132:0/3433454206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0c0094a0 con 0x7f7a1c15c590 2023-05-10T04:20:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.222+0000 7f7a2099c700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c15c590 0x7f7a1c0b6b50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7a14001ba0 tx=0x7f7a1400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.223+0000 7f7a18ff9700 1 -- 172.21.15.132:0/3433454206 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a1400aac0 con 0x7f7a1c15c590 2023-05-10T04:20:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.223+0000 7f7a18ff9700 1 -- 172.21.15.132:0/3433454206 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a1400ac20 con 0x7f7a1c15c590 2023-05-10T04:20:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.223+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a1c0cd770 con 0x7f7a1c15c590 2023-05-10T04:20:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.223+0000 7f7a18ff9700 1 -- 172.21.15.132:0/3433454206 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a140070d0 con 0x7f7a1c15c590 2023-05-10T04:20:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.223+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a1c0cf560 con 0x7f7a1c15c590 2023-05-10T04:20:21.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.224+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a1c15c960 con 0x7f7a1c15c590 2023-05-10T04:20:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.225+0000 7f7a18ff9700 1 -- 172.21.15.132:0/3433454206 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7a14007230 con 0x7f7a1c15c590 2023-05-10T04:20:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.226+0000 7f7a18ff9700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7a0806ace0 0x7f7a0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.226+0000 7f7a18ff9700 1 -- 172.21.15.132:0/3433454206 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7a140892f0 con 0x7f7a1c15c590 2023-05-10T04:20:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.226+0000 7f7a1bfff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7a0806ace0 0x7f7a0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.226+0000 7f7a1bfff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7a0806ace0 0x7f7a0806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0090b0 tx=0x7f7a0c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:21.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.230+0000 7f7a18ff9700 1 -- 172.21.15.132:0/3433454206 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7a140540a0 con 0x7f7a1c15c590 2023-05-10T04:20:21.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.425+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7a1c0b63f0 con 0x7f7a1c15c590 2023-05-10T04:20:21.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.426+0000 7f7a18ff9700 1 -- 172.21.15.132:0/3433454206 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7a140576c0 con 0x7f7a1c15c590 2023-05-10T04:20:21.428 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7a0806ace0 msgr2=0x7f7a0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7a0806ace0 0x7f7a0806d190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c0090b0 tx=0x7f7a0c008030 comp rx=0 tx=0).stop 2023-05-10T04:20:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c15c590 msgr2=0x7f7a1c0b6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c15c590 0x7f7a1c0b6b50 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7a14001ba0 tx=0x7f7a1400cf50 comp rx=0 tx=0).stop 2023-05-10T04:20:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 shutdown_connections 2023-05-10T04:20:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7a0806ace0 0x7f7a0806d190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a1c15c590 0x7f7a1c0b6b50 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7a1c0cf010 0x7f7a1c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 --2- 172.21.15.132:0/3433454206 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7a1c0cff50 0x7f7a1c0b6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.428+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 >> 172.21.15.132:0/3433454206 conn(0x7f7a1c071b10 msgr2=0x7f7a1c0d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.429+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 shutdown_connections 2023-05-10T04:20:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.429+0000 7f7a223ff700 1 -- 172.21.15.132:0/3433454206 wait complete. 2023-05-10T04:20:21.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:21.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.633+0000 7f4d199ff700 1 Processor -- start 2023-05-10T04:20:21.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.633+0000 7f4d199ff700 1 -- start start 2023-05-10T04:20:21.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.634+0000 7f4d199ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d14070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d199ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4d14071030 0x7f4d1406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d199ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d140cb280 con 0x7f4d1415a5a0 2023-05-10T04:20:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d199ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1415a970 con 0x7f4d14071030 2023-05-10T04:20:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d199ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140714b0 con 0x7f4d1406aaf0 2023-05-10T04:20:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d12ffd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4d1415a5a0 0x7f4d1406a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33930/0 (socket says 172.21.15.132:33930) 2023-05-10T04:20:21.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d12ffd700 1 -- 172.21.15.132:0/2515930435 learned_addr learned my addr 172.21.15.132:0/2515930435 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:21.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d0bfff700 1 --2- 172.21.15.132:0/2515930435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d14070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d137fe700 1 --2- 172.21.15.132:0/2515930435 >> v2:172.21.15.154:3300/0 conn(0x7f4d14071030 0x7f4d1406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d127fc700 1 -- 172.21.15.132:0/2515930435 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3788230985 0 0) 0x7f4d04001110 con 0x7f4d1415a5a0 2023-05-10T04:20:21.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.635+0000 7f4d127fc700 1 -- 172.21.15.132:0/2515930435 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d000035b0 con 0x7f4d1415a5a0 2023-05-10T04:20:21.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d127fc700 1 -- 172.21.15.132:0/2515930435 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2670128166 0 0) 0x7f4d000035b0 con 0x7f4d1415a5a0 2023-05-10T04:20:21.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d0bfff700 1 -- 172.21.15.132:0/2515930435 >> v2:172.21.15.154:3300/0 conn(0x7f4d14071030 msgr2=0x7f4d1406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:21.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d0bfff700 1 --2- 172.21.15.132:0/2515930435 >> v2:172.21.15.154:3300/0 conn(0x7f4d14071030 0x7f4d1406d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d0bfff700 1 -- 172.21.15.132:0/2515930435 >> v1:172.21.15.132:6789/0 conn(0x7f4d1415a5a0 legacy=0x7f4d1406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d0bfff700 1 -- 172.21.15.132:0/2515930435 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d14071700 con 0x7f4d1406aaf0 2023-05-10T04:20:21.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d137fe700 1 --2- 172.21.15.132:0/2515930435 >> v2:172.21.15.154:3300/0 conn(0x7f4d14071030 0x7f4d1406d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:21.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d0bfff700 1 --2- 172.21.15.132:0/2515930435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d14070af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009820 tx=0x7f4cfc009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=887c33b6025f6c27 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:21.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d127fc700 1 -- 172.21.15.132:0/2515930435 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04001800 con 0x7f4d1406aaf0 2023-05-10T04:20:21.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d127fc700 1 -- 172.21.15.132:0/2515930435 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cfc005c30 con 0x7f4d1406aaf0 2023-05-10T04:20:21.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.636+0000 7f4d127fc700 1 -- 172.21.15.132:0/2515930435 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc004030 con 0x7f4d1406aaf0 2023-05-10T04:20:21.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.637+0000 7f4d199ff700 1 -- 172.21.15.132:0/2515930435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 msgr2=0x7f4d14070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.637+0000 7f4d199ff700 1 --2- 172.21.15.132:0/2515930435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d14070af0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009820 tx=0x7f4cfc009b30 comp rx=0 tx=0).stop 2023-05-10T04:20:21.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.637+0000 7f4d199ff700 1 -- 172.21.15.132:0/2515930435 shutdown_connections 2023-05-10T04:20:21.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.637+0000 7f4d199ff700 1 --2- 172.21.15.132:0/2515930435 >> v2:172.21.15.154:3300/0 conn(0x7f4d14071030 0x7f4d1406d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.637+0000 7f4d199ff700 1 --2- 172.21.15.132:0/2515930435 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d14070af0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.637+0000 7f4d199ff700 1 -- 172.21.15.132:0/2515930435 >> 172.21.15.132:0/2515930435 conn(0x7f4d140cf720 msgr2=0x7f4d140cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:21.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.637+0000 7f4d199ff700 1 -- 172.21.15.132:0/2515930435 shutdown_connections 2023-05-10T04:20:21.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.637+0000 7f4d199ff700 1 -- 172.21.15.132:0/2515930435 wait complete. 2023-05-10T04:20:21.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.638+0000 7f4d199ff700 1 Processor -- start 2023-05-10T04:20:21.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.639+0000 7f4d199ff700 1 -- start start 2023-05-10T04:20:21.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d199ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d1415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d199ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d14071030 0x7f4d141f5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d199ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d1415a5a0 0x7f4d141f5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d199ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140cc5d0 con 0x7f4d1415a5a0 2023-05-10T04:20:21.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d199ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d141562a0 con 0x7f4d14071030 2023-05-10T04:20:21.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d199ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d140cc820 con 0x7f4d1406aaf0 2023-05-10T04:20:21.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d137fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d1415a5a0 0x7f4d141f5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d137fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d1415a5a0 0x7f4d141f5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45978/0 (socket says 172.21.15.132:45978) 2023-05-10T04:20:21.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d137fe700 1 -- 172.21.15.132:0/3632788863 learned_addr learned my addr 172.21.15.132:0/3632788863 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:21.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d12ffd700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d1415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d0bfff700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d14071030 0x7f4d141f5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d137fe700 1 -- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 msgr2=0x7f4d1415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d137fe700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d1415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d137fe700 1 -- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d14071030 msgr2=0x7f4d141f5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d137fe700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d14071030 0x7f4d141f5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d137fe700 1 -- 172.21.15.132:0/3632788863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c009a70 con 0x7f4d1415a5a0 2023-05-10T04:20:21.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.640+0000 7f4d0bfff700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d14071030 0x7f4d141f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:21.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.641+0000 7f4d137fe700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d1415a5a0 0x7f4d141f5ba0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00efc0 tx=0x7f4d0c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:21.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.641+0000 7f4d10ff9700 1 -- 172.21.15.132:0/3632788863 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c00cb40 con 0x7f4d1415a5a0 2023-05-10T04:20:21.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.641+0000 7f4d10ff9700 1 -- 172.21.15.132:0/3632788863 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c00f040 con 0x7f4d1415a5a0 2023-05-10T04:20:21.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.641+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cfc009430 con 0x7f4d1415a5a0 2023-05-10T04:20:21.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.641+0000 7f4d10ff9700 1 -- 172.21.15.132:0/3632788863 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c003a20 con 0x7f4d1415a5a0 2023-05-10T04:20:21.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.641+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1406c6c0 con 0x7f4d1415a5a0 2023-05-10T04:20:21.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.642+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d140719e0 con 0x7f4d1415a5a0 2023-05-10T04:20:21.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.643+0000 7f4d10ff9700 1 -- 172.21.15.132:0/3632788863 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4d0c014480 con 0x7f4d1415a5a0 2023-05-10T04:20:21.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.644+0000 7f4d10ff9700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cf406ace0 0x7f4cf406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:21.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.644+0000 7f4d10ff9700 1 -- 172.21.15.132:0/3632788863 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4d0c08a200 con 0x7f4d1415a5a0 2023-05-10T04:20:21.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.644+0000 7f4d12ffd700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cf406ace0 0x7f4cf406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:21.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.644+0000 7f4d12ffd700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cf406ace0 0x7f4cf406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000f60 tx=0x7f4d04001df0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:21.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.648+0000 7f4d10ff9700 1 -- 172.21.15.132:0/3632788863 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4d0c054f30 con 0x7f4d1415a5a0 2023-05-10T04:20:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.847+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4d1406c9a0 con 0x7f4d1415a5a0 2023-05-10T04:20:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.847+0000 7f4d10ff9700 1 -- 172.21.15.132:0/3632788863 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4d0c058550 con 0x7f4d1415a5a0 2023-05-10T04:20:21.849 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:21.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cf406ace0 msgr2=0x7f4cf406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cf406ace0 0x7f4cf406d190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4d04000f60 tx=0x7f4d04001df0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d1415a5a0 msgr2=0x7f4d141f5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:21.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d1415a5a0 0x7f4d141f5ba0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00efc0 tx=0x7f4d0c00c3a0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 shutdown_connections 2023-05-10T04:20:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4cf406ace0 0x7f4cf406d190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d1415a5a0 0x7f4d141f5ba0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4d1406aaf0 0x7f4d1415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 --2- 172.21.15.132:0/3632788863 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4d14071030 0x7f4d141f5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 >> 172.21.15.132:0/3632788863 conn(0x7f4d140cf720 msgr2=0x7f4d140b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 shutdown_connections 2023-05-10T04:20:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:21.850+0000 7f4d199ff700 1 -- 172.21.15.132:0/3632788863 wait complete. 2023-05-10T04:20:21.869 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:22.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.057+0000 7fb3c65ff700 1 Processor -- start 2023-05-10T04:20:22.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.057+0000 7fb3c65ff700 1 -- start start 2023-05-10T04:20:22.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.058+0000 7fb3c65ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3c015a5a0 0x7fb3c006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.058+0000 7fb3c65ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c00cb280 con 0x7fb3c0071200 2023-05-10T04:20:22.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.058+0000 7fb3c65ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c0071700 con 0x7fb3c006a920 2023-05-10T04:20:22.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.058+0000 7fb3c65ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c006adc0 con 0x7fb3c015a5a0 2023-05-10T04:20:22.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.058+0000 7fb3bffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3c015a5a0 0x7fb3c006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3bffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3c015a5a0 0x7fb3c006a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45990/0 (socket says 172.21.15.132:45990) 2023-05-10T04:20:22.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3bffff700 1 -- 172.21.15.132:0/2630400515 learned_addr learned my addr 172.21.15.132:0/2630400515 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:22.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3bffff700 1 -- 172.21.15.132:0/2630400515 >> v1:172.21.15.154:6789/0 conn(0x7fb3c006a920 legacy=0x7fb3c0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:22.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3bffff700 1 -- 172.21.15.132:0/2630400515 >> v1:172.21.15.132:6789/0 conn(0x7fb3c0071200 legacy=0x7fb3c006d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3bffff700 1 -- 172.21.15.132:0/2630400515 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00719e0 con 0x7fb3c015a5a0 2023-05-10T04:20:22.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3bffff700 1 --2- 172.21.15.132:0/2630400515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c006a3e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00098f0 tx=0x7fb3b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba956b83e5386cbc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3beffd700 1 -- 172.21.15.132:0/2630400515 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0004230 con 0x7fb3c015a5a0 2023-05-10T04:20:22.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3beffd700 1 -- 172.21.15.132:0/2630400515 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b0004390 con 0x7fb3c015a5a0 2023-05-10T04:20:22.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.059+0000 7fb3beffd700 1 -- 172.21.15.132:0/2630400515 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00036a0 con 0x7fb3c015a5a0 2023-05-10T04:20:22.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.060+0000 7fb3c65ff700 1 -- 172.21.15.132:0/2630400515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 msgr2=0x7fb3c006a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.060+0000 7fb3c65ff700 1 --2- 172.21.15.132:0/2630400515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c006a3e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb3b00098f0 tx=0x7fb3b0009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:22.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.060+0000 7fb3c65ff700 1 -- 172.21.15.132:0/2630400515 shutdown_connections 2023-05-10T04:20:22.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.060+0000 7fb3c65ff700 1 --2- 172.21.15.132:0/2630400515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c006a3e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.060+0000 7fb3c65ff700 1 -- 172.21.15.132:0/2630400515 >> 172.21.15.132:0/2630400515 conn(0x7fb3c00cf720 msgr2=0x7fb3c00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:22.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.060+0000 7fb3c65ff700 1 -- 172.21.15.132:0/2630400515 shutdown_connections 2023-05-10T04:20:22.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.060+0000 7fb3c65ff700 1 -- 172.21.15.132:0/2630400515 wait complete. 2023-05-10T04:20:22.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.062+0000 7fb3c65ff700 1 Processor -- start 2023-05-10T04:20:22.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.062+0000 7fb3c65ff700 1 -- start start 2023-05-10T04:20:22.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c65ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c006a920 0x7fb3c015bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c65ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c0071200 0x7fb3c01558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c65ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c00c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c65ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c015b790 con 0x7fb3c015a5a0 2023-05-10T04:20:22.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c65ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c015d370 con 0x7fb3c006a920 2023-05-10T04:20:22.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c65ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c015cdb0 con 0x7fb3c0071200 2023-05-10T04:20:22.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c4b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c00c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c4b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c00c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46002/0 (socket says 172.21.15.132:46002) 2023-05-10T04:20:22.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c4b9c700 1 -- 172.21.15.132:0/3432887290 learned_addr learned my addr 172.21.15.132:0/3432887290 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:22.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3bffff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c006a920 0x7fb3c015bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3bf7fe700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c0071200 0x7fb3c01558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c4b9c700 1 -- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c0071200 msgr2=0x7fb3c01558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c4b9c700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c0071200 0x7fb3c01558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c4b9c700 1 -- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c006a920 msgr2=0x7fb3c015bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c4b9c700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c006a920 0x7fb3c015bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3c4b9c700 1 -- 172.21.15.132:0/3432887290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b0009550 con 0x7fb3c015a5a0 2023-05-10T04:20:22.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.063+0000 7fb3bffff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c006a920 0x7fb3c015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:22.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.064+0000 7fb3c4b9c700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c00c7140 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800cc50 tx=0x7fb3b800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.064+0000 7fb3bcff9700 1 -- 172.21.15.132:0/3432887290 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b800ad80 con 0x7fb3c015a5a0 2023-05-10T04:20:22.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.064+0000 7fb3bcff9700 1 -- 172.21.15.132:0/3432887290 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b800ce50 con 0x7fb3c015a5a0 2023-05-10T04:20:22.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.064+0000 7fb3bcff9700 1 -- 172.21.15.132:0/3432887290 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b8003c40 con 0x7fb3c015a5a0 2023-05-10T04:20:22.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.064+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c006c9a0 con 0x7fb3c015a5a0 2023-05-10T04:20:22.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.064+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c006c6c0 con 0x7fb3c015a5a0 2023-05-10T04:20:22.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.065+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c006cc80 con 0x7fb3c015a5a0 2023-05-10T04:20:22.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.066+0000 7fb3bcff9700 1 -- 172.21.15.132:0/3432887290 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb3b80050d0 con 0x7fb3c015a5a0 2023-05-10T04:20:22.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.067+0000 7fb3bcff9700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb3ac06ace0 0x7fb3ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.067+0000 7fb3bcff9700 1 -- 172.21.15.132:0/3432887290 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb3b8089750 con 0x7fb3c015a5a0 2023-05-10T04:20:22.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.067+0000 7fb3bffff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb3ac06ace0 0x7fb3ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.068+0000 7fb3bffff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb3ac06ace0 0x7fb3ac06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009130 tx=0x7fb3b0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.071+0000 7fb3bcff9700 1 -- 172.21.15.132:0/3432887290 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb3b8054470 con 0x7fb3c015a5a0 2023-05-10T04:20:22.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.266+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3c00cb280 con 0x7fb3c015a5a0 2023-05-10T04:20:22.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.267+0000 7fb3bcff9700 1 -- 172.21.15.132:0/3432887290 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3c00cb280 con 0x7fb3c015a5a0 2023-05-10T04:20:22.269 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:22.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb3ac06ace0 msgr2=0x7fb3ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb3ac06ace0 0x7fb3ac06d190 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009130 tx=0x7fb3b0008030 comp rx=0 tx=0).stop 2023-05-10T04:20:22.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 msgr2=0x7fb3c00c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c00c7140 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb3b800cc50 tx=0x7fb3b800a340 comp rx=0 tx=0).stop 2023-05-10T04:20:22.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 shutdown_connections 2023-05-10T04:20:22.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb3ac06ace0 0x7fb3ac06d190 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3c015a5a0 0x7fb3c00c7140 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb3c006a920 0x7fb3c015bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 --2- 172.21.15.132:0/3432887290 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb3c0071200 0x7fb3c01558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 >> 172.21.15.132:0/3432887290 conn(0x7fb3c00cf720 msgr2=0x7fb3c00afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:22.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.269+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 shutdown_connections 2023-05-10T04:20:22.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.270+0000 7fb3c65ff700 1 -- 172.21.15.132:0/3432887290 wait complete. 2023-05-10T04:20:22.289 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.473+0000 7f0e935ff700 1 Processor -- start 2023-05-10T04:20:22.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.474+0000 7f0e935ff700 1 -- start start 2023-05-10T04:20:22.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.475+0000 7f0e935ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0e8c1589d0 0x7f0e8c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.475+0000 7f0e935ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c0cd690 0x7f0e8c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.475+0000 7f0e935ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e8c158da0 0x7f0e8c06cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.475+0000 7f0e935ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8c0ca890 con 0x7f0e8c158da0 2023-05-10T04:20:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.475+0000 7f0e935ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e8c0ca5b0 con 0x7f0e8c1589d0 2023-05-10T04:20:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.475+0000 7f0e935ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0cc670 con 0x7f0e8c0cd690 2023-05-10T04:20:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e8c158da0 0x7f0e8c06cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e8c158da0 0x7f0e8c06cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46018/0 (socket says 172.21.15.132:46018) 2023-05-10T04:20:22.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 -- 172.21.15.132:0/742311176 learned_addr learned my addr 172.21.15.132:0/742311176 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:22.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e9139b700 1 --2- 172.21.15.132:0/742311176 >> v2:172.21.15.154:3300/0 conn(0x7f0e8c1589d0 0x7f0e8c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e90b9a700 1 --2- 172.21.15.132:0/742311176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c0cd690 0x7f0e8c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 -- 172.21.15.132:0/742311176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c0cd690 msgr2=0x7f0e8c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 --2- 172.21.15.132:0/742311176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c0cd690 0x7f0e8c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 -- 172.21.15.132:0/742311176 >> v2:172.21.15.154:3300/0 conn(0x7f0e8c1589d0 msgr2=0x7f0e8c0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 --2- 172.21.15.132:0/742311176 >> v2:172.21.15.154:3300/0 conn(0x7f0e8c1589d0 0x7f0e8c0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 -- 172.21.15.132:0/742311176 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e8c0cc950 con 0x7f0e8c158da0 2023-05-10T04:20:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e91b9c700 1 --2- 172.21.15.132:0/742311176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c158da0 0x7f0e8c06cc00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c067990 tx=0x7f0e8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5757ad071d1ef46 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e83fff700 1 -- 172.21.15.132:0/742311176 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400e070 con 0x7f0e8c158da0 2023-05-10T04:20:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.476+0000 7f0e83fff700 1 -- 172.21.15.132:0/742311176 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8400b910 con 0x7f0e8c158da0 2023-05-10T04:20:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e83fff700 1 -- 172.21.15.132:0/742311176 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8400bcc0 con 0x7f0e8c158da0 2023-05-10T04:20:22.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 -- 172.21.15.132:0/742311176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c158da0 msgr2=0x7f0e8c06cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 --2- 172.21.15.132:0/742311176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c158da0 0x7f0e8c06cc00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c067990 tx=0x7f0e8400b330 comp rx=0 tx=0).stop 2023-05-10T04:20:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 -- 172.21.15.132:0/742311176 shutdown_connections 2023-05-10T04:20:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 --2- 172.21.15.132:0/742311176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c158da0 0x7f0e8c06cc00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 --2- 172.21.15.132:0/742311176 >> v2:172.21.15.154:3300/0 conn(0x7f0e8c1589d0 0x7f0e8c0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 --2- 172.21.15.132:0/742311176 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c0cd690 0x7f0e8c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 -- 172.21.15.132:0/742311176 >> 172.21.15.132:0/742311176 conn(0x7f0e8c0cf720 msgr2=0x7f0e8c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 -- 172.21.15.132:0/742311176 shutdown_connections 2023-05-10T04:20:22.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.477+0000 7f0e935ff700 1 -- 172.21.15.132:0/742311176 wait complete. 2023-05-10T04:20:22.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.479+0000 7f0e935ff700 1 Processor -- start 2023-05-10T04:20:22.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.480+0000 7f0e935ff700 1 -- start start 2023-05-10T04:20:22.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e935ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c0cd690 0x7f0e8c0b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e935ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c1589d0 0x7f0e8c1edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e935ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c158da0 0x7f0e8c157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e935ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c0c3c50 con 0x7f0e8c0cd690 2023-05-10T04:20:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e935ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c15a320 con 0x7f0e8c1589d0 2023-05-10T04:20:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e935ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8c15a8e0 con 0x7f0e8c158da0 2023-05-10T04:20:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e9139b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c0cd690 0x7f0e8c0b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e9139b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c0cd690 0x7f0e8c0b18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46024/0 (socket says 172.21.15.132:46024) 2023-05-10T04:20:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e9139b700 1 -- 172.21.15.132:0/3863845730 learned_addr learned my addr 172.21.15.132:0/3863845730 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e90b9a700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c1589d0 0x7f0e8c1edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.481+0000 7f0e91b9c700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c158da0 0x7f0e8c157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e9139b700 1 -- 172.21.15.132:0/3863845730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c158da0 msgr2=0x7f0e8c157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e9139b700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c158da0 0x7f0e8c157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e9139b700 1 -- 172.21.15.132:0/3863845730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c1589d0 msgr2=0x7f0e8c1edaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e9139b700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c1589d0 0x7f0e8c1edaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e9139b700 1 -- 172.21.15.132:0/3863845730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84009b30 con 0x7f0e8c0cd690 2023-05-10T04:20:22.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e9139b700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c0cd690 0x7f0e8c0b18c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e9e0 tx=0x7f0e8800ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e81ffb700 1 -- 172.21.15.132:0/3863845730 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e88009710 con 0x7f0e8c0cd690 2023-05-10T04:20:22.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e81ffb700 1 -- 172.21.15.132:0/3863845730 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e8800ee80 con 0x7f0e8c0cd690 2023-05-10T04:20:22.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e8c0cbc20 con 0x7f0e8c0cd690 2023-05-10T04:20:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e81ffb700 1 -- 172.21.15.132:0/3863845730 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8800ca50 con 0x7f0e8c0cd690 2023-05-10T04:20:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.482+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e8c0ccc30 con 0x7f0e8c0cd690 2023-05-10T04:20:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.483+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e8c0cbdb0 con 0x7f0e8c0cd690 2023-05-10T04:20:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.484+0000 7f0e81ffb700 1 -- 172.21.15.132:0/3863845730 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0e8800cbb0 con 0x7f0e8c0cd690 2023-05-10T04:20:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.485+0000 7f0e81ffb700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0e7006ace0 0x7f0e7006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.485+0000 7f0e81ffb700 1 -- 172.21.15.132:0/3863845730 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0e880895f0 con 0x7f0e8c0cd690 2023-05-10T04:20:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.485+0000 7f0e90b9a700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0e7006ace0 0x7f0e7006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.486+0000 7f0e90b9a700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0e7006ace0 0x7f0e7006d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c1511b0 tx=0x7f0e7c00a2d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.490+0000 7f0e81ffb700 1 -- 172.21.15.132:0/3863845730 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0e88057ed0 con 0x7f0e8c0cd690 2023-05-10T04:20:22.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.688+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0e8c0b4a10 con 0x7f0e8c0cd690 2023-05-10T04:20:22.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.689+0000 7f0e81ffb700 1 -- 172.21.15.132:0/3863845730 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0e88057a60 con 0x7f0e8c0cd690 2023-05-10T04:20:22.691 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:22.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0e7006ace0 msgr2=0x7f0e7006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0e7006ace0 0x7f0e7006d190 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c1511b0 tx=0x7f0e7c00a2d0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c0cd690 msgr2=0x7f0e8c0b18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c0cd690 0x7f0e8c0b18c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800e9e0 tx=0x7f0e8800ecf0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 shutdown_connections 2023-05-10T04:20:22.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0e7006ace0 0x7f0e7006d190 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0e8c158da0 0x7f0e8c157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e8c0cd690 0x7f0e8c0b18c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 --2- 172.21.15.132:0/3863845730 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0e8c1589d0 0x7f0e8c1edaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 >> 172.21.15.132:0/3863845730 conn(0x7f0e8c0cf720 msgr2=0x7f0e8c070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:22.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 shutdown_connections 2023-05-10T04:20:22.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.691+0000 7f0e935ff700 1 -- 172.21.15.132:0/3863845730 wait complete. 2023-05-10T04:20:22.711 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:22.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.893+0000 7f980a1ff700 1 Processor -- start 2023-05-10T04:20:22.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.893+0000 7f980a1ff700 1 -- start start 2023-05-10T04:20:22.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.894+0000 7f980a1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f98040cf010 0x7f9804160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.894+0000 7f980a1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040cd520 con 0x7f98040cff50 2023-05-10T04:20:22.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.894+0000 7f980a1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040d2640 con 0x7f980415c590 2023-05-10T04:20:22.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.894+0000 7f980a1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98041610d0 con 0x7f98040cf010 2023-05-10T04:20:22.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f9803fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f98040cff50 0x7f98040d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49448/0 (socket says 172.21.15.132:49448) 2023-05-10T04:20:22.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f9803fff700 1 -- 172.21.15.132:0/2522154621 learned_addr learned my addr 172.21.15.132:0/2522154621 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:22.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f9802ffd700 1 --2- 172.21.15.132:0/2522154621 >> v2:172.21.15.154:3300/0 conn(0x7f98040cf010 0x7f9804160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f98027fc700 1 -- 172.21.15.132:0/2522154621 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290294911 0 0) 0x7f98040cd520 con 0x7f98040cff50 2023-05-10T04:20:22.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f98027fc700 1 -- 172.21.15.132:0/2522154621 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97ec0035b0 con 0x7f98040cff50 2023-05-10T04:20:22.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f98027fc700 1 -- 172.21.15.132:0/2522154621 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690020869 0 0) 0x7f98040d2640 con 0x7f980415c590 2023-05-10T04:20:22.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f98027fc700 1 -- 172.21.15.132:0/2522154621 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98040cd520 con 0x7f980415c590 2023-05-10T04:20:22.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f98027fc700 1 -- 172.21.15.132:0/2522154621 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2782043290 0 0) 0x7f97ec0035b0 con 0x7f98040cff50 2023-05-10T04:20:22.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.895+0000 7f9802ffd700 1 -- 172.21.15.132:0/2522154621 >> v1:172.21.15.154:6789/0 conn(0x7f980415c590 legacy=0x7f98040cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.896+0000 7f9802ffd700 1 -- 172.21.15.132:0/2522154621 >> v1:172.21.15.132:6789/0 conn(0x7f98040cff50 legacy=0x7f98040d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.896+0000 7f9802ffd700 1 -- 172.21.15.132:0/2522154621 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040b23c0 con 0x7f98040cf010 2023-05-10T04:20:22.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.896+0000 7f9802ffd700 1 --2- 172.21.15.132:0/2522154621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98040cf010 0x7f9804160b90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009840 tx=0x7f97f8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0d9ff4f0cacf29d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.896+0000 7f98027fc700 1 -- 172.21.15.132:0/2522154621 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc0019f0 con 0x7f98040cf010 2023-05-10T04:20:22.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.896+0000 7f98027fc700 1 -- 172.21.15.132:0/2522154621 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f8004030 con 0x7f98040cf010 2023-05-10T04:20:22.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.896+0000 7f98027fc700 1 -- 172.21.15.132:0/2522154621 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f80043c0 con 0x7f98040cf010 2023-05-10T04:20:22.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.897+0000 7f980a1ff700 1 -- 172.21.15.132:0/2522154621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98040cf010 msgr2=0x7f9804160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.897+0000 7f980a1ff700 1 --2- 172.21.15.132:0/2522154621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98040cf010 0x7f9804160b90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009840 tx=0x7f97f8009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:22.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.897+0000 7f980a1ff700 1 -- 172.21.15.132:0/2522154621 shutdown_connections 2023-05-10T04:20:22.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.897+0000 7f980a1ff700 1 --2- 172.21.15.132:0/2522154621 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f98040cf010 0x7f9804160b90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.897+0000 7f980a1ff700 1 -- 172.21.15.132:0/2522154621 >> 172.21.15.132:0/2522154621 conn(0x7f9804071b10 msgr2=0x7f9804071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:22.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.897+0000 7f980a1ff700 1 -- 172.21.15.132:0/2522154621 shutdown_connections 2023-05-10T04:20:22.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.897+0000 7f980a1ff700 1 -- 172.21.15.132:0/2522154621 wait complete. 2023-05-10T04:20:22.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.898+0000 7f980a1ff700 1 Processor -- start 2023-05-10T04:20:22.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.899+0000 7f980a1ff700 1 -- start start 2023-05-10T04:20:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.899+0000 7f980a1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98040cf010 0x7f98040c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.899+0000 7f980a1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98040cff50 0x7f98040c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f980a1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f980415c590 0x7f98040c7950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f980a1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980415f460 con 0x7f98040cff50 2023-05-10T04:20:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f980a1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98041f3060 con 0x7f980415c590 2023-05-10T04:20:22.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f980a1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980415f670 con 0x7f98040cf010 2023-05-10T04:20:22.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98040cff50 0x7f98040c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98040cff50 0x7f98040c7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39060/0 (socket says 172.21.15.132:39060) 2023-05-10T04:20:22.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 -- 172.21.15.132:0/3682372622 learned_addr learned my addr 172.21.15.132:0/3682372622 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:22.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9803fff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f980415c590 0x7f98040c7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f98037fe700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98040cf010 0x7f98040c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 -- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98040cf010 msgr2=0x7f98040c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98040cf010 0x7f98040c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 -- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f980415c590 msgr2=0x7f98040c7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f980415c590 0x7f98040c7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 -- 172.21.15.132:0/3682372622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80094a0 con 0x7f98040cff50 2023-05-10T04:20:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9803fff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f980415c590 0x7f98040c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.900+0000 7f9802ffd700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98040cff50 0x7f98040c7410 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97f80090b0 tx=0x7f97f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.901+0000 7f97ebfff700 1 -- 172.21.15.132:0/3682372622 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8011830 con 0x7f98040cff50 2023-05-10T04:20:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.901+0000 7f97ebfff700 1 -- 172.21.15.132:0/3682372622 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f801f070 con 0x7f98040cff50 2023-05-10T04:20:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.901+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98040cd770 con 0x7f98040cff50 2023-05-10T04:20:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.901+0000 7f97ebfff700 1 -- 172.21.15.132:0/3682372622 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8011bf0 con 0x7f98040cff50 2023-05-10T04:20:22.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.901+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98040cf560 con 0x7f98040cff50 2023-05-10T04:20:22.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.902+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980415c960 con 0x7f98040cff50 2023-05-10T04:20:22.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.903+0000 7f97ebfff700 1 -- 172.21.15.132:0/3682372622 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f97f8011d50 con 0x7f98040cff50 2023-05-10T04:20:22.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.903+0000 7f97ebfff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f97f006ace0 0x7f97f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:22.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.904+0000 7f97ebfff700 1 -- 172.21.15.132:0/3682372622 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f97f8021070 con 0x7f98040cff50 2023-05-10T04:20:22.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.904+0000 7f98037fe700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f97f006ace0 0x7f97f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:22.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.904+0000 7f98037fe700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f97f006ace0 0x7f97f006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97f4007fd0 tx=0x7f97f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:22.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:22.908+0000 7f97ebfff700 1 -- 172.21.15.132:0/3682372622 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f97f80599a0 con 0x7f98040cff50 2023-05-10T04:20:23.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.103+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f98040c6cb0 con 0x7f98040cff50 2023-05-10T04:20:23.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.103+0000 7f97ebfff700 1 -- 172.21.15.132:0/3682372622 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97f8059530 con 0x7f98040cff50 2023-05-10T04:20:23.106 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:23.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f97f006ace0 msgr2=0x7f97f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:23.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f97f006ace0 0x7f97f006d190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f97f4007fd0 tx=0x7f97f4009040 comp rx=0 tx=0).stop 2023-05-10T04:20:23.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98040cff50 msgr2=0x7f98040c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:23.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98040cff50 0x7f98040c7410 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97f80090b0 tx=0x7f97f8004750 comp rx=0 tx=0).stop 2023-05-10T04:20:23.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 shutdown_connections 2023-05-10T04:20:23.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f97f006ace0 0x7f97f006d190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f980415c590 0x7f98040c7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f98040cf010 0x7f98040c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 --2- 172.21.15.132:0/3682372622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98040cff50 0x7f98040c7410 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 >> 172.21.15.132:0/3682372622 conn(0x7f9804071b10 msgr2=0x7f98040d29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:23.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 shutdown_connections 2023-05-10T04:20:23.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.106+0000 7f980a1ff700 1 -- 172.21.15.132:0/3682372622 wait complete. 2023-05-10T04:20:23.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:20:23.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.307+0000 7f76a2fff700 1 Processor -- start 2023-05-10T04:20:23.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.308+0000 7f76a2fff700 1 -- start start 2023-05-10T04:20:23.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f76a2fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:23.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f76a2fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f769c160d40 0x7f769c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:23.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f76a2fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f769c0cdc60 con 0x7f769c1601e0 2023-05-10T04:20:23.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f76a2fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f769c0d02d0 con 0x7f769c160d40 2023-05-10T04:20:23.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f76a2fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0d0cb0 con 0x7f769c0b87a0 2023-05-10T04:20:23.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f769bfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f769c1601e0 0x7f769c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49456/0 (socket says 172.21.15.132:49456) 2023-05-10T04:20:23.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f769bfff700 1 -- 172.21.15.132:0/1579653753 learned_addr learned my addr 172.21.15.132:0/1579653753 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:23.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f76a0d9b700 1 --2- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:23.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f76a159c700 1 --2- 172.21.15.132:0/1579653753 >> v2:172.21.15.154:3300/0 conn(0x7f769c160d40 0x7f769c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:23.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f769b7fe700 1 -- 172.21.15.132:0/1579653753 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329201833 0 0) 0x7f769c0cdc60 con 0x7f769c1601e0 2023-05-10T04:20:23.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.309+0000 7f769b7fe700 1 -- 172.21.15.132:0/1579653753 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f768c0035b0 con 0x7f769c1601e0 2023-05-10T04:20:23.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f76a159c700 1 -- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 msgr2=0x7f769c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:23.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f76a159c700 1 --2- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f76a159c700 1 -- 172.21.15.132:0/1579653753 >> v1:172.21.15.132:6789/0 conn(0x7f769c1601e0 legacy=0x7f769c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:23.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f76a159c700 1 -- 172.21.15.132:0/1579653753 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f769c0cd6a0 con 0x7f769c160d40 2023-05-10T04:20:23.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f76a0d9b700 1 --2- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:23.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f76a159c700 1 --2- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c160d40 0x7f769c0d1100 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7694009d90 tx=0x7f769400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2b813f1bb6e1300 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:23.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f769b7fe700 1 -- 172.21.15.132:0/1579653753 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769400e070 con 0x7f769c160d40 2023-05-10T04:20:23.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f769b7fe700 1 -- 172.21.15.132:0/1579653753 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f769400bb20 con 0x7f769c160d40 2023-05-10T04:20:23.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.310+0000 7f769b7fe700 1 -- 172.21.15.132:0/1579653753 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694012430 con 0x7f769c160d40 2023-05-10T04:20:23.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.311+0000 7f76a2fff700 1 -- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c160d40 msgr2=0x7f769c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:23.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.311+0000 7f76a2fff700 1 --2- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c160d40 0x7f769c0d1100 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7694009d90 tx=0x7f769400b330 comp rx=0 tx=0).stop 2023-05-10T04:20:23.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.311+0000 7f76a2fff700 1 -- 172.21.15.132:0/1579653753 shutdown_connections 2023-05-10T04:20:23.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.311+0000 7f76a2fff700 1 --2- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c160d40 0x7f769c0d1100 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.311+0000 7f76a2fff700 1 --2- 172.21.15.132:0/1579653753 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.311+0000 7f76a2fff700 1 -- 172.21.15.132:0/1579653753 >> 172.21.15.132:0/1579653753 conn(0x7f769c071b10 msgr2=0x7f769c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:23.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.311+0000 7f76a2fff700 1 -- 172.21.15.132:0/1579653753 shutdown_connections 2023-05-10T04:20:23.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.311+0000 7f76a2fff700 1 -- 172.21.15.132:0/1579653753 wait complete. 2023-05-10T04:20:23.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.313+0000 7f76a2fff700 1 Processor -- start 2023-05-10T04:20:23.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.313+0000 7f76a2fff700 1 -- start start 2023-05-10T04:20:23.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a2fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c15e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:23.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a2fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c1601e0 0x7f769c0cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:23.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a2fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f769c160d40 0x7f769c1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:23.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a2fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c0cb890 con 0x7f769c160d40 2023-05-10T04:20:23.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a2fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769c15e880 con 0x7f769c1601e0 2023-05-10T04:20:23.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a2fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f769c15ec80 con 0x7f769c0b87a0 2023-05-10T04:20:23.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a159c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f769c160d40 0x7f769c1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:23.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a159c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f769c160d40 0x7f769c1512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39072/0 (socket says 172.21.15.132:39072) 2023-05-10T04:20:23.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a159c700 1 -- 172.21.15.132:0/2562238997 learned_addr learned my addr 172.21.15.132:0/2562238997 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:23.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a0d9b700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c15e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:23.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f769bfff700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c1601e0 0x7f769c0cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:23.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a159c700 1 -- 172.21.15.132:0/2562238997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 msgr2=0x7f769c15e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:23.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a159c700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c15e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a159c700 1 -- 172.21.15.132:0/2562238997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c1601e0 msgr2=0x7f769c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:23.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a159c700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c1601e0 0x7f769c0cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.314+0000 7f76a159c700 1 -- 172.21.15.132:0/2562238997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76900094a0 con 0x7f769c160d40 2023-05-10T04:20:23.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.315+0000 7f76a159c700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f769c160d40 0x7f769c1512c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7694014040 tx=0x7f7694004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:23.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.315+0000 7f76997fa700 1 -- 172.21.15.132:0/2562238997 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76940129f0 con 0x7f769c160d40 2023-05-10T04:20:23.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.315+0000 7f76997fa700 1 -- 172.21.15.132:0/2562238997 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7694020070 con 0x7f769c160d40 2023-05-10T04:20:23.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.315+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7694009a70 con 0x7f769c160d40 2023-05-10T04:20:23.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.315+0000 7f76997fa700 1 -- 172.21.15.132:0/2562238997 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7694012db0 con 0x7f769c160d40 2023-05-10T04:20:23.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.315+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f769c0d1640 con 0x7f769c160d40 2023-05-10T04:20:23.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.316+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769c0cd980 con 0x7f769c160d40 2023-05-10T04:20:23.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.317+0000 7f76997fa700 1 -- 172.21.15.132:0/2562238997 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7694004040 con 0x7f769c160d40 2023-05-10T04:20:23.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.318+0000 7f76997fa700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f768006ace0 0x7f768006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:23.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.318+0000 7f76997fa700 1 -- 172.21.15.132:0/2562238997 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7694022070 con 0x7f769c160d40 2023-05-10T04:20:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.318+0000 7f76a0d9b700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f768006ace0 0x7f768006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.319+0000 7f76a0d9b700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f768006ace0 0x7f768006d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7690009d00 tx=0x7f7690008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:23.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.322+0000 7f76997fa700 1 -- 172.21.15.132:0/2562238997 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f76940563d0 con 0x7f769c160d40 2023-05-10T04:20:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.532+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f769c0d17d0 con 0x7f769c160d40 2023-05-10T04:20:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.533+0000 7f76997fa700 1 -- 172.21.15.132:0/2562238997 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f76940599f0 con 0x7f769c160d40 2023-05-10T04:20:23.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f768006ace0 msgr2=0x7f768006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:23.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f768006ace0 0x7f768006d190 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7690009d00 tx=0x7f7690008040 comp rx=0 tx=0).stop 2023-05-10T04:20:23.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f769c160d40 msgr2=0x7f769c1512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:23.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f769c160d40 0x7f769c1512c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f7694014040 tx=0x7f7694004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 shutdown_connections 2023-05-10T04:20:23.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f768006ace0 0x7f768006d190 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f769c160d40 0x7f769c1512c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f769c0b87a0 0x7f769c15e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 --2- 172.21.15.132:0/2562238997 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f769c1601e0 0x7f769c0cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:23.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 >> 172.21.15.132:0/2562238997 conn(0x7f769c071b10 msgr2=0x7f769c160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:23.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 shutdown_connections 2023-05-10T04:20:23.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:23.535+0000 7f76a2fff700 1 -- 172.21.15.132:0/2562238997 wait complete. 2023-05-10T04:20:23.539 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:20:23.555 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2023-05-10T04:20:23.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:20:23.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-05-10T04:20:23.627 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:20:23.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-05-10T04:20:23.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:20:23.629 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-05-10T04:20:23.678 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:20:23.679 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:23.718 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:20:23.718 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:23.797 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:24.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.017+0000 7f81e1bff700 1 Processor -- start 2023-05-10T04:20:24.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.017+0000 7f81e1bff700 1 -- start start 2023-05-10T04:20:24.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81e1bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc15a5a0 0x7f81dc06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81e1bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f81dc06a920 0x7f81dc070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81e1bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81dc0cb280 con 0x7f81dc071030 2023-05-10T04:20:24.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81e1bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81dc15a970 con 0x7f81dc06a920 2023-05-10T04:20:24.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81e1bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc06ad90 con 0x7f81dc15a5a0 2023-05-10T04:20:24.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81dbfff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f81dc071030 0x7f81dc15dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:38220/0 (socket says 172.21.15.132:38220) 2023-05-10T04:20:24.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81dbfff700 1 -- 172.21.15.132:0/2571092682 learned_addr learned my addr 172.21.15.132:0/2571092682 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:24.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81daffd700 1 --2- 172.21.15.132:0/2571092682 >> v2:172.21.15.132:3300/0 conn(0x7f81dc06a920 0x7f81dc070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.018+0000 7f81db7fe700 1 --2- 172.21.15.132:0/2571092682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc15a5a0 0x7f81dc06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81da7fc700 1 -- 172.21.15.132:0/2571092682 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 55119714 0 0) 0x7f81d4001490 con 0x7f81dc071030 2023-05-10T04:20:24.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81daffd700 1 -- 172.21.15.132:0/2571092682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc15a5a0 msgr2=0x7f81dc06a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:24.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81daffd700 1 --2- 172.21.15.132:0/2571092682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc15a5a0 0x7f81dc06a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81daffd700 1 -- 172.21.15.132:0/2571092682 >> v1:172.21.15.154:6789/0 conn(0x7f81dc071030 legacy=0x7f81dc15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81daffd700 1 -- 172.21.15.132:0/2571092682 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81dc0714b0 con 0x7f81dc06a920 2023-05-10T04:20:24.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81db7fe700 1 --2- 172.21.15.132:0/2571092682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc15a5a0 0x7f81dc06a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:24.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81daffd700 1 --2- 172.21.15.132:0/2571092682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc06a920 0x7f81dc070af0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009850 tx=0x7f81d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d3bad8dbd48c03 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81da7fc700 1 -- 172.21.15.132:0/2571092682 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0005e30 con 0x7f81dc06a920 2023-05-10T04:20:24.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81da7fc700 1 -- 172.21.15.132:0/2571092682 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0006030 con 0x7f81dc06a920 2023-05-10T04:20:24.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.019+0000 7f81da7fc700 1 -- 172.21.15.132:0/2571092682 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d00063c0 con 0x7f81dc06a920 2023-05-10T04:20:24.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.020+0000 7f81e1bff700 1 -- 172.21.15.132:0/2571092682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc06a920 msgr2=0x7f81dc070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.020+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2571092682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc06a920 0x7f81dc070af0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f81d0009850 tx=0x7f81d0009b60 comp rx=0 tx=0).stop 2023-05-10T04:20:24.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.020+0000 7f81e1bff700 1 -- 172.21.15.132:0/2571092682 shutdown_connections 2023-05-10T04:20:24.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.020+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2571092682 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc15a5a0 0x7f81dc06a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.020+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2571092682 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc06a920 0x7f81dc070af0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.020+0000 7f81e1bff700 1 -- 172.21.15.132:0/2571092682 >> 172.21.15.132:0/2571092682 conn(0x7f81dc0cf720 msgr2=0x7f81dc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:24.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.020+0000 7f81e1bff700 1 -- 172.21.15.132:0/2571092682 shutdown_connections 2023-05-10T04:20:24.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.020+0000 7f81e1bff700 1 -- 172.21.15.132:0/2571092682 wait complete. 2023-05-10T04:20:24.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.022+0000 7f81e1bff700 1 Processor -- start 2023-05-10T04:20:24.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.023+0000 7f81e1bff700 1 -- start start 2023-05-10T04:20:24.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81e1bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc06a920 0x7f81dc14ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81e1bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc071030 0x7f81dc15c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81e1bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc15a5a0 0x7f81dc0b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81e1bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc15d220 con 0x7f81dc071030 2023-05-10T04:20:24.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81e1bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc15d500 con 0x7f81dc15a5a0 2023-05-10T04:20:24.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81e1bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81dc15d7e0 con 0x7f81dc06a920 2023-05-10T04:20:24.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81daffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc071030 0x7f81dc15c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81daffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc071030 0x7f81dc15c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39080/0 (socket says 172.21.15.132:39080) 2023-05-10T04:20:24.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81daffd700 1 -- 172.21.15.132:0/2852451732 learned_addr learned my addr 172.21.15.132:0/2852451732 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:24.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81db7fe700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc06a920 0x7f81dc14ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81dbfff700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc15a5a0 0x7f81dc0b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81daffd700 1 -- 172.21.15.132:0/2852451732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc06a920 msgr2=0x7f81dc14ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81daffd700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc06a920 0x7f81dc14ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81daffd700 1 -- 172.21.15.132:0/2852451732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc15a5a0 msgr2=0x7f81dc0b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81daffd700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc15a5a0 0x7f81dc0b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.024+0000 7f81daffd700 1 -- 172.21.15.132:0/2852451732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc0094a0 con 0x7f81dc071030 2023-05-10T04:20:24.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.025+0000 7f81daffd700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc071030 0x7f81dc15c760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f81dc070600 tx=0x7f81d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.025+0000 7f81c3fff700 1 -- 172.21.15.132:0/2852451732 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0006870 con 0x7f81dc071030 2023-05-10T04:20:24.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.025+0000 7f81c3fff700 1 -- 172.21.15.132:0/2852451732 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d0020070 con 0x7f81dc071030 2023-05-10T04:20:24.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.025+0000 7f81c3fff700 1 -- 172.21.15.132:0/2852451732 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0025650 con 0x7f81dc071030 2023-05-10T04:20:24.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.025+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d0009430 con 0x7f81dc071030 2023-05-10T04:20:24.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.025+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81dc0719e0 con 0x7f81dc071030 2023-05-10T04:20:24.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.026+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81dc071700 con 0x7f81dc071030 2023-05-10T04:20:24.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.027+0000 7f81c3fff700 1 -- 172.21.15.132:0/2852451732 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81d0022030 con 0x7f81dc071030 2023-05-10T04:20:24.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.028+0000 7f81c3fff700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81c806ace0 0x7f81c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.028+0000 7f81c3fff700 1 -- 172.21.15.132:0/2852451732 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f81d008abf0 con 0x7f81dc071030 2023-05-10T04:20:24.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.029+0000 7f81db7fe700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81c806ace0 0x7f81c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.029+0000 7f81db7fe700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81c806ace0 0x7f81c806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009cd0 tx=0x7f81cc009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.033+0000 7f81c3fff700 1 -- 172.21.15.132:0/2852451732 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f81d00559a0 con 0x7f81dc071030 2023-05-10T04:20:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.229+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81dc06c6c0 con 0x7f81dc071030 2023-05-10T04:20:24.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.230+0000 7f81c3fff700 1 -- 172.21.15.132:0/2852451732 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f81d00069d0 con 0x7f81dc071030 2023-05-10T04:20:24.233 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:24.233 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81c806ace0 msgr2=0x7f81c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81c806ace0 0x7f81c806d190 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009cd0 tx=0x7f81cc009210 comp rx=0 tx=0).stop 2023-05-10T04:20:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc071030 msgr2=0x7f81dc15c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc071030 0x7f81dc15c760 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f81dc070600 tx=0x7f81d0004750 comp rx=0 tx=0).stop 2023-05-10T04:20:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 shutdown_connections 2023-05-10T04:20:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f81c806ace0 0x7f81c806d190 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81dc15a5a0 0x7f81dc0b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81dc06a920 0x7f81dc14ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 --2- 172.21.15.132:0/2852451732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81dc071030 0x7f81dc15c760 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 >> 172.21.15.132:0/2852451732 conn(0x7f81dc0cf720 msgr2=0x7f81dc0b0560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:24.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 shutdown_connections 2023-05-10T04:20:24.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.233+0000 7f81e1bff700 1 -- 172.21.15.132:0/2852451732 wait complete. 2023-05-10T04:20:24.252 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:24.253 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:24.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.438+0000 7fabd3fff700 1 Processor -- start 2023-05-10T04:20:24.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.438+0000 7fabd3fff700 1 -- start start 2023-05-10T04:20:24.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.439+0000 7fabd3fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fabcc0cf010 0x7fabcc160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.439+0000 7fabd3fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc0cd520 con 0x7fabcc0cff50 2023-05-10T04:20:24.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.439+0000 7fabd3fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabcc0d2640 con 0x7fabcc15c590 2023-05-10T04:20:24.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.439+0000 7fabd3fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabcc1610d0 con 0x7fabcc0cf010 2023-05-10T04:20:24.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.439+0000 7fabd259c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fabcc0cff50 0x7fabcc0d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49472/0 (socket says 172.21.15.132:49472) 2023-05-10T04:20:24.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.439+0000 7fabd259c700 1 -- 172.21.15.132:0/2992851304 learned_addr learned my addr 172.21.15.132:0/2992851304 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:24.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd159a700 1 --2- 172.21.15.132:0/2992851304 >> v2:172.21.15.154:3300/0 conn(0x7fabcc0cf010 0x7fabcc160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234232744 0 0) 0x7fabcc0cd520 con 0x7fabcc0cff50 2023-05-10T04:20:24.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb80035b0 con 0x7fabcc0cff50 2023-05-10T04:20:24.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1950594370 0 0) 0x7fabb80035b0 con 0x7fabcc0cff50 2023-05-10T04:20:24.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 >> v2:172.21.15.154:3300/0 conn(0x7fabcc0cf010 msgr2=0x7fabcc160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:24.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 --2- 172.21.15.132:0/2992851304 >> v2:172.21.15.154:3300/0 conn(0x7fabcc0cf010 0x7fabcc160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 >> v1:172.21.15.154:6789/0 conn(0x7fabcc15c590 legacy=0x7fabcc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0b23c0 con 0x7fabcc0cff50 2023-05-10T04:20:24.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fabc40019f0 con 0x7fabcc0cff50 2023-05-10T04:20:24.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 >> v1:172.21.15.132:6789/0 conn(0x7fabcc0cff50 legacy=0x7fabcc0d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8003a50 0x7fabb8003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabb8004850 0x7fabb8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabb800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc1610d0 con 0x7fabb8005200 2023-05-10T04:20:24.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb800c0e0 con 0x7fabb8003a50 2023-05-10T04:20:24.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb800c2a0 con 0x7fabb8004850 2023-05-10T04:20:24.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.440+0000 7fabd259c700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabb800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd1d9b700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8003a50 0x7fabb8003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd159a700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabb8004850 0x7fabb8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd259c700 1 -- 172.21.15.132:0/2992851304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabb8004850 msgr2=0x7fabb8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:24.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd259c700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabb8004850 0x7fabb8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd259c700 1 -- 172.21.15.132:0/2992851304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8003a50 msgr2=0x7fabb8003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:24.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd259c700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabb8003a50 0x7fabb8003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd259c700 1 -- 172.21.15.132:0/2992851304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb80035b0 con 0x7fabb8005200 2023-05-10T04:20:24.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd259c700 1 -- 172.21.15.132:0/2992851304 reap_dead start 2023-05-10T04:20:24.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd259c700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabb800ba10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fabc4002230 tx=0x7fabb8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7fdf75ea501e862 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc400a250 con 0x7fabb8005200 2023-05-10T04:20:24.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc40072f0 con 0x7fabb8005200 2023-05-10T04:20:24.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.441+0000 7fabd0d99700 1 -- 172.21.15.132:0/2992851304 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc40076a0 con 0x7fabb8005200 2023-05-10T04:20:24.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.442+0000 7fabd3fff700 1 -- 172.21.15.132:0/2992851304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 msgr2=0x7fabb800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.442+0000 7fabd3fff700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabb800ba10 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fabc4002230 tx=0x7fabb8005880 comp rx=0 tx=0).stop 2023-05-10T04:20:24.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.442+0000 7fabd3fff700 1 -- 172.21.15.132:0/2992851304 shutdown_connections 2023-05-10T04:20:24.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.442+0000 7fabd3fff700 1 --2- 172.21.15.132:0/2992851304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabb800ba10 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.442+0000 7fabd3fff700 1 -- 172.21.15.132:0/2992851304 >> 172.21.15.132:0/2992851304 conn(0x7fabcc071b10 msgr2=0x7fabcc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:24.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.442+0000 7fabd3fff700 1 -- 172.21.15.132:0/2992851304 shutdown_connections 2023-05-10T04:20:24.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.442+0000 7fabd3fff700 1 -- 172.21.15.132:0/2992851304 wait complete. 2023-05-10T04:20:24.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.444+0000 7fabd3fff700 1 Processor -- start 2023-05-10T04:20:24.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.444+0000 7fabd3fff700 1 -- start start 2023-05-10T04:20:24.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd3fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabcc14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd3fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabcc0c77f0 0x7fabcc0b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd3fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc0b81d0 0x7fabcc0b6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd3fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc15d580 con 0x7fabb8005200 2023-05-10T04:20:24.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd3fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0b8640 con 0x7fabcc0b81d0 2023-05-10T04:20:24.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd3fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabcc0c7c60 con 0x7fabcc0c77f0 2023-05-10T04:20:24.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd1d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabcc14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd1d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabcc14f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39104/0 (socket says 172.21.15.132:39104) 2023-05-10T04:20:24.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.445+0000 7fabd1d9b700 1 -- 172.21.15.132:0/1709188165 learned_addr learned my addr 172.21.15.132:0/1709188165 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:24.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd1d9b700 1 -- 172.21.15.132:0/1709188165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabcc0c77f0 msgr2=0x7fabcc0b7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd1d9b700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabcc0c77f0 0x7fabcc0b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd1d9b700 1 -- 172.21.15.132:0/1709188165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc0b81d0 msgr2=0x7fabcc0b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd259c700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc0b81d0 0x7fabcc0b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd1d9b700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc0b81d0 0x7fabcc0b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd1d9b700 1 -- 172.21.15.132:0/1709188165 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabcc0cd770 con 0x7fabb8005200 2023-05-10T04:20:24.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd259c700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc0b81d0 0x7fabcc0b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:24.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd1d9b700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabcc14f450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fabc800f820 tx=0x7fabc800fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabc27fc700 1 -- 172.21.15.132:0/1709188165 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80052e0 con 0x7fabb8005200 2023-05-10T04:20:24.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabc27fc700 1 -- 172.21.15.132:0/1709188165 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc8005440 con 0x7fabb8005200 2023-05-10T04:20:24.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabc27fc700 1 -- 172.21.15.132:0/1709188165 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80038a0 con 0x7fabb8005200 2023-05-10T04:20:24.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabcc0cf560 con 0x7fabb8005200 2023-05-10T04:20:24.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.446+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabcc15c960 con 0x7fabb8005200 2023-05-10T04:20:24.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.447+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabcc15d7f0 con 0x7fabb8005200 2023-05-10T04:20:24.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.448+0000 7fabc27fc700 1 -- 172.21.15.132:0/1709188165 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fabc8003a00 con 0x7fabb8005200 2023-05-10T04:20:24.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.450+0000 7fabc27fc700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fabb006ace0 0x7fabb006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.450+0000 7fabc27fc700 1 -- 172.21.15.132:0/1709188165 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fabc8089600 con 0x7fabb8005200 2023-05-10T04:20:24.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.450+0000 7fabd159a700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fabb006ace0 0x7fabb006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.450+0000 7fabd159a700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fabb006ace0 0x7fabb006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0b43a0 tx=0x7fabbc0093c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.454+0000 7fabc27fc700 1 -- 172.21.15.132:0/1709188165 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fabc8054320 con 0x7fabb8005200 2023-05-10T04:20:24.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.652+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fabcc15b960 con 0x7fabb8005200 2023-05-10T04:20:24.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.652+0000 7fabc27fc700 1 -- 172.21.15.132:0/1709188165 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabc8003cb0 con 0x7fabb8005200 2023-05-10T04:20:24.655 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:24.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fabb006ace0 msgr2=0x7fabb006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fabb006ace0 0x7fabb006d190 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fabcc0b43a0 tx=0x7fabbc0093c0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 msgr2=0x7fabcc14f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabcc14f450 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fabc800f820 tx=0x7fabc800fbe0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 shutdown_connections 2023-05-10T04:20:24.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fabb006ace0 0x7fabb006d190 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fabcc0b81d0 0x7fabcc0b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabb8005200 0x7fabcc14f450 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 --2- 172.21.15.132:0/1709188165 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fabcc0c77f0 0x7fabcc0b7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 >> 172.21.15.132:0/1709188165 conn(0x7fabcc071b10 msgr2=0x7fabcc0d0d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:24.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 shutdown_connections 2023-05-10T04:20:24.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.655+0000 7fabd3fff700 1 -- 172.21.15.132:0/1709188165 wait complete. 2023-05-10T04:20:24.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:24.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.858+0000 7fb50fbff700 1 Processor -- start 2023-05-10T04:20:24.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.858+0000 7fb50fbff700 1 -- start start 2023-05-10T04:20:24.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.859+0000 7fb50fbff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.859+0000 7fb50fbff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb5080cfe20 0x7fb5080b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.859+0000 7fb50fbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50815d660 con 0x7fb50815a140 2023-05-10T04:20:24.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.859+0000 7fb50fbff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5080d02a0 con 0x7fb5080cfe20 2023-05-10T04:20:24.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50fbff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50815cd70 con 0x7fb5080cd520 2023-05-10T04:20:24.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50e19c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb5080cfe20 0x7fb5080b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50e19c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb5080cfe20 0x7fb5080b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39106/0 (socket says 172.21.15.132:39106) 2023-05-10T04:20:24.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50e19c700 1 -- 172.21.15.132:0/2460298679 learned_addr learned my addr 172.21.15.132:0/2460298679 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:24.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50d19a700 1 --2- 172.21.15.132:0/2460298679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50e19c700 1 -- 172.21.15.132:0/2460298679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 msgr2=0x7fb5080cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:24.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50e19c700 1 --2- 172.21.15.132:0/2460298679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50e19c700 1 -- 172.21.15.132:0/2460298679 >> v1:172.21.15.154:6789/0 conn(0x7fb50815a140 legacy=0x7fb508160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50e19c700 1 -- 172.21.15.132:0/2460298679 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50815d010 con 0x7fb5080cfe20 2023-05-10T04:20:24.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.860+0000 7fb50e19c700 1 --2- 172.21.15.132:0/2460298679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb5080b1b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb500009e80 tx=0x7fb50000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffad14e9f9bfa209 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50c999700 1 -- 172.21.15.132:0/2460298679 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50000e070 con 0x7fb5080cfe20 2023-05-10T04:20:24.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50c999700 1 -- 172.21.15.132:0/2460298679 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50000b8d0 con 0x7fb5080cfe20 2023-05-10T04:20:24.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50c999700 1 -- 172.21.15.132:0/2460298679 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50000bc80 con 0x7fb5080cfe20 2023-05-10T04:20:24.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50fbff700 1 -- 172.21.15.132:0/2460298679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 msgr2=0x7fb5080b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50fbff700 1 --2- 172.21.15.132:0/2460298679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb5080b1b70 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb500009e80 tx=0x7fb50000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:24.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50fbff700 1 -- 172.21.15.132:0/2460298679 shutdown_connections 2023-05-10T04:20:24.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50fbff700 1 --2- 172.21.15.132:0/2460298679 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb5080b1b70 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50fbff700 1 --2- 172.21.15.132:0/2460298679 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50fbff700 1 -- 172.21.15.132:0/2460298679 >> 172.21.15.132:0/2460298679 conn(0x7fb508071b10 msgr2=0x7fb508071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:24.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50fbff700 1 -- 172.21.15.132:0/2460298679 shutdown_connections 2023-05-10T04:20:24.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.861+0000 7fb50fbff700 1 -- 172.21.15.132:0/2460298679 wait complete. 2023-05-10T04:20:24.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.863+0000 7fb50fbff700 1 Processor -- start 2023-05-10T04:20:24.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.863+0000 7fb50fbff700 1 -- start start 2023-05-10T04:20:24.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50fbff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080d16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50fbff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb508156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50fbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50815a140 0x7fb5080d2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50fbff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5081f30c0 con 0x7fb5080cfe20 2023-05-10T04:20:24.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50fbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080d0be0 con 0x7fb50815a140 2023-05-10T04:20:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50fbff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5080d0ec0 con 0x7fb5080cd520 2023-05-10T04:20:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50d19a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb508156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50d19a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb508156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39122/0 (socket says 172.21.15.132:39122) 2023-05-10T04:20:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50d19a700 1 -- 172.21.15.132:0/3811769879 learned_addr learned my addr 172.21.15.132:0/3811769879 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50e19c700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50815a140 0x7fb5080d2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.864+0000 7fb50d99b700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080d16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50d19a700 1 -- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 msgr2=0x7fb5080d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50d19a700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080d16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50d19a700 1 -- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50815a140 msgr2=0x7fb5080d2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:24.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50d19a700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50815a140 0x7fb5080d2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:24.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50d19a700 1 -- 172.21.15.132:0/3811769879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb500009b30 con 0x7fb5080cfe20 2023-05-10T04:20:24.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50d99b700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:24.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50d19a700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb508156ff0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800e9b0 tx=0x7fb4f800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb4fe7fc700 1 -- 172.21.15.132:0/3811769879 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f8009710 con 0x7fb5080cfe20 2023-05-10T04:20:24.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb4fe7fc700 1 -- 172.21.15.132:0/3811769879 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4f800c850 con 0x7fb5080cfe20 2023-05-10T04:20:24.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb4fe7fc700 1 -- 172.21.15.132:0/3811769879 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4f800cbc0 con 0x7fb5080cfe20 2023-05-10T04:20:24.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50815daf0 con 0x7fb5080cfe20 2023-05-10T04:20:24.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.865+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50815d2f0 con 0x7fb5080cfe20 2023-05-10T04:20:24.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.867+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5080cdb00 con 0x7fb5080cfe20 2023-05-10T04:20:24.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.867+0000 7fb4fe7fc700 1 -- 172.21.15.132:0/3811769879 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4f800cd20 con 0x7fb5080cfe20 2023-05-10T04:20:24.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.868+0000 7fb4fe7fc700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4ec06ace0 0x7fb4ec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:24.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.869+0000 7fb4fe7fc700 1 -- 172.21.15.132:0/3811769879 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb4f8089770 con 0x7fb5080cfe20 2023-05-10T04:20:24.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.869+0000 7fb50d99b700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4ec06ace0 0x7fb4ec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:24.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.869+0000 7fb50d99b700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4ec06ace0 0x7fb4ec06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5080cc940 tx=0x7fb504009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:24.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:24.873+0000 7fb4fe7fc700 1 -- 172.21.15.132:0/3811769879 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb4f80545c0 con 0x7fb5080cfe20 2023-05-10T04:20:25.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.068+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fb5080b51f0 con 0x7fb5080cfe20 2023-05-10T04:20:25.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.069+0000 7fb4fe7fc700 1 -- 172.21.15.132:0/3811769879 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fb4f8057be0 con 0x7fb5080cfe20 2023-05-10T04:20:25.071 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:25.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4ec06ace0 msgr2=0x7fb4ec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4ec06ace0 0x7fb4ec06d190 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5080cc940 tx=0x7fb504009040 comp rx=0 tx=0).stop 2023-05-10T04:20:25.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 msgr2=0x7fb508156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb508156ff0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb4f800e9b0 tx=0x7fb4f800ecc0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 shutdown_connections 2023-05-10T04:20:25.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4ec06ace0 0x7fb4ec06d190 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50815a140 0x7fb5080d2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb5080cd520 0x7fb5080d16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 --2- 172.21.15.132:0/3811769879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5080cfe20 0x7fb508156ff0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 >> 172.21.15.132:0/3811769879 conn(0x7fb508071b10 msgr2=0x7fb5080b5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:25.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 shutdown_connections 2023-05-10T04:20:25.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.071+0000 7fb50fbff700 1 -- 172.21.15.132:0/3811769879 wait complete. 2023-05-10T04:20:25.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:25.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.274+0000 7fb5135ff700 1 Processor -- start 2023-05-10T04:20:25.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.274+0000 7fb5135ff700 1 -- start start 2023-05-10T04:20:25.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.275+0000 7fb5135ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 0x7fb50c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.275+0000 7fb5135ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb50c0d1100 0x7fb50c0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.275+0000 7fb5135ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb50c0d0020 con 0x7fb50c0b87a0 2023-05-10T04:20:25.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.275+0000 7fb5135ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb50c0d02d0 con 0x7fb50c0d1100 2023-05-10T04:20:25.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.275+0000 7fb5135ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0d0cb0 con 0x7fb50c0cfbf0 2023-05-10T04:20:25.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.275+0000 7fb51139b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb50c0b87a0 0x7fb50c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49474/0 (socket says 172.21.15.132:49474) 2023-05-10T04:20:25.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.275+0000 7fb51139b700 1 -- 172.21.15.132:0/273610503 learned_addr learned my addr 172.21.15.132:0/273610503 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:25.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.275+0000 7fb511b9c700 1 --2- 172.21.15.132:0/273610503 >> v2:172.21.15.132:3300/0 conn(0x7fb50c0d1100 0x7fb50c0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb510b9a700 1 --2- 172.21.15.132:0/273610503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 0x7fb50c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb503fff700 1 -- 172.21.15.132:0/273610503 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287705221 0 0) 0x7fb50c0d0020 con 0x7fb50c0b87a0 2023-05-10T04:20:25.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb503fff700 1 -- 172.21.15.132:0/273610503 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb4f80035b0 con 0x7fb50c0b87a0 2023-05-10T04:20:25.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb511b9c700 1 -- 172.21.15.132:0/273610503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 msgr2=0x7fb50c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:25.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb511b9c700 1 --2- 172.21.15.132:0/273610503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 0x7fb50c1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb511b9c700 1 -- 172.21.15.132:0/273610503 >> v1:172.21.15.132:6789/0 conn(0x7fb50c0b87a0 legacy=0x7fb50c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb511b9c700 1 -- 172.21.15.132:0/273610503 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0cdc60 con 0x7fb50c0d1100 2023-05-10T04:20:25.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb511b9c700 1 --2- 172.21.15.132:0/273610503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0d1100 0x7fb50c0d1580 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb504009d90 tx=0x7fb50400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=587940e49f43528c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:25.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.276+0000 7fb503fff700 1 -- 172.21.15.132:0/273610503 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50400e070 con 0x7fb50c0d1100 2023-05-10T04:20:25.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb503fff700 1 -- 172.21.15.132:0/273610503 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50400bb20 con 0x7fb50c0d1100 2023-05-10T04:20:25.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb503fff700 1 -- 172.21.15.132:0/273610503 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb504012430 con 0x7fb50c0d1100 2023-05-10T04:20:25.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb5135ff700 1 -- 172.21.15.132:0/273610503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0d1100 msgr2=0x7fb50c0d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb5135ff700 1 --2- 172.21.15.132:0/273610503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0d1100 0x7fb50c0d1580 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb504009d90 tx=0x7fb50400b330 comp rx=0 tx=0).stop 2023-05-10T04:20:25.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb5135ff700 1 -- 172.21.15.132:0/273610503 shutdown_connections 2023-05-10T04:20:25.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb5135ff700 1 --2- 172.21.15.132:0/273610503 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0d1100 0x7fb50c0d1580 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb5135ff700 1 --2- 172.21.15.132:0/273610503 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 0x7fb50c1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb5135ff700 1 -- 172.21.15.132:0/273610503 >> 172.21.15.132:0/273610503 conn(0x7fb50c071b10 msgr2=0x7fb50c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:25.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb5135ff700 1 -- 172.21.15.132:0/273610503 shutdown_connections 2023-05-10T04:20:25.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.277+0000 7fb5135ff700 1 -- 172.21.15.132:0/273610503 wait complete. 2023-05-10T04:20:25.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.279+0000 7fb5135ff700 1 Processor -- start 2023-05-10T04:20:25.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.279+0000 7fb5135ff700 1 -- start start 2023-05-10T04:20:25.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb5135ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0b87a0 0x7fb50c0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb5135ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 0x7fb50c15f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb5135ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d1100 0x7fb50c0d28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb5135ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c15de70 con 0x7fb50c0b87a0 2023-05-10T04:20:25.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb5135ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c0cc030 con 0x7fb50c0d1100 2023-05-10T04:20:25.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb5135ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb50c15cdd0 con 0x7fb50c0cfbf0 2023-05-10T04:20:25.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb51139b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0b87a0 0x7fb50c0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb51139b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0b87a0 0x7fb50c0cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39132/0 (socket says 172.21.15.132:39132) 2023-05-10T04:20:25.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb51139b700 1 -- 172.21.15.132:0/2743403504 learned_addr learned my addr 172.21.15.132:0/2743403504 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:25.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb510b9a700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 0x7fb50c15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb511b9c700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d1100 0x7fb50c0d28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb51139b700 1 -- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 msgr2=0x7fb50c15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb51139b700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 0x7fb50c15f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb51139b700 1 -- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d1100 msgr2=0x7fb50c0d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb51139b700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d1100 0x7fb50c0d28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb51139b700 1 -- 172.21.15.132:0/2743403504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb504009a70 con 0x7fb50c0b87a0 2023-05-10T04:20:25.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.280+0000 7fb511b9c700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d1100 0x7fb50c0d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:25.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.281+0000 7fb51139b700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0b87a0 0x7fb50c0cbaf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb508001eb0 tx=0x7fb50800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:25.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.281+0000 7fb501ffb700 1 -- 172.21.15.132:0/2743403504 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508005d70 con 0x7fb50c0b87a0 2023-05-10T04:20:25.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.281+0000 7fb501ffb700 1 -- 172.21.15.132:0/2743403504 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5080070d0 con 0x7fb50c0b87a0 2023-05-10T04:20:25.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.281+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb50c0cd980 con 0x7fb50c0b87a0 2023-05-10T04:20:25.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.281+0000 7fb501ffb700 1 -- 172.21.15.132:0/2743403504 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb508007460 con 0x7fb50c0b87a0 2023-05-10T04:20:25.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.281+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb50c0cd6a0 con 0x7fb50c0b87a0 2023-05-10T04:20:25.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.282+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb50c160e30 con 0x7fb50c0b87a0 2023-05-10T04:20:25.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.283+0000 7fb501ffb700 1 -- 172.21.15.132:0/2743403504 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb5080075c0 con 0x7fb50c0b87a0 2023-05-10T04:20:25.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.284+0000 7fb501ffb700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4f006ace0 0x7fb4f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.284+0000 7fb501ffb700 1 -- 172.21.15.132:0/2743403504 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb508088c60 con 0x7fb50c0b87a0 2023-05-10T04:20:25.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.284+0000 7fb510b9a700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4f006ace0 0x7fb4f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.285+0000 7fb510b9a700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4f006ace0 0x7fb4f006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0c9c60 tx=0x7fb4fc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:25.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.288+0000 7fb501ffb700 1 -- 172.21.15.132:0/2743403504 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb508053ab0 con 0x7fb50c0b87a0 2023-05-10T04:20:25.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.485+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb50c074430 con 0x7fb50c0b87a0 2023-05-10T04:20:25.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.485+0000 7fb501ffb700 1 -- 172.21.15.132:0/2743403504 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb5080570d0 con 0x7fb50c0b87a0 2023-05-10T04:20:25.487 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:25.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.487+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4f006ace0 msgr2=0x7fb4f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.487+0000 7fb5135ff700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4f006ace0 0x7fb4f006d190 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb50c0c9c60 tx=0x7fb4fc008040 comp rx=0 tx=0).stop 2023-05-10T04:20:25.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.487+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0b87a0 msgr2=0x7fb50c0cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.487+0000 7fb5135ff700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0b87a0 0x7fb50c0cbaf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb508001eb0 tx=0x7fb50800c860 comp rx=0 tx=0).stop 2023-05-10T04:20:25.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.488+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 shutdown_connections 2023-05-10T04:20:25.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.488+0000 7fb5135ff700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4f006ace0 0x7fb4f006d190 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.488+0000 7fb5135ff700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb50c0d1100 0x7fb50c0d28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.488+0000 7fb5135ff700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb50c0b87a0 0x7fb50c0cbaf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.488+0000 7fb5135ff700 1 --2- 172.21.15.132:0/2743403504 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb50c0cfbf0 0x7fb50c15f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.488+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 >> 172.21.15.132:0/2743403504 conn(0x7fb50c071b10 msgr2=0x7fb50c0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:25.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.488+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 shutdown_connections 2023-05-10T04:20:25.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.488+0000 7fb5135ff700 1 -- 172.21.15.132:0/2743403504 wait complete. 2023-05-10T04:20:25.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.693+0000 7feea43ff700 1 Processor -- start 2023-05-10T04:20:25.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.693+0000 7feea43ff700 1 -- start start 2023-05-10T04:20:25.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.694+0000 7feea43ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0cfbf0 0x7fee9c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.694+0000 7feea43ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee9c0d1100 0x7fee9c0d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.694+0000 7feea43ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c0d0020 con 0x7fee9c0b87a0 2023-05-10T04:20:25.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.694+0000 7feea43ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0d02d0 con 0x7fee9c0d1100 2023-05-10T04:20:25.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.694+0000 7feea43ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0d0cb0 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.695+0000 7feea199a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0cfbf0 0x7fee9c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.695+0000 7feea299c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fee9c0d1100 0x7fee9c0d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.695+0000 7feea199a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0cfbf0 0x7fee9c1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:41596/0 (socket says 172.21.15.132:41596) 2023-05-10T04:20:25.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.695+0000 7feea199a700 1 -- 172.21.15.132:0/1844664823 learned_addr learned my addr 172.21.15.132:0/1844664823 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:25.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.695+0000 7feea1199700 1 -- 172.21.15.132:0/1844664823 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301944476 0 0) 0x7fee9c0d0020 con 0x7fee9c0b87a0 2023-05-10T04:20:25.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea1199700 1 -- 172.21.15.132:0/1844664823 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee880035b0 con 0x7fee9c0b87a0 2023-05-10T04:20:25.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea199a700 1 -- 172.21.15.132:0/1844664823 >> v2:172.21.15.154:3300/0 conn(0x7fee9c0d1100 msgr2=0x7fee9c0d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:25.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea199a700 1 --2- 172.21.15.132:0/1844664823 >> v2:172.21.15.154:3300/0 conn(0x7fee9c0d1100 0x7fee9c0d1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea199a700 1 -- 172.21.15.132:0/1844664823 >> v1:172.21.15.154:6789/0 conn(0x7fee9c0b87a0 legacy=0x7fee9c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea199a700 1 -- 172.21.15.132:0/1844664823 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c0cdc60 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea299c700 1 --2- 172.21.15.132:0/1844664823 >> v2:172.21.15.154:3300/0 conn(0x7fee9c0d1100 0x7fee9c0d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:25.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea199a700 1 --2- 172.21.15.132:0/1844664823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0cfbf0 0x7fee9c1608f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0098f0 tx=0x7fee8c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bb1a5d4e93859d1 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:25.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea1199700 1 -- 172.21.15.132:0/1844664823 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c011830 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea1199700 1 -- 172.21.15.132:0/1844664823 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c011990 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.696+0000 7feea1199700 1 -- 172.21.15.132:0/1844664823 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c011d20 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.697+0000 7feea43ff700 1 -- 172.21.15.132:0/1844664823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0cfbf0 msgr2=0x7fee9c1608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.697+0000 7feea43ff700 1 --2- 172.21.15.132:0/1844664823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0cfbf0 0x7fee9c1608f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0098f0 tx=0x7fee8c009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:25.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.697+0000 7feea43ff700 1 -- 172.21.15.132:0/1844664823 shutdown_connections 2023-05-10T04:20:25.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.697+0000 7feea43ff700 1 --2- 172.21.15.132:0/1844664823 >> v2:172.21.15.154:3300/0 conn(0x7fee9c0d1100 0x7fee9c0d1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.697+0000 7feea43ff700 1 --2- 172.21.15.132:0/1844664823 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0cfbf0 0x7fee9c1608f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.697+0000 7feea43ff700 1 -- 172.21.15.132:0/1844664823 >> 172.21.15.132:0/1844664823 conn(0x7fee9c071b10 msgr2=0x7fee9c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:25.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.697+0000 7feea43ff700 1 -- 172.21.15.132:0/1844664823 shutdown_connections 2023-05-10T04:20:25.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.697+0000 7feea43ff700 1 -- 172.21.15.132:0/1844664823 wait complete. 2023-05-10T04:20:25.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.698+0000 7feea43ff700 1 Processor -- start 2023-05-10T04:20:25.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.699+0000 7feea43ff700 1 -- start start 2023-05-10T04:20:25.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea43ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee9c0b87a0 0x7fee9c15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea43ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee9c0cfbf0 0x7fee9c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea43ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0d1100 0x7fee9c14a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea43ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0c6f20 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea43ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0c71f0 con 0x7fee9c0b87a0 2023-05-10T04:20:25.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea43ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0c74d0 con 0x7fee9c0d1100 2023-05-10T04:20:25.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee9c0cfbf0 0x7fee9c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee9c0cfbf0 0x7fee9c0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39138/0 (socket says 172.21.15.132:39138) 2023-05-10T04:20:25.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 -- 172.21.15.132:0/2987422507 learned_addr learned my addr 172.21.15.132:0/2987422507 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:25.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea299c700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0d1100 0x7fee9c14a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea219b700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee9c0b87a0 0x7fee9c15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 -- 172.21.15.132:0/2987422507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0d1100 msgr2=0x7fee9c14a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0d1100 0x7fee9c14a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 -- 172.21.15.132:0/2987422507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee9c0b87a0 msgr2=0x7fee9c15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee9c0b87a0 0x7fee9c15f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 -- 172.21.15.132:0/2987422507 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009a70 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.700+0000 7feea199a700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee9c0cfbf0 0x7fee9c0c69e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009c40 tx=0x7fee8c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:25.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.701+0000 7fee92ffd700 1 -- 172.21.15.132:0/2987422507 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c004590 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.701+0000 7fee92ffd700 1 -- 172.21.15.132:0/2987422507 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c01e070 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.701+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee8c009550 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.701+0000 7fee92ffd700 1 -- 172.21.15.132:0/2987422507 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c0038e0 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.701+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c0cd980 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.702+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c0cd6a0 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.703+0000 7fee92ffd700 1 -- 172.21.15.132:0/2987422507 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee8c003a40 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.704+0000 7fee92ffd700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fee8006ace0 0x7fee8006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:25.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.704+0000 7fee92ffd700 1 -- 172.21.15.132:0/2987422507 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee8c08a6a0 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.704+0000 7feea219b700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fee8006ace0 0x7fee8006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:25.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.704+0000 7feea219b700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fee8006ace0 0x7fee8006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee98007fd0 tx=0x7fee98009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:25.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.708+0000 7fee92ffd700 1 -- 172.21.15.132:0/2987422507 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fee8c055450 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.902+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee9c160e30 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.903+0000 7fee92ffd700 1 -- 172.21.15.132:0/2987422507 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee8c058a70 con 0x7fee9c0cfbf0 2023-05-10T04:20:25.905 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:25.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fee8006ace0 msgr2=0x7fee8006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fee8006ace0 0x7fee8006d190 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fee98007fd0 tx=0x7fee98009040 comp rx=0 tx=0).stop 2023-05-10T04:20:25.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee9c0cfbf0 msgr2=0x7fee9c0c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:25.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee9c0cfbf0 0x7fee9c0c69e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009c40 tx=0x7fee8c004750 comp rx=0 tx=0).stop 2023-05-10T04:20:25.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 shutdown_connections 2023-05-10T04:20:25.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fee8006ace0 0x7fee8006d190 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fee9c0d1100 0x7fee9c14a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fee9c0b87a0 0x7fee9c15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 --2- 172.21.15.132:0/2987422507 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee9c0cfbf0 0x7fee9c0c69e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:25.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.905+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 >> 172.21.15.132:0/2987422507 conn(0x7fee9c071b10 msgr2=0x7fee9c0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:25.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.906+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 shutdown_connections 2023-05-10T04:20:25.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:25.906+0000 7feea43ff700 1 -- 172.21.15.132:0/2987422507 wait complete. 2023-05-10T04:20:25.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:26.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.114+0000 7fe5691ff700 1 Processor -- start 2023-05-10T04:20:26.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.114+0000 7fe5691ff700 1 -- start start 2023-05-10T04:20:26.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe5691ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5640cd640 0x7fe5640cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe5691ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5640d00b0 0x7fe5640d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe5691ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56415d480 con 0x7fe56415a280 2023-05-10T04:20:26.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe5691ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56415d6e0 con 0x7fe5640cd640 2023-05-10T04:20:26.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe5691ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56415d9c0 con 0x7fe5640d00b0 2023-05-10T04:20:26.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe56259c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5640cd640 0x7fe5640cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe56259c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5640cd640 0x7fe5640cfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39152/0 (socket says 172.21.15.132:39152) 2023-05-10T04:20:26.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe56259c700 1 -- 172.21.15.132:0/2873848398 learned_addr learned my addr 172.21.15.132:0/2873848398 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:26.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe56259c700 1 -- 172.21.15.132:0/2873848398 >> v2:172.21.15.154:3300/0 conn(0x7fe5640d00b0 msgr2=0x7fe5640d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:26.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe56359e700 1 --2- 172.21.15.132:0/2873848398 >> v2:172.21.15.154:3300/0 conn(0x7fe5640d00b0 0x7fe5640d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.115+0000 7fe56259c700 1 --2- 172.21.15.132:0/2873848398 >> v2:172.21.15.154:3300/0 conn(0x7fe5640d00b0 0x7fe5640d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.116+0000 7fe56259c700 1 -- 172.21.15.132:0/2873848398 >> v1:172.21.15.154:6789/0 conn(0x7fe56415a280 legacy=0x7fe56415cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:26.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.116+0000 7fe56259c700 1 -- 172.21.15.132:0/2873848398 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56415dca0 con 0x7fe5640cd640 2023-05-10T04:20:26.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.116+0000 7fe56359e700 1 --2- 172.21.15.132:0/2873848398 >> v2:172.21.15.154:3300/0 conn(0x7fe5640d00b0 0x7fe5640d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:26.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.116+0000 7fe56259c700 1 --2- 172.21.15.132:0/2873848398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5640cd640 0x7fe5640cfb70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe564161400 tx=0x7fe558009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68ac193b52aa2faa server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:26.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.116+0000 7fe561d9b700 1 -- 172.21.15.132:0/2873848398 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe558004230 con 0x7fe5640cd640 2023-05-10T04:20:26.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.116+0000 7fe561d9b700 1 -- 172.21.15.132:0/2873848398 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe558004390 con 0x7fe5640cd640 2023-05-10T04:20:26.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.116+0000 7fe561d9b700 1 -- 172.21.15.132:0/2873848398 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5580036a0 con 0x7fe5640cd640 2023-05-10T04:20:26.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.117+0000 7fe5691ff700 1 -- 172.21.15.132:0/2873848398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5640cd640 msgr2=0x7fe5640cfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.117+0000 7fe5691ff700 1 --2- 172.21.15.132:0/2873848398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5640cd640 0x7fe5640cfb70 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe564161400 tx=0x7fe558009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.117+0000 7fe5691ff700 1 -- 172.21.15.132:0/2873848398 shutdown_connections 2023-05-10T04:20:26.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.117+0000 7fe5691ff700 1 --2- 172.21.15.132:0/2873848398 >> v2:172.21.15.154:3300/0 conn(0x7fe5640d00b0 0x7fe5640d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.117+0000 7fe5691ff700 1 --2- 172.21.15.132:0/2873848398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5640cd640 0x7fe5640cfb70 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.117+0000 7fe5691ff700 1 -- 172.21.15.132:0/2873848398 >> 172.21.15.132:0/2873848398 conn(0x7fe564066260 msgr2=0x7fe564071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:26.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.117+0000 7fe5691ff700 1 -- 172.21.15.132:0/2873848398 shutdown_connections 2023-05-10T04:20:26.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.117+0000 7fe5691ff700 1 -- 172.21.15.132:0/2873848398 wait complete. 2023-05-10T04:20:26.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.118+0000 7fe5691ff700 1 Processor -- start 2023-05-10T04:20:26.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.118+0000 7fe5691ff700 1 -- start start 2023-05-10T04:20:26.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.119+0000 7fe5691ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5640cd640 0x7fe5640cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.119+0000 7fe5691ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5640d00b0 0x7fe5641584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.119+0000 7fe5691ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56415a280 0x7fe5641589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.119+0000 7fe5691ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640b6b30 con 0x7fe56415a280 2023-05-10T04:20:26.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.119+0000 7fe5691ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640cb090 con 0x7fe5640d00b0 2023-05-10T04:20:26.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.119+0000 7fe5691ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5640cb370 con 0x7fe5640cd640 2023-05-10T04:20:26.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56415a280 0x7fe5641589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56415a280 0x7fe5641589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39156/0 (socket says 172.21.15.132:39156) 2023-05-10T04:20:26.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 -- 172.21.15.132:0/904590613 learned_addr learned my addr 172.21.15.132:0/904590613 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:26.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe562d9d700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5640cd640 0x7fe5640cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56259c700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5640d00b0 0x7fe5641584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 -- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5640cd640 msgr2=0x7fe5640cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5640cd640 0x7fe5640cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 -- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5640d00b0 msgr2=0x7fe5641584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5640d00b0 0x7fe5641584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 -- 172.21.15.132:0/904590613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe558009550 con 0x7fe56415a280 2023-05-10T04:20:26.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56259c700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5640d00b0 0x7fe5641584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:26.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe56359e700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56415a280 0x7fe5641589e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00cef0 tx=0x7fe55c00cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:26.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.120+0000 7fe54b7fe700 1 -- 172.21.15.132:0/904590613 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00adb0 con 0x7fe56415a280 2023-05-10T04:20:26.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.121+0000 7fe54b7fe700 1 -- 172.21.15.132:0/904590613 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c015440 con 0x7fe56415a280 2023-05-10T04:20:26.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.121+0000 7fe54b7fe700 1 -- 172.21.15.132:0/904590613 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c0157f0 con 0x7fe56415a280 2023-05-10T04:20:26.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.121+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5640cf650 con 0x7fe56415a280 2023-05-10T04:20:26.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.121+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5640cf370 con 0x7fe56415a280 2023-05-10T04:20:26.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.122+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56415a650 con 0x7fe56415a280 2023-05-10T04:20:26.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.123+0000 7fe54b7fe700 1 -- 172.21.15.132:0/904590613 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe55c00d430 con 0x7fe56415a280 2023-05-10T04:20:26.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.124+0000 7fe54b7fe700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe55006ace0 0x7fe55006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.124+0000 7fe54b7fe700 1 -- 172.21.15.132:0/904590613 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe55c089d80 con 0x7fe56415a280 2023-05-10T04:20:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.124+0000 7fe562d9d700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe55006ace0 0x7fe55006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.124+0000 7fe562d9d700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe55006ace0 0x7fe55006d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe5640cd150 tx=0x7fe5540090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:26.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.128+0000 7fe54b7fe700 1 -- 172.21.15.132:0/904590613 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe55c054aa0 con 0x7fe56415a280 2023-05-10T04:20:26.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.321+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe5640caef0 con 0x7fe56415a280 2023-05-10T04:20:26.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.321+0000 7fe54b7fe700 1 -- 172.21.15.132:0/904590613 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe5640caef0 con 0x7fe56415a280 2023-05-10T04:20:26.324 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:26.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe55006ace0 msgr2=0x7fe55006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe55006ace0 0x7fe55006d190 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe5640cd150 tx=0x7fe5540090e0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56415a280 msgr2=0x7fe5641589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56415a280 0x7fe5641589e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00cef0 tx=0x7fe55c00cf20 comp rx=0 tx=0).stop 2023-05-10T04:20:26.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 shutdown_connections 2023-05-10T04:20:26.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe55006ace0 0x7fe55006d190 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56415a280 0x7fe5641589e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5640cd640 0x7fe5640cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 --2- 172.21.15.132:0/904590613 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5640d00b0 0x7fe5641584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 >> 172.21.15.132:0/904590613 conn(0x7fe564066260 msgr2=0x7fe5640d1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:26.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 shutdown_connections 2023-05-10T04:20:26.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.324+0000 7fe5691ff700 1 -- 172.21.15.132:0/904590613 wait complete. 2023-05-10T04:20:26.343 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:20:26.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.525+0000 7f81197ff700 1 Processor -- start 2023-05-10T04:20:26.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.525+0000 7f81197ff700 1 -- start start 2023-05-10T04:20:26.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.526+0000 7f81197ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f811415c590 0x7f8114160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f81197ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140cd520 con 0x7f81140cf010 2023-05-10T04:20:26.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f81197ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140d2640 con 0x7f81140cff50 2023-05-10T04:20:26.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f81197ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81141610d0 con 0x7f811415c590 2023-05-10T04:20:26.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f8112ffd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f811415c590 0x7f8114160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f810bfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f81140cf010 0x7f81140cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49486/0 (socket says 172.21.15.132:49486) 2023-05-10T04:20:26.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f810bfff700 1 -- 172.21.15.132:0/4000715536 learned_addr learned my addr 172.21.15.132:0/4000715536 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:26.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f8112ffd700 1 -- 172.21.15.132:0/4000715536 >> v1:172.21.15.154:6789/0 conn(0x7f81140cff50 legacy=0x7f81140d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f8112ffd700 1 -- 172.21.15.132:0/4000715536 >> v1:172.21.15.132:6789/0 conn(0x7f81140cf010 legacy=0x7f81140cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.527+0000 7f8112ffd700 1 -- 172.21.15.132:0/4000715536 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140b23c0 con 0x7f811415c590 2023-05-10T04:20:26.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f8112ffd700 1 --2- 172.21.15.132:0/4000715536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f811415c590 0x7f8114160b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8104009840 tx=0x7f8104009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae76fe9052ac476b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:26.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81127fc700 1 -- 172.21.15.132:0/4000715536 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104011830 con 0x7f811415c590 2023-05-10T04:20:26.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81127fc700 1 -- 172.21.15.132:0/4000715536 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104011990 con 0x7f811415c590 2023-05-10T04:20:26.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81127fc700 1 -- 172.21.15.132:0/4000715536 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104011d20 con 0x7f811415c590 2023-05-10T04:20:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81197ff700 1 -- 172.21.15.132:0/4000715536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f811415c590 msgr2=0x7f8114160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81197ff700 1 --2- 172.21.15.132:0/4000715536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f811415c590 0x7f8114160b90 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f8104009840 tx=0x7f8104009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81197ff700 1 -- 172.21.15.132:0/4000715536 shutdown_connections 2023-05-10T04:20:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81197ff700 1 --2- 172.21.15.132:0/4000715536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f811415c590 0x7f8114160b90 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81197ff700 1 -- 172.21.15.132:0/4000715536 >> 172.21.15.132:0/4000715536 conn(0x7f8114071b10 msgr2=0x7f8114071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81197ff700 1 -- 172.21.15.132:0/4000715536 shutdown_connections 2023-05-10T04:20:26.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.528+0000 7f81197ff700 1 -- 172.21.15.132:0/4000715536 wait complete. 2023-05-10T04:20:26.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.530+0000 7f81197ff700 1 Processor -- start 2023-05-10T04:20:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.530+0000 7f81197ff700 1 -- start start 2023-05-10T04:20:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f81197ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81140cf010 0x7f811414a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f81197ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140cff50 0x7f81141e5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f81197ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811415c590 0x7f81141e64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f81197ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141e7700 con 0x7f81140cf010 2023-05-10T04:20:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f81197ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141e6af0 con 0x7f811415c590 2023-05-10T04:20:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f81197ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81141e6dd0 con 0x7f81140cff50 2023-05-10T04:20:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f8112ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81140cf010 0x7f811414a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f8112ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81140cf010 0x7f811414a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39160/0 (socket says 172.21.15.132:39160) 2023-05-10T04:20:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.531+0000 7f8112ffd700 1 -- 172.21.15.132:0/2316585981 learned_addr learned my addr 172.21.15.132:0/2316585981 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f810bfff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140cff50 0x7f81141e5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f81137fe700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811415c590 0x7f81141e64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f8112ffd700 1 -- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140cff50 msgr2=0x7f81141e5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f8112ffd700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140cff50 0x7f81141e5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f8112ffd700 1 -- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811415c590 msgr2=0x7f81141e64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f8112ffd700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811415c590 0x7f81141e64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f8112ffd700 1 -- 172.21.15.132:0/2316585981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040094a0 con 0x7f81140cf010 2023-05-10T04:20:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f81137fe700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811415c590 0x7f81141e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f810bfff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140cff50 0x7f81141e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f8112ffd700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81140cf010 0x7f811414a4e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8104000c00 tx=0x7f8104004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f810b7fe700 1 -- 172.21.15.132:0/2316585981 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040038a0 con 0x7f81140cf010 2023-05-10T04:20:26.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f810b7fe700 1 -- 172.21.15.132:0/2316585981 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810401e070 con 0x7f81140cf010 2023-05-10T04:20:26.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f810b7fe700 1 -- 172.21.15.132:0/2316585981 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104003c60 con 0x7f81140cf010 2023-05-10T04:20:26.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81140cd770 con 0x7f81140cf010 2023-05-10T04:20:26.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.532+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81140cf560 con 0x7f81140cf010 2023-05-10T04:20:26.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.533+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811415c960 con 0x7f81140cf010 2023-05-10T04:20:26.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.534+0000 7f810b7fe700 1 -- 172.21.15.132:0/2316585981 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f810402d450 con 0x7f81140cf010 2023-05-10T04:20:26.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.535+0000 7f810b7fe700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f80f406ace0 0x7f80f406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:26.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.535+0000 7f810b7fe700 1 -- 172.21.15.132:0/2316585981 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f810408a8f0 con 0x7f81140cf010 2023-05-10T04:20:26.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.535+0000 7f810bfff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f80f406ace0 0x7f80f406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:26.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.536+0000 7f810bfff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f80f406ace0 0x7f80f406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f81140b1fb0 tx=0x7f80fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:26.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.540+0000 7f810b7fe700 1 -- 172.21.15.132:0/2316585981 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f81040556a0 con 0x7f81140cf010 2023-05-10T04:20:26.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.753+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f81140b51f0 con 0x7f81140cf010 2023-05-10T04:20:26.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.754+0000 7f810b7fe700 1 -- 172.21.15.132:0/2316585981 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8104058cc0 con 0x7f81140cf010 2023-05-10T04:20:26.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f80f406ace0 msgr2=0x7f80f406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f80f406ace0 0x7f80f406d190 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f81140b1fb0 tx=0x7f80fc009040 comp rx=0 tx=0).stop 2023-05-10T04:20:26.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81140cf010 msgr2=0x7f811414a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:26.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81140cf010 0x7f811414a4e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f8104000c00 tx=0x7f8104004750 comp rx=0 tx=0).stop 2023-05-10T04:20:26.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 shutdown_connections 2023-05-10T04:20:26.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f80f406ace0 0x7f80f406d190 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f811415c590 0x7f81141e64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81140cf010 0x7f811414a4e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 --2- 172.21.15.132:0/2316585981 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81140cff50 0x7f81141e5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:26.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 >> 172.21.15.132:0/2316585981 conn(0x7f8114071b10 msgr2=0x7f81140b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:26.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 shutdown_connections 2023-05-10T04:20:26.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:26.756+0000 7f81197ff700 1 -- 172.21.15.132:0/2316585981 wait complete. 2023-05-10T04:20:26.760 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:20:26.775 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:20:26.776 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:26.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:27.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.035+0000 7ff32bbff700 1 Processor -- start 2023-05-10T04:20:27.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.035+0000 7ff32bbff700 1 -- start start 2023-05-10T04:20:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.036+0000 7ff32bbff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3240d2110 0x7ff324167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.036+0000 7ff32bbff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff324161000 con 0x7ff3240b87a0 2023-05-10T04:20:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32bbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3240d0020 con 0x7ff3240cfbf0 2023-05-10T04:20:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32bbff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3240d02d0 con 0x7ff3240d2110 2023-05-10T04:20:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32999b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff3240b87a0 0x7ff3241601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49498/0 (socket says 172.21.15.132:49498) 2023-05-10T04:20:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32999b700 1 -- 172.21.15.132:0/3742502759 learned_addr learned my addr 172.21.15.132:0/3742502759 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32a19c700 1 --2- 172.21.15.132:0/3742502759 >> v2:172.21.15.132:3300/0 conn(0x7ff3240d2110 0x7ff324167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff328999700 1 -- 172.21.15.132:0/3742502759 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258499409 0 0) 0x7ff324161000 con 0x7ff3240b87a0 2023-05-10T04:20:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff328999700 1 -- 172.21.15.132:0/3742502759 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3100035b0 con 0x7ff3240b87a0 2023-05-10T04:20:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32a19c700 1 -- 172.21.15.132:0/3742502759 >> v1:172.21.15.154:6789/0 conn(0x7ff3240cfbf0 legacy=0x7ff3241608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32a19c700 1 -- 172.21.15.132:0/3742502759 >> v1:172.21.15.132:6789/0 conn(0x7ff3240b87a0 legacy=0x7ff3241601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32a19c700 1 -- 172.21.15.132:0/3742502759 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3240cdc60 con 0x7ff3240d2110 2023-05-10T04:20:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.037+0000 7ff32a19c700 1 --2- 172.21.15.132:0/3742502759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff324167550 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009d90 tx=0x7ff31c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51a59c9b590431cc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff328999700 1 -- 172.21.15.132:0/3742502759 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c00e070 con 0x7ff3240d2110 2023-05-10T04:20:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff328999700 1 -- 172.21.15.132:0/3742502759 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c00bb20 con 0x7ff3240d2110 2023-05-10T04:20:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff328999700 1 -- 172.21.15.132:0/3742502759 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c012430 con 0x7ff3240d2110 2023-05-10T04:20:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff32bbff700 1 -- 172.21.15.132:0/3742502759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 msgr2=0x7ff324167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff32bbff700 1 --2- 172.21.15.132:0/3742502759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff324167550 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff31c009d90 tx=0x7ff31c00b330 comp rx=0 tx=0).stop 2023-05-10T04:20:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff32bbff700 1 -- 172.21.15.132:0/3742502759 shutdown_connections 2023-05-10T04:20:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff32bbff700 1 --2- 172.21.15.132:0/3742502759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff324167550 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff32bbff700 1 -- 172.21.15.132:0/3742502759 >> 172.21.15.132:0/3742502759 conn(0x7ff324071b10 msgr2=0x7ff324071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff32bbff700 1 -- 172.21.15.132:0/3742502759 shutdown_connections 2023-05-10T04:20:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.038+0000 7ff32bbff700 1 -- 172.21.15.132:0/3742502759 wait complete. 2023-05-10T04:20:27.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.040+0000 7ff32bbff700 1 Processor -- start 2023-05-10T04:20:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.040+0000 7ff32bbff700 1 -- start start 2023-05-10T04:20:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32bbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3240b87a0 0x7ff32414b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32bbff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3240cfbf0 0x7ff3240c5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32bbff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff32414d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32bbff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32414cb00 con 0x7ff3240d2110 2023-05-10T04:20:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32bbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32414d3a0 con 0x7ff3240b87a0 2023-05-10T04:20:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32bbff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3240b7180 con 0x7ff3240cfbf0 2023-05-10T04:20:27.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32a19c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff32414d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32a19c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff32414d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39186/0 (socket says 172.21.15.132:39186) 2023-05-10T04:20:27.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32a19c700 1 -- 172.21.15.132:0/3946380480 learned_addr learned my addr 172.21.15.132:0/3946380480 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:27.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.041+0000 7ff32999b700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3240b87a0 0x7ff32414b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff32919a700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3240cfbf0 0x7ff3240c5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff32a19c700 1 -- 172.21.15.132:0/3946380480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3240cfbf0 msgr2=0x7ff3240c5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff32a19c700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3240cfbf0 0x7ff3240c5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff32a19c700 1 -- 172.21.15.132:0/3946380480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3240b87a0 msgr2=0x7ff32414b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff32a19c700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3240b87a0 0x7ff32414b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff32a19c700 1 -- 172.21.15.132:0/3946380480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff31c009a70 con 0x7ff3240d2110 2023-05-10T04:20:27.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff32a19c700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff32414d830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b680 tx=0x7ff31c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff31a7fc700 1 -- 172.21.15.132:0/3946380480 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c012430 con 0x7ff3240d2110 2023-05-10T04:20:27.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff31a7fc700 1 -- 172.21.15.132:0/3946380480 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c020070 con 0x7ff3240d2110 2023-05-10T04:20:27.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff31a7fc700 1 -- 172.21.15.132:0/3946380480 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c004280 con 0x7ff3240d2110 2023-05-10T04:20:27.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.042+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3240cd980 con 0x7ff3240d2110 2023-05-10T04:20:27.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.043+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3240cd6a0 con 0x7ff3240d2110 2023-05-10T04:20:27.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.043+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff324167a90 con 0x7ff3240d2110 2023-05-10T04:20:27.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.044+0000 7ff31a7fc700 1 -- 172.21.15.132:0/3946380480 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff31c0043e0 con 0x7ff3240d2110 2023-05-10T04:20:27.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.045+0000 7ff31a7fc700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff30806ace0 0x7ff30806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.045+0000 7ff31a7fc700 1 -- 172.21.15.132:0/3946380480 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff31c022070 con 0x7ff3240d2110 2023-05-10T04:20:27.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.045+0000 7ff32999b700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff30806ace0 0x7ff30806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.046+0000 7ff32999b700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff30806ace0 0x7ff30806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff320007fd0 tx=0x7ff320007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.049+0000 7ff31a7fc700 1 -- 172.21.15.132:0/3946380480 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff31c056160 con 0x7ff3240d2110 2023-05-10T04:20:27.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.246+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff32414d4e0 con 0x7ff3240d2110 2023-05-10T04:20:27.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.247+0000 7ff31a7fc700 1 -- 172.21.15.132:0/3946380480 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7ff31c059780 con 0x7ff3240d2110 2023-05-10T04:20:27.249 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:27.249 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:27.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff30806ace0 msgr2=0x7ff30806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff30806ace0 0x7ff30806d190 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff320007fd0 tx=0x7ff320007dc0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 msgr2=0x7ff32414d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff32414d830 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00b680 tx=0x7ff31c004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 shutdown_connections 2023-05-10T04:20:27.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff30806ace0 0x7ff30806d190 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3240d2110 0x7ff32414d830 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff3240b87a0 0x7ff32414b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 --2- 172.21.15.132:0/3946380480 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff3240cfbf0 0x7ff3240c5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.249+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 >> 172.21.15.132:0/3946380480 conn(0x7ff324071b10 msgr2=0x7ff3241601e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:27.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.250+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 shutdown_connections 2023-05-10T04:20:27.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.250+0000 7ff32bbff700 1 -- 172.21.15.132:0/3946380480 wait complete. 2023-05-10T04:20:27.269 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:27.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:27.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.455+0000 7f33fedff700 1 Processor -- start 2023-05-10T04:20:27.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.456+0000 7f33fedff700 1 -- start start 2023-05-10T04:20:27.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33fedff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33f815c590 0x7f33f8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33fedff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f80cd520 con 0x7f33f80cf010 2023-05-10T04:20:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33fedff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f80d2640 con 0x7f33f80cff50 2023-05-10T04:20:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33fedff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f81610d0 con 0x7f33f815c590 2023-05-10T04:20:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33fcb9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33f815c590 0x7f33f8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33f7fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f33f80cf010 0x7f33f80cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49508/0 (socket says 172.21.15.132:49508) 2023-05-10T04:20:27.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33f7fff700 1 -- 172.21.15.132:0/2138159415 learned_addr learned my addr 172.21.15.132:0/2138159415 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:27.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33fcb9b700 1 -- 172.21.15.132:0/2138159415 >> v1:172.21.15.154:6789/0 conn(0x7f33f80cff50 legacy=0x7f33f80d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33fcb9b700 1 -- 172.21.15.132:0/2138159415 >> v1:172.21.15.132:6789/0 conn(0x7f33f80cf010 legacy=0x7f33f80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33fcb9b700 1 -- 172.21.15.132:0/2138159415 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80b23c0 con 0x7f33f815c590 2023-05-10T04:20:27.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.457+0000 7f33f77fe700 1 -- 172.21.15.132:0/2138159415 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3670091291 0 0) 0x7f33f80cd520 con 0x7f33f80cf010 2023-05-10T04:20:27.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33fcb9b700 1 --2- 172.21.15.132:0/2138159415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f815c590 0x7f33f8160b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009840 tx=0x7f33ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d0a4ebdeb68153 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33f77fe700 1 -- 172.21.15.132:0/2138159415 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec011830 con 0x7f33f815c590 2023-05-10T04:20:27.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33f77fe700 1 -- 172.21.15.132:0/2138159415 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33ec011990 con 0x7f33f815c590 2023-05-10T04:20:27.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33f77fe700 1 -- 172.21.15.132:0/2138159415 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33ec011d20 con 0x7f33f815c590 2023-05-10T04:20:27.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33fedff700 1 -- 172.21.15.132:0/2138159415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f815c590 msgr2=0x7f33f8160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33fedff700 1 --2- 172.21.15.132:0/2138159415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f815c590 0x7f33f8160b90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f33ec009840 tx=0x7f33ec009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33fedff700 1 -- 172.21.15.132:0/2138159415 shutdown_connections 2023-05-10T04:20:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33fedff700 1 --2- 172.21.15.132:0/2138159415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f815c590 0x7f33f8160b90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.458+0000 7f33fedff700 1 -- 172.21.15.132:0/2138159415 >> 172.21.15.132:0/2138159415 conn(0x7f33f8071b10 msgr2=0x7f33f8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.459+0000 7f33fedff700 1 -- 172.21.15.132:0/2138159415 shutdown_connections 2023-05-10T04:20:27.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.459+0000 7f33fedff700 1 -- 172.21.15.132:0/2138159415 wait complete. 2023-05-10T04:20:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.460+0000 7f33fedff700 1 Processor -- start 2023-05-10T04:20:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.460+0000 7f33fedff700 1 -- start start 2023-05-10T04:20:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.461+0000 7f33fedff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f80cf010 0x7f33f8156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.461+0000 7f33fedff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80cff50 0x7f33f80c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.461+0000 7f33fedff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f815c590 0x7f33f80b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.461+0000 7f33fedff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f81e7ce0 con 0x7f33f80cff50 2023-05-10T04:20:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.461+0000 7f33fedff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f81e70f0 con 0x7f33f815c590 2023-05-10T04:20:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.461+0000 7f33fedff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f81e7340 con 0x7f33f80cf010 2023-05-10T04:20:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.461+0000 7f33f7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80cff50 0x7f33f80c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.461+0000 7f33f7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80cff50 0x7f33f80c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39192/0 (socket says 172.21.15.132:39192) 2023-05-10T04:20:27.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f7fff700 1 -- 172.21.15.132:0/2451968556 learned_addr learned my addr 172.21.15.132:0/2451968556 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33fd39c700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f815c590 0x7f33f80b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33fcb9b700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f80cf010 0x7f33f8156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f7fff700 1 -- 172.21.15.132:0/2451968556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f80cf010 msgr2=0x7f33f8156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f7fff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f80cf010 0x7f33f8156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f7fff700 1 -- 172.21.15.132:0/2451968556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f815c590 msgr2=0x7f33f80b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f7fff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f815c590 0x7f33f80b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f7fff700 1 -- 172.21.15.132:0/2451968556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0094a0 con 0x7f33f80cff50 2023-05-10T04:20:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f7fff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80cff50 0x7f33f80c9400 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f33e400c520 tx=0x7f33e400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f57fa700 1 -- 172.21.15.132:0/2451968556 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4004c80 con 0x7f33f80cff50 2023-05-10T04:20:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f57fa700 1 -- 172.21.15.132:0/2451968556 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4004e00 con 0x7f33f80cff50 2023-05-10T04:20:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f80cd770 con 0x7f33f80cff50 2023-05-10T04:20:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.462+0000 7f33f57fa700 1 -- 172.21.15.132:0/2451968556 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4007310 con 0x7f33f80cff50 2023-05-10T04:20:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.463+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f80cf560 con 0x7f33f80cff50 2023-05-10T04:20:27.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.463+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f815c960 con 0x7f33f80cff50 2023-05-10T04:20:27.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.464+0000 7f33f57fa700 1 -- 172.21.15.132:0/2451968556 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f33e4007470 con 0x7f33f80cff50 2023-05-10T04:20:27.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.465+0000 7f33f57fa700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f33dc06ace0 0x7f33dc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.465+0000 7f33f57fa700 1 -- 172.21.15.132:0/2451968556 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f33e4089500 con 0x7f33f80cff50 2023-05-10T04:20:27.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.466+0000 7f33fcb9b700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f33dc06ace0 0x7f33dc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.466+0000 7f33fcb9b700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f33dc06ace0 0x7f33dc06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f33f80c67a0 tx=0x7f33ec01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.470+0000 7f33f57fa700 1 -- 172.21.15.132:0/2451968556 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f33e40542b0 con 0x7f33f80cff50 2023-05-10T04:20:27.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.664+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33f81e7e20 con 0x7f33f80cff50 2023-05-10T04:20:27.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.664+0000 7f33f57fa700 1 -- 172.21.15.132:0/2451968556 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33f81e7e20 con 0x7f33f80cff50 2023-05-10T04:20:27.667 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:27.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f33dc06ace0 msgr2=0x7f33dc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f33dc06ace0 0x7f33dc06d190 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f33f80c67a0 tx=0x7f33ec01c040 comp rx=0 tx=0).stop 2023-05-10T04:20:27.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80cff50 msgr2=0x7f33f80c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80cff50 0x7f33f80c9400 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f33e400c520 tx=0x7f33e400c8e0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 shutdown_connections 2023-05-10T04:20:27.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f33dc06ace0 0x7f33dc06d190 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33f815c590 0x7f33f80b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33f80cf010 0x7f33f8156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 --2- 172.21.15.132:0/2451968556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80cff50 0x7f33f80c9400 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 >> 172.21.15.132:0/2451968556 conn(0x7f33f8071b10 msgr2=0x7f33f80d0370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:27.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 shutdown_connections 2023-05-10T04:20:27.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.667+0000 7f33fedff700 1 -- 172.21.15.132:0/2451968556 wait complete. 2023-05-10T04:20:27.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:27.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.870+0000 7f3b117ff700 1 Processor -- start 2023-05-10T04:20:27.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.870+0000 7f3b117ff700 1 -- start start 2023-05-10T04:20:27.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.871+0000 7f3b117ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f3b0c0cd760 0x7f3b0c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.871+0000 7f3b117ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 0x7f3b0c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.871+0000 7f3b117ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0c0cc9e0 con 0x7f3b0c15cf10 2023-05-10T04:20:27.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b117ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b0c15de20 con 0x7f3b0c0cd760 2023-05-10T04:20:27.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b117ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0ce070 con 0x7f3b0c0adf70 2023-05-10T04:20:27.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b0b7fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3b0c15cf10 0x7f3b0c06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49518/0 (socket says 172.21.15.132:49518) 2023-05-10T04:20:27.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b0b7fe700 1 -- 172.21.15.132:0/4289447891 learned_addr learned my addr 172.21.15.132:0/4289447891 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:27.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b03fff700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 0x7f3b0c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b0affd700 1 --2- 172.21.15.132:0/4289447891 >> v2:172.21.15.154:3300/0 conn(0x7f3b0c0cd760 0x7f3b0c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2345478642 0 0) 0x7f3b0c0cc9e0 con 0x7f3b0c15cf10 2023-05-10T04:20:27.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3af80035b0 con 0x7f3b0c15cf10 2023-05-10T04:20:27.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.872+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 647045261 0 0) 0x7f3af80035b0 con 0x7f3b0c15cf10 2023-05-10T04:20:27.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 msgr2=0x7f3b0c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:27.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 0x7f3b0c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 >> v2:172.21.15.154:3300/0 conn(0x7f3b0c0cd760 msgr2=0x7f3b0c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:27.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 --2- 172.21.15.132:0/4289447891 >> v2:172.21.15.154:3300/0 conn(0x7f3b0c0cd760 0x7f3b0c0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c15d860 con 0x7f3b0c15cf10 2023-05-10T04:20:27.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f3b040019f0 con 0x7f3b0c15cf10 2023-05-10T04:20:27.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 >> v1:172.21.15.132:6789/0 conn(0x7f3b0c15cf10 legacy=0x7f3b0c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af8003a00 0x7f3af8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3af8004850 0x7f3af8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 0x7f3af8005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c15de20 con 0x7f3af8004850 2023-05-10T04:20:27.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0ce070 con 0x7f3af8003a00 2023-05-10T04:20:27.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af800ba10 con 0x7f3b0c0adf70 2023-05-10T04:20:27.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b03fff700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3af8004850 0x7f3af8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0affd700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af8003a00 0x7f3af8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0b7fe700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 0x7f3af8005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b03fff700 1 -- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 msgr2=0x7f3af8005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:27.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b03fff700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 0x7f3af8005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b03fff700 1 -- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af8003a00 msgr2=0x7f3af8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:27.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b03fff700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3af8003a00 0x7f3af8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b03fff700 1 -- 172.21.15.132:0/4289447891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af80035b0 con 0x7f3af8004850 2023-05-10T04:20:27.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.873+0000 7f3b0b7fe700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3b0c0adf70 0x7f3af8005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:27.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b03fff700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3af8004850 0x7f3af8004cc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009b70 tx=0x7f3af8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335ed77a61aeb0e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4005a20 con 0x7f3af8004850 2023-05-10T04:20:27.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af4005b80 con 0x7f3af8004850 2023-05-10T04:20:27.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b0a7fc700 1 -- 172.21.15.132:0/4289447891 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af400e6c0 con 0x7f3af8004850 2023-05-10T04:20:27.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b117ff700 1 -- 172.21.15.132:0/4289447891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3af8004850 msgr2=0x7f3af8004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b117ff700 1 --2- 172.21.15.132:0/4289447891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3af8004850 0x7f3af8004cc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009b70 tx=0x7f3af8005880 comp rx=0 tx=0).stop 2023-05-10T04:20:27.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b0b7fe700 1 -- 172.21.15.132:0/4289447891 reap_dead start 2023-05-10T04:20:27.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b117ff700 1 -- 172.21.15.132:0/4289447891 shutdown_connections 2023-05-10T04:20:27.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b117ff700 1 -- 172.21.15.132:0/4289447891 >> 172.21.15.132:0/4289447891 conn(0x7f3b0c0cf720 msgr2=0x7f3b0c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:27.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.874+0000 7f3b117ff700 1 -- 172.21.15.132:0/4289447891 shutdown_connections 2023-05-10T04:20:27.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.875+0000 7f3b117ff700 1 -- 172.21.15.132:0/4289447891 wait complete. 2023-05-10T04:20:27.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.877+0000 7f3b117ff700 1 Processor -- start 2023-05-10T04:20:27.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.877+0000 7f3b117ff700 1 -- start start 2023-05-10T04:20:27.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.878+0000 7f3b117ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af8004850 0x7f3b0c14d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.878+0000 7f3b117ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b0c1f5e80 0x7f3b0c1f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.878+0000 7f3b117ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b0c159d30 0x7f3b0c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.878+0000 7f3b117ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c1f62f0 con 0x7f3b0c159d30 2023-05-10T04:20:27.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.878+0000 7f3b117ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c15a6e0 con 0x7f3b0c1f5e80 2023-05-10T04:20:27.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.878+0000 7f3b117ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0c0b2ea0 con 0x7f3af8004850 2023-05-10T04:20:27.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.878+0000 7f3b0b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b0c159d30 0x7f3b0c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b0c159d30 0x7f3b0c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39214/0 (socket says 172.21.15.132:39214) 2023-05-10T04:20:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0b7fe700 1 -- 172.21.15.132:0/3019796293 learned_addr learned my addr 172.21.15.132:0/3019796293 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0affd700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af8004850 0x7f3b0c14d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b03fff700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b0c1f5e80 0x7f3b0c1f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0b7fe700 1 -- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af8004850 msgr2=0x7f3b0c14d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0b7fe700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af8004850 0x7f3b0c14d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0b7fe700 1 -- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b0c1f5e80 msgr2=0x7f3b0c1f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0b7fe700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b0c1f5e80 0x7f3b0c1f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0b7fe700 1 -- 172.21.15.132:0/3019796293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c0cc670 con 0x7f3b0c159d30 2023-05-10T04:20:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b03fff700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b0c1f5e80 0x7f3b0c1f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b0b7fe700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b0c159d30 0x7f3b0c15a1a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c070480 tx=0x7f3b04007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b037fe700 1 -- 172.21.15.132:0/3019796293 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b04017070 con 0x7f3b0c159d30 2023-05-10T04:20:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b037fe700 1 -- 172.21.15.132:0/3019796293 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0400ec90 con 0x7f3b0c159d30 2023-05-10T04:20:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0c15db40 con 0x7f3b0c159d30 2023-05-10T04:20:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.879+0000 7f3b037fe700 1 -- 172.21.15.132:0/3019796293 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0400ee20 con 0x7f3b0c159d30 2023-05-10T04:20:27.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.880+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0c071600 con 0x7f3b0c159d30 2023-05-10T04:20:27.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.881+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c1466e0 con 0x7f3b0c159d30 2023-05-10T04:20:27.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.882+0000 7f3b037fe700 1 -- 172.21.15.132:0/3019796293 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3b04013420 con 0x7f3b0c159d30 2023-05-10T04:20:27.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.883+0000 7f3b037fe700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3aec06ace0 0x7f3aec06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:27.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.883+0000 7f3b037fe700 1 -- 172.21.15.132:0/3019796293 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b040894e0 con 0x7f3b0c159d30 2023-05-10T04:20:27.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.883+0000 7f3b0affd700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3aec06ace0 0x7f3aec06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:27.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.883+0000 7f3b0affd700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3aec06ace0 0x7f3aec06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009c20 tx=0x7f3afc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:27.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:27.887+0000 7f3b037fe700 1 -- 172.21.15.132:0/3019796293 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3b0c1466e0 con 0x7f3b0c159d30 2023-05-10T04:20:28.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.082+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3b0c1466e0 con 0x7f3b0c159d30 2023-05-10T04:20:28.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.082+0000 7f3b037fe700 1 -- 172.21.15.132:0/3019796293 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3b0c1466e0 con 0x7f3b0c159d30 2023-05-10T04:20:28.084 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:28.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3aec06ace0 msgr2=0x7f3aec06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3aec06ace0 0x7f3aec06d190 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3afc009c20 tx=0x7f3afc008040 comp rx=0 tx=0).stop 2023-05-10T04:20:28.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b0c159d30 msgr2=0x7f3b0c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b0c159d30 0x7f3b0c15a1a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c070480 tx=0x7f3b04007c90 comp rx=0 tx=0).stop 2023-05-10T04:20:28.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 shutdown_connections 2023-05-10T04:20:28.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3aec06ace0 0x7f3aec06d190 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b0c159d30 0x7f3b0c15a1a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3af8004850 0x7f3b0c14d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 --2- 172.21.15.132:0/3019796293 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3b0c1f5e80 0x7f3b0c1f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 >> 172.21.15.132:0/3019796293 conn(0x7f3b0c0cf720 msgr2=0x7f3b0c15ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:28.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 shutdown_connections 2023-05-10T04:20:28.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.085+0000 7f3b117ff700 1 -- 172.21.15.132:0/3019796293 wait complete. 2023-05-10T04:20:28.104 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.289+0000 7fa5bbdff700 1 Processor -- start 2023-05-10T04:20:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.289+0000 7fa5bbdff700 1 -- start start 2023-05-10T04:20:28.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.290+0000 7fa5bbdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fa5b40b87a0 0x7fa5b40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.290+0000 7fa5bbdff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b40cdc60 con 0x7fa5b4160d40 2023-05-10T04:20:28.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.290+0000 7fa5bbdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b40cd6a0 con 0x7fa5b41601e0 2023-05-10T04:20:28.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.290+0000 7fa5bbdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5b40d02d0 con 0x7fa5b40b87a0 2023-05-10T04:20:28.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.290+0000 7fa5ba39c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa5b4160d40 0x7fa5b40d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49522/0 (socket says 172.21.15.132:49522) 2023-05-10T04:20:28.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.290+0000 7fa5ba39c700 1 -- 172.21.15.132:0/514779567 learned_addr learned my addr 172.21.15.132:0/514779567 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.291+0000 7fa5b9b9b700 1 --2- 172.21.15.132:0/514779567 >> v2:172.21.15.154:3300/0 conn(0x7fa5b40b87a0 0x7fa5b40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.291+0000 7fa5b8b99700 1 -- 172.21.15.132:0/514779567 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090224913 0 0) 0x7fa5b40cdc60 con 0x7fa5b4160d40 2023-05-10T04:20:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.291+0000 7fa5b8b99700 1 -- 172.21.15.132:0/514779567 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5a00035b0 con 0x7fa5b4160d40 2023-05-10T04:20:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.291+0000 7fa5b9b9b700 1 -- 172.21.15.132:0/514779567 >> v1:172.21.15.154:6789/0 conn(0x7fa5b41601e0 legacy=0x7fa5b4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.291+0000 7fa5b8b99700 1 -- 172.21.15.132:0/514779567 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1556198114 0 0) 0x7fa5a00035b0 con 0x7fa5b4160d40 2023-05-10T04:20:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.291+0000 7fa5b9b9b700 1 -- 172.21.15.132:0/514779567 >> v1:172.21.15.132:6789/0 conn(0x7fa5b4160d40 legacy=0x7fa5b40d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.291+0000 7fa5b9b9b700 1 -- 172.21.15.132:0/514779567 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40cd980 con 0x7fa5b40b87a0 2023-05-10T04:20:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.291+0000 7fa5b9b9b700 1 --2- 172.21.15.132:0/514779567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40cfbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009840 tx=0x7fa5b0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=507d63306e01d6ae server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5b8b99700 1 -- 172.21.15.132:0/514779567 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0019f0 con 0x7fa5b40b87a0 2023-05-10T04:20:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5b8b99700 1 -- 172.21.15.132:0/514779567 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0004030 con 0x7fa5b40b87a0 2023-05-10T04:20:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5b8b99700 1 -- 172.21.15.132:0/514779567 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00043a0 con 0x7fa5b40b87a0 2023-05-10T04:20:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5bbdff700 1 -- 172.21.15.132:0/514779567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b40b87a0 msgr2=0x7fa5b40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5bbdff700 1 --2- 172.21.15.132:0/514779567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40cfbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009840 tx=0x7fa5b0009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5bbdff700 1 -- 172.21.15.132:0/514779567 shutdown_connections 2023-05-10T04:20:28.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5bbdff700 1 --2- 172.21.15.132:0/514779567 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40cfbf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5bbdff700 1 -- 172.21.15.132:0/514779567 >> 172.21.15.132:0/514779567 conn(0x7fa5b4071b10 msgr2=0x7fa5b4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:28.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5bbdff700 1 -- 172.21.15.132:0/514779567 shutdown_connections 2023-05-10T04:20:28.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.292+0000 7fa5bbdff700 1 -- 172.21.15.132:0/514779567 wait complete. 2023-05-10T04:20:28.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.294+0000 7fa5bbdff700 1 Processor -- start 2023-05-10T04:20:28.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.294+0000 7fa5bbdff700 1 -- start start 2023-05-10T04:20:28.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5bbdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5bbdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5b41601e0 0x7fa5b415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5bbdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b4160d40 0x7fa5b415d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5bbdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40c8680 con 0x7fa5b40b87a0 2023-05-10T04:20:28.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5bbdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b415d9f0 con 0x7fa5b4160d40 2023-05-10T04:20:28.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5bbdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b41f25e0 con 0x7fa5b41601e0 2023-05-10T04:20:28.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5b9b9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5b9b9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39228/0 (socket says 172.21.15.132:39228) 2023-05-10T04:20:28.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.295+0000 7fa5b9b9b700 1 -- 172.21.15.132:0/1187546309 learned_addr learned my addr 172.21.15.132:0/1187546309 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:28.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5ba39c700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b4160d40 0x7fa5b415d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5b939a700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5b41601e0 0x7fa5b415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5b9b9b700 1 -- 172.21.15.132:0/1187546309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5b41601e0 msgr2=0x7fa5b415ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5b9b9b700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5b41601e0 0x7fa5b415ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5b9b9b700 1 -- 172.21.15.132:0/1187546309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b4160d40 msgr2=0x7fa5b415d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5b9b9b700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b4160d40 0x7fa5b415d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5b9b9b700 1 -- 172.21.15.132:0/1187546309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b00094a0 con 0x7fa5b40b87a0 2023-05-10T04:20:28.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5b9b9b700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40b3030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009b90 tx=0x7fa5b0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:28.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5aa7fc700 1 -- 172.21.15.132:0/1187546309 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b0003d20 con 0x7fa5b40b87a0 2023-05-10T04:20:28.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5aa7fc700 1 -- 172.21.15.132:0/1187546309 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5b0003e80 con 0x7fa5b40b87a0 2023-05-10T04:20:28.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5aa7fc700 1 -- 172.21.15.132:0/1187546309 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5b00107d0 con 0x7fa5b40b87a0 2023-05-10T04:20:28.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.296+0000 7fa5bbdff700 1 -- 172.21.15.132:0/1187546309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b40d19a0 con 0x7fa5b40b87a0 2023-05-10T04:20:28.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.297+0000 7fa5bbdff700 1 -- 172.21.15.132:0/1187546309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b40d1810 con 0x7fa5b40b87a0 2023-05-10T04:20:28.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.298+0000 7fa597fff700 1 -- 172.21.15.132:0/1187546309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b40d1b30 con 0x7fa5b40b87a0 2023-05-10T04:20:28.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.298+0000 7fa5aa7fc700 1 -- 172.21.15.132:0/1187546309 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa5b0010930 con 0x7fa5b40b87a0 2023-05-10T04:20:28.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.299+0000 7fa5aa7fc700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa59806ace0 0x7fa59806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.299+0000 7fa5aa7fc700 1 -- 172.21.15.132:0/1187546309 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa5b008afb0 con 0x7fa5b40b87a0 2023-05-10T04:20:28.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.299+0000 7fa5b939a700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa59806ace0 0x7fa59806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.300+0000 7fa5b939a700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa59806ace0 0x7fa59806d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4001300 tx=0x7fa5a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:28.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.304+0000 7fa5aa7fc700 1 -- 172.21.15.132:0/1187546309 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fa5b0055d60 con 0x7fa5b40b87a0 2023-05-10T04:20:28.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.497+0000 7fa597fff700 1 -- 172.21.15.132:0/1187546309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5b41f29d0 con 0x7fa5b40b87a0 2023-05-10T04:20:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.497+0000 7fa5aa7fc700 1 -- 172.21.15.132:0/1187546309 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5b0059380 con 0x7fa5b40b87a0 2023-05-10T04:20:28.499 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:28.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 -- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa59806ace0 msgr2=0x7fa59806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa59806ace0 0x7fa59806d190 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4001300 tx=0x7fa5a4009040 comp rx=0 tx=0).stop 2023-05-10T04:20:28.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 -- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5b40b87a0 msgr2=0x7fa5b40b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40b3030 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0009b90 tx=0x7fa5b0004750 comp rx=0 tx=0).stop 2023-05-10T04:20:28.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 -- 172.21.15.132:0/1187546309 shutdown_connections 2023-05-10T04:20:28.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fa59806ace0 0x7fa59806d190 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fa5b4160d40 0x7fa5b415d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5b40b87a0 0x7fa5b40b3030 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 --2- 172.21.15.132:0/1187546309 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fa5b41601e0 0x7fa5b415ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 -- 172.21.15.132:0/1187546309 >> 172.21.15.132:0/1187546309 conn(0x7fa5b4071b10 msgr2=0x7fa5b40b5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:28.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 -- 172.21.15.132:0/1187546309 shutdown_connections 2023-05-10T04:20:28.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.500+0000 7fa597fff700 1 -- 172.21.15.132:0/1187546309 wait complete. 2023-05-10T04:20:28.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:28.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.704+0000 7f4caa1ff700 1 Processor -- start 2023-05-10T04:20:28.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.704+0000 7f4caa1ff700 1 -- start start 2023-05-10T04:20:28.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.705+0000 7f4caa1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 0x7f4ca406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.705+0000 7f4caa1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca40cb280 con 0x7f4ca406a920 2023-05-10T04:20:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.705+0000 7f4caa1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca4071700 con 0x7f4ca4071200 2023-05-10T04:20:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.705+0000 7f4caa1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca415a970 con 0x7f4ca415a5a0 2023-05-10T04:20:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.705+0000 7f4ca2ffd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4ca406a920 0x7f4ca4070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49530/0 (socket says 172.21.15.132:49530) 2023-05-10T04:20:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.705+0000 7f4ca2ffd700 1 -- 172.21.15.132:0/2270796244 learned_addr learned my addr 172.21.15.132:0/2270796244 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca37fe700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 0x7f4ca406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2043525478 0 0) 0x7f4c98001290 con 0x7f4ca406a920 2023-05-10T04:20:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c8c0035b0 con 0x7f4ca406a920 2023-05-10T04:20:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417448756 0 0) 0x7f4ca4071700 con 0x7f4ca4071200 2023-05-10T04:20:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c98001290 con 0x7f4ca4071200 2023-05-10T04:20:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3944164135 0 0) 0x7f4c8c0035b0 con 0x7f4ca406a920 2023-05-10T04:20:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 msgr2=0x7f4ca406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 0x7f4ca406a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 >> v1:172.21.15.154:6789/0 conn(0x7f4ca4071200 legacy=0x7f4ca406d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca40719e0 con 0x7f4ca406a920 2023-05-10T04:20:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f4c98001980 con 0x7f4ca406a920 2023-05-10T04:20:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 >> v1:172.21.15.132:6789/0 conn(0x7f4ca406a920 legacy=0x7f4ca4070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c8c003bc0 0x7f4c8c003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c004850 0x7f4c8c004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 0x7f4c8c005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca415a970 con 0x7f4c8c003bc0 2023-05-10T04:20:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c00bac0 con 0x7f4c8c004850 2023-05-10T04:20:28.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8c00bc30 con 0x7f4ca415a5a0 2023-05-10T04:20:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.706+0000 7f4ca37fe700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c8c003bc0 0x7f4c8c003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca2ffd700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c004850 0x7f4c8c004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca3fff700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 0x7f4c8c005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca37fe700 1 -- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 msgr2=0x7f4c8c005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca37fe700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 0x7f4c8c005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca37fe700 1 -- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c004850 msgr2=0x7f4c8c004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:28.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca37fe700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c004850 0x7f4c8c004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca37fe700 1 -- 172.21.15.132:0/2270796244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8c0035b0 con 0x7f4c8c003bc0 2023-05-10T04:20:28.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca2ffd700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c004850 0x7f4c8c004cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:28.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca3fff700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415a5a0 0x7f4c8c005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:28.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca37fe700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c8c003bc0 0x7f4c8c003fb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009b60 tx=0x7f4c8c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becd22349fcfd33a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:28.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400e6c0 con 0x7f4c8c003bc0 2023-05-10T04:20:28.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9400e820 con 0x7f4c8c003bc0 2023-05-10T04:20:28.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.707+0000 7f4ca27fc700 1 -- 172.21.15.132:0/2270796244 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400eb90 con 0x7f4c8c003bc0 2023-05-10T04:20:28.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.708+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2270796244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c8c003bc0 msgr2=0x7f4c8c003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.708+0000 7f4caa1ff700 1 --2- 172.21.15.132:0/2270796244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c8c003bc0 0x7f4c8c003fb0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009b60 tx=0x7f4c8c005880 comp rx=0 tx=0).stop 2023-05-10T04:20:28.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.708+0000 7f4ca3fff700 1 -- 172.21.15.132:0/2270796244 reap_dead start 2023-05-10T04:20:28.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.708+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2270796244 shutdown_connections 2023-05-10T04:20:28.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.708+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2270796244 >> 172.21.15.132:0/2270796244 conn(0x7f4ca40cf720 msgr2=0x7f4ca40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:28.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.708+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2270796244 shutdown_connections 2023-05-10T04:20:28.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.708+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2270796244 wait complete. 2023-05-10T04:20:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.710+0000 7f4caa1ff700 1 Processor -- start 2023-05-10T04:20:28.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.710+0000 7f4caa1ff700 1 -- start start 2023-05-10T04:20:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4caa1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c003bc0 0x7f4ca40b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4caa1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415d320 0x7f4ca40c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4caa1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca41501f0 0x7f4ca40aea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4caa1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40c81f0 con 0x7f4ca41501f0 2023-05-10T04:20:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4caa1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca415c700 con 0x7f4c8c003bc0 2023-05-10T04:20:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4caa1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca415d8a0 con 0x7f4ca415d320 2023-05-10T04:20:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca3fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca41501f0 0x7f4ca40aea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca3fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca41501f0 0x7f4ca40aea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39248/0 (socket says 172.21.15.132:39248) 2023-05-10T04:20:28.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca3fff700 1 -- 172.21.15.132:0/2834840177 learned_addr learned my addr 172.21.15.132:0/2834840177 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:28.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca2ffd700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415d320 0x7f4ca40c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca37fe700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c003bc0 0x7f4ca40b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca3fff700 1 -- 172.21.15.132:0/2834840177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415d320 msgr2=0x7f4ca40c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca3fff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415d320 0x7f4ca40c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca3fff700 1 -- 172.21.15.132:0/2834840177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c003bc0 msgr2=0x7f4ca40b42a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca3fff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c003bc0 0x7f4ca40b42a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.711+0000 7f4ca3fff700 1 -- 172.21.15.132:0/2834840177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca406c9a0 con 0x7f4ca41501f0 2023-05-10T04:20:28.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.712+0000 7f4ca3fff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca41501f0 0x7f4ca40aea20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4067990 tx=0x7f4c9c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:28.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.712+0000 7f4c8bfff700 1 -- 172.21.15.132:0/2834840177 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c003c10 con 0x7f4ca41501f0 2023-05-10T04:20:28.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.712+0000 7f4c8bfff700 1 -- 172.21.15.132:0/2834840177 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9c003d90 con 0x7f4ca41501f0 2023-05-10T04:20:28.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.712+0000 7f4c8bfff700 1 -- 172.21.15.132:0/2834840177 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c005310 con 0x7f4ca41501f0 2023-05-10T04:20:28.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.712+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca406c6c0 con 0x7f4ca41501f0 2023-05-10T04:20:28.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.712+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca406cc80 con 0x7f4ca41501f0 2023-05-10T04:20:28.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.713+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca40cbcf0 con 0x7f4ca41501f0 2023-05-10T04:20:28.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.714+0000 7f4c8bfff700 1 -- 172.21.15.132:0/2834840177 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c9c005470 con 0x7f4ca41501f0 2023-05-10T04:20:28.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.715+0000 7f4c8bfff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c9006ace0 0x7f4c9006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:28.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.715+0000 7f4c8bfff700 1 -- 172.21.15.132:0/2834840177 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c9c089770 con 0x7f4ca41501f0 2023-05-10T04:20:28.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.715+0000 7f4ca37fe700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c9006ace0 0x7f4c9006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:28.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.716+0000 7f4ca37fe700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c9006ace0 0x7f4c9006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4c940090b0 tx=0x7f4c9401f040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:28.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.719+0000 7f4c8bfff700 1 -- 172.21.15.132:0/2834840177 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4c9c054490 con 0x7f4ca41501f0 2023-05-10T04:20:28.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.914+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ca4072eb0 con 0x7f4ca41501f0 2023-05-10T04:20:28.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.915+0000 7f4c8bfff700 1 -- 172.21.15.132:0/2834840177 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4c9c057ab0 con 0x7f4ca41501f0 2023-05-10T04:20:28.917 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:28.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c9006ace0 msgr2=0x7f4c9006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c9006ace0 0x7f4c9006d190 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4c940090b0 tx=0x7f4c9401f040 comp rx=0 tx=0).stop 2023-05-10T04:20:28.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca41501f0 msgr2=0x7f4ca40aea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:28.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca41501f0 0x7f4ca40aea20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4067990 tx=0x7f4c9c00ee90 comp rx=0 tx=0).stop 2023-05-10T04:20:28.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 shutdown_connections 2023-05-10T04:20:28.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c9006ace0 0x7f4c9006d190 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ca41501f0 0x7f4ca40aea20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c8c003bc0 0x7f4ca40b42a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 --2- 172.21.15.132:0/2834840177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4ca415d320 0x7f4ca40c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:28.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 >> 172.21.15.132:0/2834840177 conn(0x7f4ca40cf720 msgr2=0x7f4ca40adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 shutdown_connections 2023-05-10T04:20:28.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:28.917+0000 7f4caa1ff700 1 -- 172.21.15.132:0/2834840177 wait complete. 2023-05-10T04:20:28.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:29.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.120+0000 7fdbd6bff700 1 Processor -- start 2023-05-10T04:20:29.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.121+0000 7fdbd6bff700 1 -- start start 2023-05-10T04:20:29.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd6bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdbd00d2110 0x7fdbd0167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd6bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd0161000 con 0x7fdbd00b87a0 2023-05-10T04:20:29.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd6bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd00d0020 con 0x7fdbd00cfbf0 2023-05-10T04:20:29.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd6bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd00d02d0 con 0x7fdbd00d2110 2023-05-10T04:20:29.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd519c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdbd00d2110 0x7fdbd0167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd499b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdbd00b87a0 0x7fdbd01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49546/0 (socket says 172.21.15.132:49546) 2023-05-10T04:20:29.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd499b700 1 -- 172.21.15.132:0/2750435185 learned_addr learned my addr 172.21.15.132:0/2750435185 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:29.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd519c700 1 -- 172.21.15.132:0/2750435185 >> v1:172.21.15.154:6789/0 conn(0x7fdbd00cfbf0 legacy=0x7fdbd01608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:29.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd519c700 1 -- 172.21.15.132:0/2750435185 >> v1:172.21.15.132:6789/0 conn(0x7fdbd00b87a0 legacy=0x7fdbd01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbd519c700 1 -- 172.21.15.132:0/2750435185 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd00cdc60 con 0x7fdbd00d2110 2023-05-10T04:20:29.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.122+0000 7fdbcf7fe700 1 -- 172.21.15.132:0/2750435185 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078105951 0 0) 0x7fdbd0161000 con 0x7fdbd00b87a0 2023-05-10T04:20:29.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.123+0000 7fdbd519c700 1 --2- 172.21.15.132:0/2750435185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd0167550 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009d90 tx=0x7fdbc800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad4de20af36897f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:29.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.123+0000 7fdbcf7fe700 1 -- 172.21.15.132:0/2750435185 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc800e070 con 0x7fdbd00d2110 2023-05-10T04:20:29.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.123+0000 7fdbcf7fe700 1 -- 172.21.15.132:0/2750435185 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc800bb90 con 0x7fdbd00d2110 2023-05-10T04:20:29.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.123+0000 7fdbcf7fe700 1 -- 172.21.15.132:0/2750435185 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8003a20 con 0x7fdbd00d2110 2023-05-10T04:20:29.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.123+0000 7fdbd6bff700 1 -- 172.21.15.132:0/2750435185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 msgr2=0x7fdbd0167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.123+0000 7fdbd6bff700 1 --2- 172.21.15.132:0/2750435185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd0167550 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009d90 tx=0x7fdbc800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:29.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.124+0000 7fdbd6bff700 1 -- 172.21.15.132:0/2750435185 shutdown_connections 2023-05-10T04:20:29.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.124+0000 7fdbd6bff700 1 --2- 172.21.15.132:0/2750435185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd0167550 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.124+0000 7fdbd6bff700 1 -- 172.21.15.132:0/2750435185 >> 172.21.15.132:0/2750435185 conn(0x7fdbd0071b10 msgr2=0x7fdbd0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:29.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.124+0000 7fdbd6bff700 1 -- 172.21.15.132:0/2750435185 shutdown_connections 2023-05-10T04:20:29.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.124+0000 7fdbd6bff700 1 -- 172.21.15.132:0/2750435185 wait complete. 2023-05-10T04:20:29.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.125+0000 7fdbd6bff700 1 Processor -- start 2023-05-10T04:20:29.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.126+0000 7fdbd6bff700 1 -- start start 2023-05-10T04:20:29.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.126+0000 7fdbd6bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbd00b87a0 0x7fdbd0153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.126+0000 7fdbd6bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbd00cfbf0 0x7fdbd015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.126+0000 7fdbd6bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd00b6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.126+0000 7fdbd6bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd0153ea0 con 0x7fdbd00d2110 2023-05-10T04:20:29.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.126+0000 7fdbd6bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd013a8e0 con 0x7fdbd00cfbf0 2023-05-10T04:20:29.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.126+0000 7fdbd6bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd013abc0 con 0x7fdbd00b87a0 2023-05-10T04:20:29.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd00b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd00b6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39272/0 (socket says 172.21.15.132:39272) 2023-05-10T04:20:29.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 -- 172.21.15.132:0/3923070967 learned_addr learned my addr 172.21.15.132:0/3923070967 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:29.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd499b700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbd00b87a0 0x7fdbd0153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbcffff700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbd00cfbf0 0x7fdbd015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 -- 172.21.15.132:0/3923070967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbd00b87a0 msgr2=0x7fdbd0153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbd00b87a0 0x7fdbd0153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 -- 172.21.15.132:0/3923070967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbd00cfbf0 msgr2=0x7fdbd015cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbd00cfbf0 0x7fdbd015cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 -- 172.21.15.132:0/3923070967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009a70 con 0x7fdbd00d2110 2023-05-10T04:20:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbd519c700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd00b6460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0072760 tx=0x7fdbc8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.127+0000 7fdbcd7fa700 1 -- 172.21.15.132:0/3923070967 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8012630 con 0x7fdbd00d2110 2023-05-10T04:20:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.128+0000 7fdbcd7fa700 1 -- 172.21.15.132:0/3923070967 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc80127b0 con 0x7fdbd00d2110 2023-05-10T04:20:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.128+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd00cd980 con 0x7fdbd00d2110 2023-05-10T04:20:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.128+0000 7fdbcd7fa700 1 -- 172.21.15.132:0/3923070967 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc8012b60 con 0x7fdbd00d2110 2023-05-10T04:20:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.128+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd00cd6a0 con 0x7fdbd00d2110 2023-05-10T04:20:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.129+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd0167a90 con 0x7fdbd00d2110 2023-05-10T04:20:29.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.129+0000 7fdbcd7fa700 1 -- 172.21.15.132:0/3923070967 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdbc8012cc0 con 0x7fdbd00d2110 2023-05-10T04:20:29.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.131+0000 7fdbcd7fa700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdbb406ace0 0x7fdbb406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.131+0000 7fdbcd7fa700 1 -- 172.21.15.132:0/3923070967 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdbc808ba80 con 0x7fdbd00d2110 2023-05-10T04:20:29.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.131+0000 7fdbd499b700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdbb406ace0 0x7fdbb406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.131+0000 7fdbd499b700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdbb406ace0 0x7fdbb406d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4000f60 tx=0x7fdbc4007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:29.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.134+0000 7fdbcd7fa700 1 -- 172.21.15.132:0/3923070967 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdbc805a2c0 con 0x7fdbd00d2110 2023-05-10T04:20:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.329+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fdbd00b52f0 con 0x7fdbd00d2110 2023-05-10T04:20:29.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.329+0000 7fdbcd7fa700 1 -- 172.21.15.132:0/3923070967 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fdbc8059e50 con 0x7fdbd00d2110 2023-05-10T04:20:29.332 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:29.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdbb406ace0 msgr2=0x7fdbb406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdbb406ace0 0x7fdbb406d190 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdbc4000f60 tx=0x7fdbc4007c90 comp rx=0 tx=0).stop 2023-05-10T04:20:29.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 msgr2=0x7fdbd00b6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd00b6460 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0072760 tx=0x7fdbc8004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 shutdown_connections 2023-05-10T04:20:29.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdbb406ace0 0x7fdbb406d190 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbd00d2110 0x7fdbd00b6460 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdbd00b87a0 0x7fdbd0153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 --2- 172.21.15.132:0/3923070967 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdbd00cfbf0 0x7fdbd015cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 >> 172.21.15.132:0/3923070967 conn(0x7fdbd0071b10 msgr2=0x7fdbd00cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:29.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 shutdown_connections 2023-05-10T04:20:29.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.332+0000 7fdbd6bff700 1 -- 172.21.15.132:0/3923070967 wait complete. 2023-05-10T04:20:29.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:20:29.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.535+0000 7ff13a3ff700 1 Processor -- start 2023-05-10T04:20:29.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.536+0000 7ff13a3ff700 1 -- start start 2023-05-10T04:20:29.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff13a3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff1340d2110 0x7ff134167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff13a3ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff134161000 con 0x7ff1340b87a0 2023-05-10T04:20:29.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff13a3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1340d0020 con 0x7ff1340cfbf0 2023-05-10T04:20:29.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff13a3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340d02d0 con 0x7ff1340d2110 2023-05-10T04:20:29.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff133fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff1340b87a0 0x7ff1341601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49550/0 (socket says 172.21.15.132:49550) 2023-05-10T04:20:29.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff133fff700 1 -- 172.21.15.132:0/3357488459 learned_addr learned my addr 172.21.15.132:0/3357488459 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:29.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff13899c700 1 --2- 172.21.15.132:0/3357488459 >> v2:172.21.15.154:3300/0 conn(0x7ff1340d2110 0x7ff134167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff1337fe700 1 -- 172.21.15.132:0/3357488459 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679939256 0 0) 0x7ff134161000 con 0x7ff1340b87a0 2023-05-10T04:20:29.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.537+0000 7ff1337fe700 1 -- 172.21.15.132:0/3357488459 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff1200035b0 con 0x7ff1340b87a0 2023-05-10T04:20:29.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.538+0000 7ff1337fe700 1 -- 172.21.15.132:0/3357488459 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3358526498 0 0) 0x7ff1200035b0 con 0x7ff1340b87a0 2023-05-10T04:20:29.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.538+0000 7ff13899c700 1 -- 172.21.15.132:0/3357488459 >> v1:172.21.15.154:6789/0 conn(0x7ff1340cfbf0 legacy=0x7ff1341608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.538+0000 7ff13899c700 1 -- 172.21.15.132:0/3357488459 >> v1:172.21.15.132:6789/0 conn(0x7ff1340b87a0 legacy=0x7ff1341601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.538+0000 7ff13899c700 1 -- 172.21.15.132:0/3357488459 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340cdc60 con 0x7ff1340d2110 2023-05-10T04:20:29.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.538+0000 7ff13899c700 1 --2- 172.21.15.132:0/3357488459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340d2110 0x7ff134167550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009d90 tx=0x7ff12c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1850745132c7aea7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:29.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.538+0000 7ff1337fe700 1 -- 172.21.15.132:0/3357488459 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12c00e070 con 0x7ff1340d2110 2023-05-10T04:20:29.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.538+0000 7ff1337fe700 1 -- 172.21.15.132:0/3357488459 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12c003a20 con 0x7ff1340d2110 2023-05-10T04:20:29.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.538+0000 7ff1337fe700 1 -- 172.21.15.132:0/3357488459 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff124001670 con 0x7ff1340d2110 2023-05-10T04:20:29.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.539+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3357488459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340d2110 msgr2=0x7ff134167550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.539+0000 7ff13a3ff700 1 --2- 172.21.15.132:0/3357488459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340d2110 0x7ff134167550 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff12c009d90 tx=0x7ff12c00b330 comp rx=0 tx=0).stop 2023-05-10T04:20:29.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.539+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3357488459 shutdown_connections 2023-05-10T04:20:29.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.539+0000 7ff13a3ff700 1 --2- 172.21.15.132:0/3357488459 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340d2110 0x7ff134167550 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.539+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3357488459 >> 172.21.15.132:0/3357488459 conn(0x7ff134071b10 msgr2=0x7ff134071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:29.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.539+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3357488459 shutdown_connections 2023-05-10T04:20:29.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.539+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3357488459 wait complete. 2023-05-10T04:20:29.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.541+0000 7ff13a3ff700 1 Processor -- start 2023-05-10T04:20:29.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.541+0000 7ff13a3ff700 1 -- start start 2023-05-10T04:20:29.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff13a3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340b87a0 0x7ff1340cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff13a3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cfbf0 0x7ff13415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff13a3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1340d2110 0x7ff13414d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff13a3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340ccce0 con 0x7ff1340cfbf0 2023-05-10T04:20:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff13a3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff13414c380 con 0x7ff1340b87a0 2023-05-10T04:20:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff13a3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff13414c660 con 0x7ff1340d2110 2023-05-10T04:20:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff12bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cfbf0 0x7ff13415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff12bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cfbf0 0x7ff13415e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39280/0 (socket says 172.21.15.132:39280) 2023-05-10T04:20:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff12bfff700 1 -- 172.21.15.132:0/3050275866 learned_addr learned my addr 172.21.15.132:0/3050275866 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff13899c700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1340d2110 0x7ff13414d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff133fff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340b87a0 0x7ff1340cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff12bfff700 1 -- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1340d2110 msgr2=0x7ff13414d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff12bfff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1340d2110 0x7ff13414d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff12bfff700 1 -- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340b87a0 msgr2=0x7ff1340cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff12bfff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340b87a0 0x7ff1340cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff12bfff700 1 -- 172.21.15.132:0/3050275866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12c009a70 con 0x7ff1340cfbf0 2023-05-10T04:20:29.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.542+0000 7ff133fff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340b87a0 0x7ff1340cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:29.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.543+0000 7ff12bfff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cfbf0 0x7ff13415e350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c490 tx=0x7ff11c00c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:29.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.543+0000 7ff1317fa700 1 -- 172.21.15.132:0/3050275866 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c0052d0 con 0x7ff1340cfbf0 2023-05-10T04:20:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.543+0000 7ff1317fa700 1 -- 172.21.15.132:0/3050275866 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c005450 con 0x7ff1340cfbf0 2023-05-10T04:20:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.543+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1340cd980 con 0x7ff1340cfbf0 2023-05-10T04:20:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.543+0000 7ff1317fa700 1 -- 172.21.15.132:0/3050275866 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c006aa0 con 0x7ff1340cfbf0 2023-05-10T04:20:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.543+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1340cd6a0 con 0x7ff1340cfbf0 2023-05-10T04:20:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.544+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff134167a90 con 0x7ff1340cfbf0 2023-05-10T04:20:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.545+0000 7ff1317fa700 1 -- 172.21.15.132:0/3050275866 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff11c003680 con 0x7ff1340cfbf0 2023-05-10T04:20:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.546+0000 7ff1317fa700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff11406ace0 0x7ff11406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.546+0000 7ff1317fa700 1 -- 172.21.15.132:0/3050275866 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff11c0889d0 con 0x7ff1340cfbf0 2023-05-10T04:20:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.546+0000 7ff133fff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff11406ace0 0x7ff11406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.547+0000 7ff133fff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff11406ace0 0x7ff11406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff124001eb0 tx=0x7ff124001c80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.550+0000 7ff1317fa700 1 -- 172.21.15.132:0/3050275866 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff11c053790 con 0x7ff1340cfbf0 2023-05-10T04:20:29.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.762+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff1340cce20 con 0x7ff1340cfbf0 2023-05-10T04:20:29.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.763+0000 7ff1317fa700 1 -- 172.21.15.132:0/3050275866 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff11c056db0 con 0x7ff1340cfbf0 2023-05-10T04:20:29.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff11406ace0 msgr2=0x7ff11406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff11406ace0 0x7ff11406d190 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff124001eb0 tx=0x7ff124001c80 comp rx=0 tx=0).stop 2023-05-10T04:20:29.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cfbf0 msgr2=0x7ff13415e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:29.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cfbf0 0x7ff13415e350 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c490 tx=0x7ff11c00c7a0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 shutdown_connections 2023-05-10T04:20:29.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff11406ace0 0x7ff11406d190 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff1340d2110 0x7ff13414d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff1340b87a0 0x7ff1340cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 --2- 172.21.15.132:0/3050275866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cfbf0 0x7ff13415e350 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:29.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 >> 172.21.15.132:0/3050275866 conn(0x7ff134071b10 msgr2=0x7ff1340b4150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:29.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 shutdown_connections 2023-05-10T04:20:29.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:29.765+0000 7ff13a3ff700 1 -- 172.21.15.132:0/3050275866 wait complete. 2023-05-10T04:20:29.769 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:20:29.784 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-05-10T04:20:29.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:20:29.785 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-05-10T04:20:29.847 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:20:29.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-05-10T04:20:29.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:20:29.848 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-05-10T04:20:29.888 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:20:29.888 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:29.932 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:20:29.933 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:30.016 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:30.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.198+0000 7f95c7bff700 1 Processor -- start 2023-05-10T04:20:30.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.198+0000 7f95c7bff700 1 -- start start 2023-05-10T04:20:30.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.199+0000 7f95c7bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f95c00d2110 0x7f95c0167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.199+0000 7f95c7bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c0161000 con 0x7f95c00cfbf0 2023-05-10T04:20:30.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.199+0000 7f95c7bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c00d0020 con 0x7f95c00b87a0 2023-05-10T04:20:30.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.199+0000 7f95c7bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c00d02d0 con 0x7f95c00d2110 2023-05-10T04:20:30.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.199+0000 7f95c519a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f95c00cfbf0 0x7f95c01608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49560/0 (socket says 172.21.15.132:49560) 2023-05-10T04:20:30.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.199+0000 7f95c519a700 1 -- 172.21.15.132:0/3302168431 learned_addr learned my addr 172.21.15.132:0/3302168431 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:30.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c619c700 1 --2- 172.21.15.132:0/3302168431 >> v2:172.21.15.154:3300/0 conn(0x7f95c00d2110 0x7f95c0167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732220657 0 0) 0x7f95c0161000 con 0x7f95c00cfbf0 2023-05-10T04:20:30.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ac0035b0 con 0x7f95c00cfbf0 2023-05-10T04:20:30.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1368822602 0 0) 0x7f95ac0035b0 con 0x7f95c00cfbf0 2023-05-10T04:20:30.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 >> v2:172.21.15.154:3300/0 conn(0x7f95c00d2110 msgr2=0x7f95c0167550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:30.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 --2- 172.21.15.132:0/3302168431 >> v2:172.21.15.154:3300/0 conn(0x7f95c00d2110 0x7f95c0167550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 >> v1:172.21.15.154:6789/0 conn(0x7f95c00b87a0 legacy=0x7f95c01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00cdc60 con 0x7f95c00cfbf0 2023-05-10T04:20:30.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f95b0001670 con 0x7f95c00cfbf0 2023-05-10T04:20:30.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 >> v1:172.21.15.132:6789/0 conn(0x7f95c00cfbf0 legacy=0x7f95c01608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac003a00 0x7f95ac003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ac004850 0x7f95ac004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac005200 0x7f95ac00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c00d02d0 con 0x7f95ac003a00 2023-05-10T04:20:30.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac00c080 con 0x7f95ac004850 2023-05-10T04:20:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac00c240 con 0x7f95ac005200 2023-05-10T04:20:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.200+0000 7f95c599b700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac003a00 0x7f95ac003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c519a700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ac004850 0x7f95ac004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c619c700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac005200 0x7f95ac00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c599b700 1 -- 172.21.15.132:0/3302168431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac005200 msgr2=0x7f95ac00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:30.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c599b700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac005200 0x7f95ac00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c599b700 1 -- 172.21.15.132:0/3302168431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ac004850 msgr2=0x7f95ac004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:30.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c599b700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95ac004850 0x7f95ac004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c599b700 1 -- 172.21.15.132:0/3302168431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac0035b0 con 0x7f95ac003a00 2023-05-10T04:20:30.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c619c700 1 -- 172.21.15.132:0/3302168431 reap_dead start 2023-05-10T04:20:30.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c599b700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac003a00 0x7f95ac003e10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0017c0 tx=0x7f95ac005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76db8e4ab5b435 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:30.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0052d0 con 0x7f95ac003a00 2023-05-10T04:20:30.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95bc005430 con 0x7f95ac003a00 2023-05-10T04:20:30.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.201+0000 7f95c4999700 1 -- 172.21.15.132:0/3302168431 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc0038c0 con 0x7f95ac003a00 2023-05-10T04:20:30.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.202+0000 7f95c7bff700 1 -- 172.21.15.132:0/3302168431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac003a00 msgr2=0x7f95ac003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.202+0000 7f95c7bff700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac003a00 0x7f95ac003e10 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f95bc0017c0 tx=0x7f95ac005880 comp rx=0 tx=0).stop 2023-05-10T04:20:30.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.202+0000 7f95c7bff700 1 -- 172.21.15.132:0/3302168431 shutdown_connections 2023-05-10T04:20:30.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.202+0000 7f95c7bff700 1 --2- 172.21.15.132:0/3302168431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac003a00 0x7f95ac003e10 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.202+0000 7f95c7bff700 1 -- 172.21.15.132:0/3302168431 >> 172.21.15.132:0/3302168431 conn(0x7f95c0071b10 msgr2=0x7f95c0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:30.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.202+0000 7f95c7bff700 1 -- 172.21.15.132:0/3302168431 shutdown_connections 2023-05-10T04:20:30.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.202+0000 7f95c7bff700 1 -- 172.21.15.132:0/3302168431 wait complete. 2023-05-10T04:20:30.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.204+0000 7f95c7bff700 1 Processor -- start 2023-05-10T04:20:30.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.204+0000 7f95c7bff700 1 -- start start 2023-05-10T04:20:30.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.204+0000 7f95c7bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac003a00 0x7f95c01513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.204+0000 7f95c7bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c01f5810 0x7f95c01f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.204+0000 7f95c7bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95c01f61c0 0x7f95c015cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.204+0000 7f95c7bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c015c990 con 0x7f95c01f61c0 2023-05-10T04:20:30.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c7bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c0158030 con 0x7f95c01f5810 2023-05-10T04:20:30.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c7bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c01518e0 con 0x7f95ac003a00 2023-05-10T04:20:30.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95c01f61c0 0x7f95c015cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95c01f61c0 0x7f95c015cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39294/0 (socket says 172.21.15.132:39294) 2023-05-10T04:20:30.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 -- 172.21.15.132:0/4110160264 learned_addr learned my addr 172.21.15.132:0/4110160264 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:30.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c599b700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac003a00 0x7f95c01513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c519a700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c01f5810 0x7f95c01f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 -- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac003a00 msgr2=0x7f95c01513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac003a00 0x7f95c01513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 -- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c01f5810 msgr2=0x7f95c01f5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c01f5810 0x7f95c01f5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 -- 172.21.15.132:0/4110160264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c00cd980 con 0x7f95c01f61c0 2023-05-10T04:20:30.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c519a700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c01f5810 0x7f95c01f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:30.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.205+0000 7f95c619c700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95c01f61c0 0x7f95c015cdb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f95c00b1d10 tx=0x7f95b80114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:30.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.206+0000 7f95b67fc700 1 -- 172.21.15.132:0/4110160264 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800e070 con 0x7f95c01f61c0 2023-05-10T04:20:30.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.206+0000 7f95b67fc700 1 -- 172.21.15.132:0/4110160264 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b8003c30 con 0x7f95c01f61c0 2023-05-10T04:20:30.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.206+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c00cd6a0 con 0x7f95c01f61c0 2023-05-10T04:20:30.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.206+0000 7f95b67fc700 1 -- 172.21.15.132:0/4110160264 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8003e20 con 0x7f95c01f61c0 2023-05-10T04:20:30.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.206+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c01601e0 con 0x7f95c01f61c0 2023-05-10T04:20:30.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.207+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c015cad0 con 0x7f95c01f61c0 2023-05-10T04:20:30.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.208+0000 7f95b67fc700 1 -- 172.21.15.132:0/4110160264 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f95b8011a10 con 0x7f95c01f61c0 2023-05-10T04:20:30.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.208+0000 7f95b67fc700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f95a406ad10 0x7f95a406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.209+0000 7f95b67fc700 1 -- 172.21.15.132:0/4110160264 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f95b8089d00 con 0x7f95c01f61c0 2023-05-10T04:20:30.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.209+0000 7f95c599b700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f95a406ad10 0x7f95a406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.209+0000 7f95c599b700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f95a406ad10 0x7f95a406d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f95bc015040 tx=0x7f95bc009030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:30.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.213+0000 7f95b67fc700 1 -- 172.21.15.132:0/4110160264 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f95c015cad0 con 0x7f95c01f61c0 2023-05-10T04:20:30.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.411+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95c015cad0 con 0x7f95c01f61c0 2023-05-10T04:20:30.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.412+0000 7f95b67fc700 1 -- 172.21.15.132:0/4110160264 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f95c015cad0 con 0x7f95c01f61c0 2023-05-10T04:20:30.415 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:30.415 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:30.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f95a406ad10 msgr2=0x7f95a406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f95a406ad10 0x7f95a406d1c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f95bc015040 tx=0x7f95bc009030 comp rx=0 tx=0).stop 2023-05-10T04:20:30.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95c01f61c0 msgr2=0x7f95c015cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95c01f61c0 0x7f95c015cdb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f95c00b1d10 tx=0x7f95b80114b0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 shutdown_connections 2023-05-10T04:20:30.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f95a406ad10 0x7f95a406d1c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95c01f61c0 0x7f95c015cdb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f95ac003a00 0x7f95c01513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 --2- 172.21.15.132:0/4110160264 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f95c01f5810 0x7f95c01f5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 >> 172.21.15.132:0/4110160264 conn(0x7f95c0071b10 msgr2=0x7f95c00b1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:30.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 shutdown_connections 2023-05-10T04:20:30.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.415+0000 7f95c7bff700 1 -- 172.21.15.132:0/4110160264 wait complete. 2023-05-10T04:20:30.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:30.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:30.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.620+0000 7feb7d3ff700 1 Processor -- start 2023-05-10T04:20:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.620+0000 7feb7d3ff700 1 -- start start 2023-05-10T04:20:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.621+0000 7feb7d3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 0x7feb781608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.621+0000 7feb7d3ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb780d1100 0x7feb780d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.621+0000 7feb7d3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb780d0020 con 0x7feb780b87a0 2023-05-10T04:20:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.621+0000 7feb7d3ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb780d02d0 con 0x7feb780d1100 2023-05-10T04:20:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.621+0000 7feb7d3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb780d0cb0 con 0x7feb780cfbf0 2023-05-10T04:20:30.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb777fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb780d1100 0x7feb780d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb6ffff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 0x7feb781608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb777fe700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feb780d1100 0x7feb780d1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:45496/0 (socket says 172.21.15.132:45496) 2023-05-10T04:20:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb777fe700 1 -- 172.21.15.132:0/3408949454 learned_addr learned my addr 172.21.15.132:0/3408949454 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb76ffd700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7feb780b87a0 0x7feb781601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:38320/0 (socket says 172.21.15.132:38320) 2023-05-10T04:20:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb777fe700 1 -- 172.21.15.132:0/3408949454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 msgr2=0x7feb781608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb777fe700 1 --2- 172.21.15.132:0/3408949454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 0x7feb781608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb777fe700 1 -- 172.21.15.132:0/3408949454 >> v1:172.21.15.154:6789/0 conn(0x7feb780b87a0 legacy=0x7feb781601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb777fe700 1 -- 172.21.15.132:0/3408949454 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb780cdc60 con 0x7feb780d1100 2023-05-10T04:20:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb767fc700 1 -- 172.21.15.132:0/3408949454 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 875127954 0 0) 0x7feb780d0020 con 0x7feb780b87a0 2023-05-10T04:20:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.622+0000 7feb777fe700 1 --2- 172.21.15.132:0/3408949454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780d1100 0x7feb780d1580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feb70009e50 tx=0x7feb7000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3181cd933bb89d38 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb767fc700 1 -- 172.21.15.132:0/3408949454 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000e070 con 0x7feb780d1100 2023-05-10T04:20:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb767fc700 1 -- 172.21.15.132:0/3408949454 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7000b910 con 0x7feb780d1100 2023-05-10T04:20:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb767fc700 1 -- 172.21.15.132:0/3408949454 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7000bcc0 con 0x7feb780d1100 2023-05-10T04:20:30.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3408949454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780d1100 msgr2=0x7feb780d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3408949454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780d1100 0x7feb780d1580 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7feb70009e50 tx=0x7feb7000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:30.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3408949454 shutdown_connections 2023-05-10T04:20:30.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3408949454 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780d1100 0x7feb780d1580 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3408949454 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 0x7feb781608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3408949454 >> 172.21.15.132:0/3408949454 conn(0x7feb78071b10 msgr2=0x7feb78071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:30.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3408949454 shutdown_connections 2023-05-10T04:20:30.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.623+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3408949454 wait complete. 2023-05-10T04:20:30.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.625+0000 7feb7d3ff700 1 Processor -- start 2023-05-10T04:20:30.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.625+0000 7feb7d3ff700 1 -- start start 2023-05-10T04:20:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb7d3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780b87a0 0x7feb780b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb7d3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 0x7feb780c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb7d3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb780d1100 0x7feb780ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb7d3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb780cd560 con 0x7feb780d1100 2023-05-10T04:20:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb7d3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb780b1670 con 0x7feb780b87a0 2023-05-10T04:20:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb7d3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb781f23e0 con 0x7feb780cfbf0 2023-05-10T04:20:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb777fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb780d1100 0x7feb780ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb777fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb780d1100 0x7feb780ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39310/0 (socket says 172.21.15.132:39310) 2023-05-10T04:20:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.626+0000 7feb777fe700 1 -- 172.21.15.132:0/3202778652 learned_addr learned my addr 172.21.15.132:0/3202778652 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb6ffff700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 0x7feb780c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb76ffd700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780b87a0 0x7feb780b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb777fe700 1 -- 172.21.15.132:0/3202778652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 msgr2=0x7feb780c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb777fe700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 0x7feb780c9f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb777fe700 1 -- 172.21.15.132:0/3202778652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780b87a0 msgr2=0x7feb780b1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb777fe700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780b87a0 0x7feb780b1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb777fe700 1 -- 172.21.15.132:0/3202778652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70009b30 con 0x7feb780d1100 2023-05-10T04:20:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb777fe700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb780d1100 0x7feb780ca4c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7feb7000b680 tx=0x7feb70004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb6f7fe700 1 -- 172.21.15.132:0/3202778652 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb700099b0 con 0x7feb780d1100 2023-05-10T04:20:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb6f7fe700 1 -- 172.21.15.132:0/3202778652 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb700092e0 con 0x7feb780d1100 2023-05-10T04:20:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb780cd980 con 0x7feb780d1100 2023-05-10T04:20:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb6f7fe700 1 -- 172.21.15.132:0/3202778652 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7001c660 con 0x7feb780d1100 2023-05-10T04:20:30.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.627+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb780cd6a0 con 0x7feb780d1100 2023-05-10T04:20:30.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.628+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb78160e30 con 0x7feb780d1100 2023-05-10T04:20:30.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.629+0000 7feb6f7fe700 1 -- 172.21.15.132:0/3202778652 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feb7001c7c0 con 0x7feb780d1100 2023-05-10T04:20:30.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.630+0000 7feb6f7fe700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feb5806ace0 0x7feb5806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:30.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.630+0000 7feb6f7fe700 1 -- 172.21.15.132:0/3202778652 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feb7008b100 con 0x7feb780d1100 2023-05-10T04:20:30.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.630+0000 7feb76ffd700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feb5806ace0 0x7feb5806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:30.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.631+0000 7feb76ffd700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feb5806ace0 0x7feb5806d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb68000f60 tx=0x7feb68007c90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:30.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.635+0000 7feb6f7fe700 1 -- 172.21.15.132:0/3202778652 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7feb70055f50 con 0x7feb780d1100 2023-05-10T04:20:30.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.832+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7feb78074430 con 0x7feb780d1100 2023-05-10T04:20:30.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.832+0000 7feb6f7fe700 1 -- 172.21.15.132:0/3202778652 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb70059570 con 0x7feb780d1100 2023-05-10T04:20:30.834 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:30.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feb5806ace0 msgr2=0x7feb5806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feb5806ace0 0x7feb5806d190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feb68000f60 tx=0x7feb68007c90 comp rx=0 tx=0).stop 2023-05-10T04:20:30.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb780d1100 msgr2=0x7feb780ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:30.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb780d1100 0x7feb780ca4c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7feb7000b680 tx=0x7feb70004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 shutdown_connections 2023-05-10T04:20:30.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feb5806ace0 0x7feb5806d190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb780d1100 0x7feb780ca4c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feb780b87a0 0x7feb780b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 --2- 172.21.15.132:0/3202778652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feb780cfbf0 0x7feb780c9f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:30.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.834+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 >> 172.21.15.132:0/3202778652 conn(0x7feb78071b10 msgr2=0x7feb78160170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:30.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.835+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 shutdown_connections 2023-05-10T04:20:30.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:30.835+0000 7feb7d3ff700 1 -- 172.21.15.132:0/3202778652 wait complete. 2023-05-10T04:20:30.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:31.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.038+0000 7f2a307ff700 1 Processor -- start 2023-05-10T04:20:31.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.038+0000 7f2a307ff700 1 -- start start 2023-05-10T04:20:31.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.039+0000 7f2a307ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280d0130 0x7f2a280cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.039+0000 7f2a307ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a280b26f0 con 0x7f2a2806b4f0 2023-05-10T04:20:31.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.039+0000 7f2a307ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a280cf890 con 0x7f2a280cbf90 2023-05-10T04:20:31.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.039+0000 7f2a307ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a280cfb60 con 0x7f2a280d0130 2023-05-10T04:20:31.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.039+0000 7f2a2e59b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2a2806b4f0 0x7f2a2806b8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49568/0 (socket says 172.21.15.132:49568) 2023-05-10T04:20:31.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2e59b700 1 -- 172.21.15.132:0/3215436722 learned_addr learned my addr 172.21.15.132:0/3215436722 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2dd9a700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280d0130 0x7f2a280cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720278107 0 0) 0x7f2a280b26f0 con 0x7f2a2806b4f0 2023-05-10T04:20:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a140035b0 con 0x7f2a2806b4f0 2023-05-10T04:20:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3726950237 0 0) 0x7f2a140035b0 con 0x7f2a2806b4f0 2023-05-10T04:20:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280d0130 msgr2=0x7f2a280cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280d0130 0x7f2a280cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 >> v1:172.21.15.154:6789/0 conn(0x7f2a280cbf90 legacy=0x7f2a280cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280cfe40 con 0x7f2a2806b4f0 2023-05-10T04:20:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f2a24001670 con 0x7f2a2806b4f0 2023-05-10T04:20:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 >> v1:172.21.15.132:6789/0 conn(0x7f2a2806b4f0 legacy=0x7f2a2806b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.040+0000 7f2a2d599700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280d0130 0x7f2a14003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2d599700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a14003f70 0x7f2a14004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2d599700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a14004d90 0x7f2a14005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a280cfb60 con 0x7f2a14003f70 2023-05-10T04:20:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1400baf0 con 0x7f2a14004d90 2023-05-10T04:20:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1400bcb0 con 0x7f2a280d0130 2023-05-10T04:20:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2dd9a700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a14003f70 0x7f2a14004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2e59b700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280d0130 0x7f2a14003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2ed9c700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a14004d90 0x7f2a14005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2dd9a700 1 -- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280d0130 msgr2=0x7f2a14003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2dd9a700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a280d0130 0x7f2a14003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2dd9a700 1 -- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a14004d90 msgr2=0x7f2a14005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2dd9a700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a14004d90 0x7f2a14005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2dd9a700 1 -- 172.21.15.132:0/3215436722 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a140035b0 con 0x7f2a14003f70 2023-05-10T04:20:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.041+0000 7f2a2dd9a700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a14003f70 0x7f2a14004850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009b30 tx=0x7f2a14005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fb25c5caf0a72a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1800e6c0 con 0x7f2a14003f70 2023-05-10T04:20:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1800e820 con 0x7f2a14003f70 2023-05-10T04:20:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a2d599700 1 -- 172.21.15.132:0/3215436722 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1800eb90 con 0x7f2a14003f70 2023-05-10T04:20:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a307ff700 1 -- 172.21.15.132:0/3215436722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a14003f70 msgr2=0x7f2a14004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a307ff700 1 --2- 172.21.15.132:0/3215436722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a14003f70 0x7f2a14004850 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2a18009b30 tx=0x7f2a14005880 comp rx=0 tx=0).stop 2023-05-10T04:20:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a2ed9c700 1 -- 172.21.15.132:0/3215436722 reap_dead start 2023-05-10T04:20:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a307ff700 1 -- 172.21.15.132:0/3215436722 shutdown_connections 2023-05-10T04:20:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a307ff700 1 -- 172.21.15.132:0/3215436722 >> 172.21.15.132:0/3215436722 conn(0x7f2a2809a090 msgr2=0x7f2a280d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a307ff700 1 -- 172.21.15.132:0/3215436722 shutdown_connections 2023-05-10T04:20:31.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.042+0000 7f2a307ff700 1 -- 172.21.15.132:0/3215436722 wait complete. 2023-05-10T04:20:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.044+0000 7f2a307ff700 1 Processor -- start 2023-05-10T04:20:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.044+0000 7f2a307ff700 1 -- start start 2023-05-10T04:20:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a307ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a14003f70 0x7f2a280b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a307ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a2815e670 0x7f2a2815eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a307ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a280c5a70 0x7f2a280c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a307ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a281600b0 con 0x7f2a280c5a70 2023-05-10T04:20:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a307ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2815f430 con 0x7f2a2815e670 2023-05-10T04:20:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a307ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2815f710 con 0x7f2a14003f70 2023-05-10T04:20:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a2ed9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a280c5a70 0x7f2a280c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a2ed9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a280c5a70 0x7f2a280c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39326/0 (socket says 172.21.15.132:39326) 2023-05-10T04:20:31.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.045+0000 7f2a2ed9c700 1 -- 172.21.15.132:0/75836739 learned_addr learned my addr 172.21.15.132:0/75836739 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2dd9a700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a2815e670 0x7f2a2815eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2e59b700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a14003f70 0x7f2a280b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2ed9c700 1 -- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a14003f70 msgr2=0x7f2a280b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2ed9c700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a14003f70 0x7f2a280b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2ed9c700 1 -- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a2815e670 msgr2=0x7f2a2815eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2ed9c700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a2815e670 0x7f2a2815eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2ed9c700 1 -- 172.21.15.132:0/75836739 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a280cb790 con 0x7f2a280c5a70 2023-05-10T04:20:31.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2e59b700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a14003f70 0x7f2a280b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a2ed9c700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a280c5a70 0x7f2a280c5ef0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2a28072a30 tx=0x7f2a2000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a1effd700 1 -- 172.21.15.132:0/75836739 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20003c10 con 0x7f2a280c5a70 2023-05-10T04:20:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a1effd700 1 -- 172.21.15.132:0/75836739 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20003d90 con 0x7f2a280c5a70 2023-05-10T04:20:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a280cb4b0 con 0x7f2a280c5a70 2023-05-10T04:20:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.046+0000 7f2a1effd700 1 -- 172.21.15.132:0/75836739 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2000c930 con 0x7f2a280c5a70 2023-05-10T04:20:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.047+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a280cba70 con 0x7f2a280c5a70 2023-05-10T04:20:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.047+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a281601f0 con 0x7f2a280c5a70 2023-05-10T04:20:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.048+0000 7f2a1effd700 1 -- 172.21.15.132:0/75836739 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2a2000ca90 con 0x7f2a280c5a70 2023-05-10T04:20:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.049+0000 7f2a1effd700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2a0c06ace0 0x7f2a0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.049+0000 7f2a1effd700 1 -- 172.21.15.132:0/75836739 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2a200898b0 con 0x7f2a280c5a70 2023-05-10T04:20:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.050+0000 7f2a2e59b700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2a0c06ace0 0x7f2a0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.050+0000 7f2a2e59b700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2a0c06ace0 0x7f2a0c06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2a28070170 tx=0x7f2a24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.053+0000 7f2a1effd700 1 -- 172.21.15.132:0/75836739 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2a281601f0 con 0x7f2a280c5a70 2023-05-10T04:20:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.247+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f2a281601f0 con 0x7f2a280c5a70 2023-05-10T04:20:31.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.248+0000 7f2a1effd700 1 -- 172.21.15.132:0/75836739 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f2a281601f0 con 0x7f2a280c5a70 2023-05-10T04:20:31.250 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.250+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2a0c06ace0 msgr2=0x7f2a0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.250+0000 7f2a307ff700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2a0c06ace0 0x7f2a0c06d190 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2a28070170 tx=0x7f2a24009040 comp rx=0 tx=0).stop 2023-05-10T04:20:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.250+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a280c5a70 msgr2=0x7f2a280c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.250+0000 7f2a307ff700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a280c5a70 0x7f2a280c5ef0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2a28072a30 tx=0x7f2a2000ef10 comp rx=0 tx=0).stop 2023-05-10T04:20:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.250+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 shutdown_connections 2023-05-10T04:20:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.251+0000 7f2a307ff700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2a0c06ace0 0x7f2a0c06d190 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.251+0000 7f2a307ff700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a280c5a70 0x7f2a280c5ef0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.251+0000 7f2a307ff700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2a14003f70 0x7f2a280b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.251+0000 7f2a307ff700 1 --2- 172.21.15.132:0/75836739 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2a2815e670 0x7f2a2815eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.251+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 >> 172.21.15.132:0/75836739 conn(0x7f2a2809a090 msgr2=0x7f2a280b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.251+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 shutdown_connections 2023-05-10T04:20:31.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.251+0000 7f2a307ff700 1 -- 172.21.15.132:0/75836739 wait complete. 2023-05-10T04:20:31.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:31.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.455+0000 7f271c1ff700 1 Processor -- start 2023-05-10T04:20:31.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.455+0000 7f271c1ff700 1 -- start start 2023-05-10T04:20:31.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f271c1ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f271415c590 0x7f2714160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f271c1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27140cf010 0x7f27140cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f271c1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27140cfd80 0x7f27140d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f271c1ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140cd520 con 0x7f271415c590 2023-05-10T04:20:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f271c1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27140d2640 con 0x7f27140cfd80 2023-05-10T04:20:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f271c1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27141610d0 con 0x7f27140cf010 2023-05-10T04:20:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f2719f9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f271415c590 0x7f2714160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f2719f9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f271415c590 0x7f2714160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39330/0 (socket says 172.21.15.132:39330) 2023-05-10T04:20:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.456+0000 7f2719f9b700 1 -- 172.21.15.132:0/599506188 learned_addr learned my addr 172.21.15.132:0/599506188 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f271a79c700 1 --2- 172.21.15.132:0/599506188 >> v2:172.21.15.154:3300/0 conn(0x7f27140cfd80 0x7f27140d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f271979a700 1 --2- 172.21.15.132:0/599506188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27140cf010 0x7f27140cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2719f9b700 1 -- 172.21.15.132:0/599506188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27140cf010 msgr2=0x7f27140cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2719f9b700 1 --2- 172.21.15.132:0/599506188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27140cf010 0x7f27140cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2719f9b700 1 -- 172.21.15.132:0/599506188 >> v2:172.21.15.154:3300/0 conn(0x7f27140cfd80 msgr2=0x7f27140d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2719f9b700 1 --2- 172.21.15.132:0/599506188 >> v2:172.21.15.154:3300/0 conn(0x7f27140cfd80 0x7f27140d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2719f9b700 1 -- 172.21.15.132:0/599506188 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27140d0200 con 0x7f271415c590 2023-05-10T04:20:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2719f9b700 1 --2- 172.21.15.132:0/599506188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f271415c590 0x7f2714160b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f271408c000 tx=0x7f2710009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3caa04308975191 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2718f99700 1 -- 172.21.15.132:0/599506188 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000b870 con 0x7f271415c590 2023-05-10T04:20:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2718f99700 1 -- 172.21.15.132:0/599506188 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271000b9d0 con 0x7f271415c590 2023-05-10T04:20:31.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.457+0000 7f2718f99700 1 -- 172.21.15.132:0/599506188 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271000bd60 con 0x7f271415c590 2023-05-10T04:20:31.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 -- 172.21.15.132:0/599506188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f271415c590 msgr2=0x7f2714160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 --2- 172.21.15.132:0/599506188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f271415c590 0x7f2714160b90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f271408c000 tx=0x7f2710009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 -- 172.21.15.132:0/599506188 shutdown_connections 2023-05-10T04:20:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 --2- 172.21.15.132:0/599506188 >> v2:172.21.15.154:3300/0 conn(0x7f27140cfd80 0x7f27140d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 --2- 172.21.15.132:0/599506188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f271415c590 0x7f2714160b90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 --2- 172.21.15.132:0/599506188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f27140cf010 0x7f27140cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 -- 172.21.15.132:0/599506188 >> 172.21.15.132:0/599506188 conn(0x7f2714071b10 msgr2=0x7f2714071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 -- 172.21.15.132:0/599506188 shutdown_connections 2023-05-10T04:20:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.458+0000 7f271c1ff700 1 -- 172.21.15.132:0/599506188 wait complete. 2023-05-10T04:20:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.460+0000 7f271c1ff700 1 Processor -- start 2023-05-10T04:20:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.460+0000 7f271c1ff700 1 -- start start 2023-05-10T04:20:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f271c1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27140cf010 0x7f2714155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f271c1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27140cfd80 0x7f2714154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f271c1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271415c590 0x7f27140b7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f271c1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140b7890 con 0x7f27140cf010 2023-05-10T04:20:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f271c1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271415f5e0 con 0x7f27140cfd80 2023-05-10T04:20:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f271c1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271415f8c0 con 0x7f271415c590 2023-05-10T04:20:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f2719f9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27140cf010 0x7f2714155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f2719f9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27140cf010 0x7f2714155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39338/0 (socket says 172.21.15.132:39338) 2023-05-10T04:20:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f2719f9b700 1 -- 172.21.15.132:0/1638920123 learned_addr learned my addr 172.21.15.132:0/1638920123 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f271a79c700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271415c590 0x7f27140b7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f271979a700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27140cfd80 0x7f2714154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f2719f9b700 1 -- 172.21.15.132:0/1638920123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271415c590 msgr2=0x7f27140b7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f2719f9b700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271415c590 0x7f27140b7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f2719f9b700 1 -- 172.21.15.132:0/1638920123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27140cfd80 msgr2=0x7f2714154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f2719f9b700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27140cfd80 0x7f2714154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.461+0000 7f2719f9b700 1 -- 172.21.15.132:0/1638920123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2710009550 con 0x7f27140cf010 2023-05-10T04:20:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.462+0000 7f2719f9b700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27140cf010 0x7f2714155900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2710000c00 tx=0x7f2710004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.462+0000 7f270a7fc700 1 -- 172.21.15.132:0/1638920123 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2710004520 con 0x7f27140cf010 2023-05-10T04:20:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.462+0000 7f270a7fc700 1 -- 172.21.15.132:0/1638920123 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271001e070 con 0x7f27140cf010 2023-05-10T04:20:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.462+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27140cf560 con 0x7f27140cf010 2023-05-10T04:20:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.462+0000 7f270a7fc700 1 -- 172.21.15.132:0/1638920123 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27100038c0 con 0x7f27140cf010 2023-05-10T04:20:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.462+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27140b23c0 con 0x7f27140cf010 2023-05-10T04:20:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.463+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27140cd770 con 0x7f27140cf010 2023-05-10T04:20:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.464+0000 7f270a7fc700 1 -- 172.21.15.132:0/1638920123 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2710003a20 con 0x7f27140cf010 2023-05-10T04:20:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.465+0000 7f270a7fc700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f26f806ace0 0x7f26f806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.465+0000 7f270a7fc700 1 -- 172.21.15.132:0/1638920123 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2710020070 con 0x7f27140cf010 2023-05-10T04:20:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.465+0000 7f271979a700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f26f806ace0 0x7f26f806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.466+0000 7f271979a700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f26f806ace0 0x7f26f806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27140d1c70 tx=0x7f2704008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.469+0000 7f270a7fc700 1 -- 172.21.15.132:0/1638920123 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2710055a30 con 0x7f27140cf010 2023-05-10T04:20:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.663+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27140b79d0 con 0x7f27140cf010 2023-05-10T04:20:31.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.663+0000 7f270a7fc700 1 -- 172.21.15.132:0/1638920123 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27140b79d0 con 0x7f27140cf010 2023-05-10T04:20:31.666 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:31.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f26f806ace0 msgr2=0x7f26f806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f26f806ace0 0x7f26f806d190 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27140d1c70 tx=0x7f2704008040 comp rx=0 tx=0).stop 2023-05-10T04:20:31.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27140cf010 msgr2=0x7f2714155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27140cf010 0x7f2714155900 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f2710000c00 tx=0x7f2710004750 comp rx=0 tx=0).stop 2023-05-10T04:20:31.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 shutdown_connections 2023-05-10T04:20:31.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f26f806ace0 0x7f26f806d190 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f271415c590 0x7f27140b7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27140cf010 0x7f2714155900 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 --2- 172.21.15.132:0/1638920123 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f27140cfd80 0x7f2714154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 >> 172.21.15.132:0/1638920123 conn(0x7f2714071b10 msgr2=0x7f27140d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:31.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 shutdown_connections 2023-05-10T04:20:31.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.666+0000 7f271c1ff700 1 -- 172.21.15.132:0/1638920123 wait complete. 2023-05-10T04:20:31.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:31.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.870+0000 7fb4d4bff700 1 Processor -- start 2023-05-10T04:20:31.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.870+0000 7fb4d4bff700 1 -- start start 2023-05-10T04:20:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.871+0000 7fb4d4bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d015a5a0 0x7fb4d006a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.871+0000 7fb4d4bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb4d006a920 0x7fb4d0070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.871+0000 7fb4d4bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4d0071030 0x7fb4d015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.871+0000 7fb4d4bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d015a970 con 0x7fb4d0071030 2023-05-10T04:20:31.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.871+0000 7fb4d4bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4d006ad90 con 0x7fb4d006a920 2023-05-10T04:20:31.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.871+0000 7fb4d4bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d00cb280 con 0x7fb4d015a5a0 2023-05-10T04:20:31.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4d0071030 0x7fb4d015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4d0071030 0x7fb4d015dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39342/0 (socket says 172.21.15.132:39342) 2023-05-10T04:20:31.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 -- 172.21.15.132:0/3987816038 learned_addr learned my addr 172.21.15.132:0/3987816038 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:31.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ce59c700 1 --2- 172.21.15.132:0/3987816038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d015a5a0 0x7fb4d006a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4cdd9b700 1 --2- 172.21.15.132:0/3987816038 >> v2:172.21.15.154:3300/0 conn(0x7fb4d006a920 0x7fb4d0070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 -- 172.21.15.132:0/3987816038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d015a5a0 msgr2=0x7fb4d006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:31.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 --2- 172.21.15.132:0/3987816038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d015a5a0 0x7fb4d006a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 -- 172.21.15.132:0/3987816038 >> v2:172.21.15.154:3300/0 conn(0x7fb4d006a920 msgr2=0x7fb4d0070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:31.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 --2- 172.21.15.132:0/3987816038 >> v2:172.21.15.154:3300/0 conn(0x7fb4d006a920 0x7fb4d0070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 -- 172.21.15.132:0/3987816038 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d00714b0 con 0x7fb4d0071030 2023-05-10T04:20:31.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ce59c700 1 --2- 172.21.15.132:0/3987816038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d015a5a0 0x7fb4d006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:31.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4cdd9b700 1 --2- 172.21.15.132:0/3987816038 >> v2:172.21.15.154:3300/0 conn(0x7fb4d006a920 0x7fb4d0070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:31.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.872+0000 7fb4ced9d700 1 --2- 172.21.15.132:0/3987816038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d015dff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00705d0 tx=0x7fb4c800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31759e547c05b7f5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4cd59a700 1 -- 172.21.15.132:0/3987816038 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800e070 con 0x7fb4d0071030 2023-05-10T04:20:31.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4cd59a700 1 -- 172.21.15.132:0/3987816038 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c800b980 con 0x7fb4d0071030 2023-05-10T04:20:31.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4cd59a700 1 -- 172.21.15.132:0/3987816038 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c800bd30 con 0x7fb4d0071030 2023-05-10T04:20:31.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 -- 172.21.15.132:0/3987816038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 msgr2=0x7fb4d015dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/3987816038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d015dff0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00705d0 tx=0x7fb4c800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:31.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 -- 172.21.15.132:0/3987816038 shutdown_connections 2023-05-10T04:20:31.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/3987816038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d015dff0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/3987816038 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d015a5a0 0x7fb4d006a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/3987816038 >> v2:172.21.15.154:3300/0 conn(0x7fb4d006a920 0x7fb4d0070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 -- 172.21.15.132:0/3987816038 >> 172.21.15.132:0/3987816038 conn(0x7fb4d00cf720 msgr2=0x7fb4d00cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:31.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 -- 172.21.15.132:0/3987816038 shutdown_connections 2023-05-10T04:20:31.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.873+0000 7fb4d4bff700 1 -- 172.21.15.132:0/3987816038 wait complete. 2023-05-10T04:20:31.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.875+0000 7fb4d4bff700 1 Processor -- start 2023-05-10T04:20:31.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.875+0000 7fb4d4bff700 1 -- start start 2023-05-10T04:20:31.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4d4bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d006a920 0x7fb4d01e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4d4bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d00c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4d4bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d015a5a0 0x7fb4d00ae940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4d4bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d01438a0 con 0x7fb4d0071030 2023-05-10T04:20:31.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4d4bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0142cb0 con 0x7fb4d015a5a0 2023-05-10T04:20:31.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4d4bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d0142f00 con 0x7fb4d006a920 2023-05-10T04:20:31.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4cdd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d00c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4cdd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d00c5020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39346/0 (socket says 172.21.15.132:39346) 2023-05-10T04:20:31.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.876+0000 7fb4cdd9b700 1 -- 172.21.15.132:0/2582710500 learned_addr learned my addr 172.21.15.132:0/2582710500 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:31.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4ced9d700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d015a5a0 0x7fb4d00ae940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4ce59c700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d006a920 0x7fb4d01e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4cdd9b700 1 -- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d006a920 msgr2=0x7fb4d01e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4cdd9b700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d006a920 0x7fb4d01e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4cdd9b700 1 -- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d015a5a0 msgr2=0x7fb4d00ae940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:31.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4cdd9b700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d015a5a0 0x7fb4d00ae940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:31.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4cdd9b700 1 -- 172.21.15.132:0/2582710500 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4c8009b30 con 0x7fb4d0071030 2023-05-10T04:20:31.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4ce59c700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d006a920 0x7fb4d01e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:31.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4cdd9b700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d00c5020 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4006fd0 tx=0x7fb4c400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4beffd700 1 -- 172.21.15.132:0/2582710500 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4005c20 con 0x7fb4d0071030 2023-05-10T04:20:31.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4beffd700 1 -- 172.21.15.132:0/2582710500 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4c4005d80 con 0x7fb4d0071030 2023-05-10T04:20:31.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d00719e0 con 0x7fb4d0071030 2023-05-10T04:20:31.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4beffd700 1 -- 172.21.15.132:0/2582710500 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c4011840 con 0x7fb4d0071030 2023-05-10T04:20:31.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.877+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d0071700 con 0x7fb4d0071030 2023-05-10T04:20:31.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.878+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4d006c6c0 con 0x7fb4d0071030 2023-05-10T04:20:31.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.879+0000 7fb4beffd700 1 -- 172.21.15.132:0/2582710500 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb4c40119a0 con 0x7fb4d0071030 2023-05-10T04:20:31.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.880+0000 7fb4beffd700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4b006ace0 0x7fb4b006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:31.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.880+0000 7fb4beffd700 1 -- 172.21.15.132:0/2582710500 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb4c4089a10 con 0x7fb4d0071030 2023-05-10T04:20:31.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.881+0000 7fb4ce59c700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4b006ace0 0x7fb4b006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:31.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.881+0000 7fb4ce59c700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4b006ace0 0x7fb4b006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000aa20 tx=0x7fb4c0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:31.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:31.885+0000 7fb4beffd700 1 -- 172.21.15.132:0/2582710500 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb4c4054730 con 0x7fb4d0071030 2023-05-10T04:20:32.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.077+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4d006a700 con 0x7fb4d0071030 2023-05-10T04:20:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.078+0000 7fb4beffd700 1 -- 172.21.15.132:0/2582710500 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4c4057d50 con 0x7fb4d0071030 2023-05-10T04:20:32.080 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4b006ace0 msgr2=0x7fb4b006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4b006ace0 0x7fb4b006d190 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb4c000aa20 tx=0x7fb4c0008040 comp rx=0 tx=0).stop 2023-05-10T04:20:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 msgr2=0x7fb4d00c5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d00c5020 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb4c4006fd0 tx=0x7fb4c400ca30 comp rx=0 tx=0).stop 2023-05-10T04:20:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 shutdown_connections 2023-05-10T04:20:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb4b006ace0 0x7fb4b006d190 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb4d015a5a0 0x7fb4d00ae940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb4d006a920 0x7fb4d01e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 --2- 172.21.15.132:0/2582710500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4d0071030 0x7fb4d00c5020 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 >> 172.21.15.132:0/2582710500 conn(0x7fb4d00cf720 msgr2=0x7fb4d00b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:32.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 shutdown_connections 2023-05-10T04:20:32.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.080+0000 7fb4d4bff700 1 -- 172.21.15.132:0/2582710500 wait complete. 2023-05-10T04:20:32.100 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:32.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.284+0000 7fe99afff700 1 Processor -- start 2023-05-10T04:20:32.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.284+0000 7fe99afff700 1 -- start start 2023-05-10T04:20:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.285+0000 7fe99afff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9940b87a0 0x7fe9940cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.285+0000 7fe99afff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9940cdc60 con 0x7fe994160d40 2023-05-10T04:20:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.285+0000 7fe99afff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9940cd6a0 con 0x7fe9941601e0 2023-05-10T04:20:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.285+0000 7fe99afff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9940d02d0 con 0x7fe9940b87a0 2023-05-10T04:20:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe998d9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9940b87a0 0x7fe9940cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe99959c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe994160d40 0x7fe9940d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:49574/0 (socket says 172.21.15.132:49574) 2023-05-10T04:20:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe99959c700 1 -- 172.21.15.132:0/2610818467 learned_addr learned my addr 172.21.15.132:0/2610818467 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe998d9b700 1 -- 172.21.15.132:0/2610818467 >> v1:172.21.15.154:6789/0 conn(0x7fe9941601e0 legacy=0x7fe994160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe998d9b700 1 -- 172.21.15.132:0/2610818467 >> v1:172.21.15.132:6789/0 conn(0x7fe994160d40 legacy=0x7fe9940d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe998d9b700 1 -- 172.21.15.132:0/2610818467 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940cd980 con 0x7fe9940b87a0 2023-05-10T04:20:32.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe9937fe700 1 -- 172.21.15.132:0/2610818467 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1698043430 0 0) 0x7fe9940cdc60 con 0x7fe994160d40 2023-05-10T04:20:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe998d9b700 1 --2- 172.21.15.132:0/2610818467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9940b87a0 0x7fe9940cfbf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe988009840 tx=0x7fe988009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485c5f92af9ce8ab server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.286+0000 7fe9937fe700 1 -- 172.21.15.132:0/2610818467 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988004230 con 0x7fe9940b87a0 2023-05-10T04:20:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe9937fe700 1 -- 172.21.15.132:0/2610818467 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988004390 con 0x7fe9940b87a0 2023-05-10T04:20:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe9937fe700 1 -- 172.21.15.132:0/2610818467 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9880036a0 con 0x7fe9940b87a0 2023-05-10T04:20:32.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe99afff700 1 -- 172.21.15.132:0/2610818467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9940b87a0 msgr2=0x7fe9940cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe99afff700 1 --2- 172.21.15.132:0/2610818467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9940b87a0 0x7fe9940cfbf0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe988009840 tx=0x7fe988009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:32.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe99afff700 1 -- 172.21.15.132:0/2610818467 shutdown_connections 2023-05-10T04:20:32.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe99afff700 1 --2- 172.21.15.132:0/2610818467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9940b87a0 0x7fe9940cfbf0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe99afff700 1 -- 172.21.15.132:0/2610818467 >> 172.21.15.132:0/2610818467 conn(0x7fe994071b10 msgr2=0x7fe994071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:32.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe99afff700 1 -- 172.21.15.132:0/2610818467 shutdown_connections 2023-05-10T04:20:32.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.287+0000 7fe99afff700 1 -- 172.21.15.132:0/2610818467 wait complete. 2023-05-10T04:20:32.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.289+0000 7fe99afff700 1 Processor -- start 2023-05-10T04:20:32.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.289+0000 7fe99afff700 1 -- start start 2023-05-10T04:20:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe99afff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9940b87a0 0x7fe99415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe99afff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9941601e0 0x7fe9941536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe99afff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe994160d40 0x7fe99415c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe99afff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe994153c20 con 0x7fe9941601e0 2023-05-10T04:20:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe99afff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9940c7cf0 con 0x7fe994160d40 2023-05-10T04:20:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe99afff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe99415cb60 con 0x7fe9940b87a0 2023-05-10T04:20:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe993fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9941601e0 0x7fe9941536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe993fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9941601e0 0x7fe9941536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39350/0 (socket says 172.21.15.132:39350) 2023-05-10T04:20:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe993fff700 1 -- 172.21.15.132:0/4257880720 learned_addr learned my addr 172.21.15.132:0/4257880720 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe998d9b700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9940b87a0 0x7fe99415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe99959c700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe994160d40 0x7fe99415c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.290+0000 7fe993fff700 1 -- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9940b87a0 msgr2=0x7fe99415e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe993fff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9940b87a0 0x7fe99415e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe993fff700 1 -- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe994160d40 msgr2=0x7fe99415c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe993fff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe994160d40 0x7fe99415c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe993fff700 1 -- 172.21.15.132:0/4257880720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9880094a0 con 0x7fe9941601e0 2023-05-10T04:20:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe998d9b700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9940b87a0 0x7fe99415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:32.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe993fff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9941601e0 0x7fe9941536e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe98000c4a0 tx=0x7fe98000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe9917fa700 1 -- 172.21.15.132:0/4257880720 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9800054e0 con 0x7fe9941601e0 2023-05-10T04:20:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe9917fa700 1 -- 172.21.15.132:0/4257880720 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe980003680 con 0x7fe9941601e0 2023-05-10T04:20:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9940d19a0 con 0x7fe9941601e0 2023-05-10T04:20:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe9917fa700 1 -- 172.21.15.132:0/4257880720 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe980003a30 con 0x7fe9941601e0 2023-05-10T04:20:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.291+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9940d1810 con 0x7fe9941601e0 2023-05-10T04:20:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.292+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9940d1b30 con 0x7fe9941601e0 2023-05-10T04:20:32.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.293+0000 7fe9917fa700 1 -- 172.21.15.132:0/4257880720 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe980003b90 con 0x7fe9941601e0 2023-05-10T04:20:32.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:20:32.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.294+0000 7fe9917fa700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe97806ace0 0x7fe97806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.294+0000 7fe9917fa700 1 -- 172.21.15.132:0/4257880720 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe980088d80 con 0x7fe9941601e0 2023-05-10T04:20:32.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.294+0000 7fe998d9b700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe97806ace0 0x7fe97806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.295+0000 7fe998d9b700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe97806ace0 0x7fe97806d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe988000c00 tx=0x7fe98801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:32.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.298+0000 7fe9917fa700 1 -- 172.21.15.132:0/4257880720 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe980053aa0 con 0x7fe9941601e0 2023-05-10T04:20:32.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:20:32.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.500+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe9940c7ec0 con 0x7fe9941601e0 2023-05-10T04:20:32.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.500+0000 7fe9917fa700 1 -- 172.21.15.132:0/4257880720 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe9800170a0 con 0x7fe9941601e0 2023-05-10T04:20:32.502 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:32.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.502+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe97806ace0 msgr2=0x7fe97806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.502+0000 7fe99afff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe97806ace0 0x7fe97806d190 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe988000c00 tx=0x7fe98801c040 comp rx=0 tx=0).stop 2023-05-10T04:20:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.502+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9941601e0 msgr2=0x7fe9941536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.502+0000 7fe99afff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9941601e0 0x7fe9941536e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe98000c4a0 tx=0x7fe98000c860 comp rx=0 tx=0).stop 2023-05-10T04:20:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.503+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 shutdown_connections 2023-05-10T04:20:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.503+0000 7fe99afff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe97806ace0 0x7fe97806d190 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.503+0000 7fe99afff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe994160d40 0x7fe99415c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.503+0000 7fe99afff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9940b87a0 0x7fe99415e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.503+0000 7fe99afff700 1 --2- 172.21.15.132:0/4257880720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9941601e0 0x7fe9941536e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.503+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 >> 172.21.15.132:0/4257880720 conn(0x7fe994071b10 msgr2=0x7fe9940b6570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.503+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 shutdown_connections 2023-05-10T04:20:32.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.503+0000 7fe99afff700 1 -- 172.21.15.132:0/4257880720 wait complete. 2023-05-10T04:20:32.522 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:20:32.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.705+0000 7fdd613ff700 1 Processor -- start 2023-05-10T04:20:32.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.705+0000 7fdd613ff700 1 -- start start 2023-05-10T04:20:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd613ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5c0cd760 0x7fdd5c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd613ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 0x7fdd5c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd613ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fdd5c15cf10 0x7fdd5c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd613ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c0cc9e0 con 0x7fdd5c0cd760 2023-05-10T04:20:32.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd613ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd5c15de20 con 0x7fdd5c15cf10 2023-05-10T04:20:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd613ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0ce070 con 0x7fdd5c0adf70 2023-05-10T04:20:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5affd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5c0cd760 0x7fdd5c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5affd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5c0cd760 0x7fdd5c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40960/0 (socket says 172.21.15.132:40960) 2023-05-10T04:20:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5affd700 1 -- 172.21.15.132:0/741590353 learned_addr learned my addr 172.21.15.132:0/741590353 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd53fff700 1 --2- 172.21.15.132:0/741590353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 0x7fdd5c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5b7fe700 1 --2- 172.21.15.132:0/741590353 >> v2:172.21.15.154:3300/0 conn(0x7fdd5c15cf10 0x7fdd5c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5affd700 1 -- 172.21.15.132:0/741590353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 msgr2=0x7fdd5c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:32.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5affd700 1 --2- 172.21.15.132:0/741590353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 0x7fdd5c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5affd700 1 -- 172.21.15.132:0/741590353 >> v2:172.21.15.154:3300/0 conn(0x7fdd5c15cf10 msgr2=0x7fdd5c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:32.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5affd700 1 --2- 172.21.15.132:0/741590353 >> v2:172.21.15.154:3300/0 conn(0x7fdd5c15cf10 0x7fdd5c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.707+0000 7fdd5affd700 1 -- 172.21.15.132:0/741590353 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5c15d860 con 0x7fdd5c0cd760 2023-05-10T04:20:32.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.708+0000 7fdd5affd700 1 --2- 172.21.15.132:0/741590353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0cdb30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0b49c0 tx=0x7fdd4c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cafcdc4c14214 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:32.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd5a7fc700 1 -- 172.21.15.132:0/741590353 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00f8a0 con 0x7fdd5c0cd760 2023-05-10T04:20:32.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd5a7fc700 1 -- 172.21.15.132:0/741590353 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c00fa00 con 0x7fdd5c0cd760 2023-05-10T04:20:32.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd5a7fc700 1 -- 172.21.15.132:0/741590353 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00fd90 con 0x7fdd5c0cd760 2023-05-10T04:20:32.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd613ff700 1 -- 172.21.15.132:0/741590353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 msgr2=0x7fdd5c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd613ff700 1 --2- 172.21.15.132:0/741590353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0cdb30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdd5c0b49c0 tx=0x7fdd4c009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd613ff700 1 -- 172.21.15.132:0/741590353 shutdown_connections 2023-05-10T04:20:32.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd613ff700 1 --2- 172.21.15.132:0/741590353 >> v2:172.21.15.154:3300/0 conn(0x7fdd5c15cf10 0x7fdd5c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd613ff700 1 --2- 172.21.15.132:0/741590353 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0cdb30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.710+0000 7fdd613ff700 1 --2- 172.21.15.132:0/741590353 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 0x7fdd5c0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.711+0000 7fdd613ff700 1 -- 172.21.15.132:0/741590353 >> 172.21.15.132:0/741590353 conn(0x7fdd5c0cf720 msgr2=0x7fdd5c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:32.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.711+0000 7fdd613ff700 1 -- 172.21.15.132:0/741590353 shutdown_connections 2023-05-10T04:20:32.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.711+0000 7fdd613ff700 1 -- 172.21.15.132:0/741590353 wait complete. 2023-05-10T04:20:32.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.713+0000 7fdd613ff700 1 Processor -- start 2023-05-10T04:20:32.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.713+0000 7fdd613ff700 1 -- start start 2023-05-10T04:20:32.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.714+0000 7fdd613ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 0x7fdd5c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.714+0000 7fdd613ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.714+0000 7fdd613ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c15cf10 0x7fdd5c0cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.714+0000 7fdd613ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c3b40 con 0x7fdd5c0cd760 2023-05-10T04:20:32.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.714+0000 7fdd613ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c3e20 con 0x7fdd5c15cf10 2023-05-10T04:20:32.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.714+0000 7fdd613ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5c0c4100 con 0x7fdd5c0adf70 2023-05-10T04:20:32.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40976/0 (socket says 172.21.15.132:40976) 2023-05-10T04:20:32.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 -- 172.21.15.132:0/175366734 learned_addr learned my addr 172.21.15.132:0/175366734 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:32.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd5affd700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 0x7fdd5c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd5b7fe700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c15cf10 0x7fdd5c0cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 -- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 msgr2=0x7fdd5c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 0x7fdd5c0c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 -- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c15cf10 msgr2=0x7fdd5c0cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c15cf10 0x7fdd5c0cafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 -- 172.21.15.132:0/175366734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c009550 con 0x7fdd5c0cd760 2023-05-10T04:20:32.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd5b7fe700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c15cf10 0x7fdd5c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:32.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd53fff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0c31f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400e900 tx=0x7fdd4400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:32.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.715+0000 7fdd537fe700 1 -- 172.21.15.132:0/175366734 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44009650 con 0x7fdd5c0cd760 2023-05-10T04:20:32.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.716+0000 7fdd537fe700 1 -- 172.21.15.132:0/175366734 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4400ee50 con 0x7fdd5c0cd760 2023-05-10T04:20:32.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.716+0000 7fdd537fe700 1 -- 172.21.15.132:0/175366734 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400ca50 con 0x7fdd5c0cd760 2023-05-10T04:20:32.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.716+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd5c0cc670 con 0x7fdd5c0cd760 2023-05-10T04:20:32.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.716+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5c15db40 con 0x7fdd5c0cd760 2023-05-10T04:20:32.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.717+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5c071600 con 0x7fdd5c0cd760 2023-05-10T04:20:32.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.717+0000 7fdd537fe700 1 -- 172.21.15.132:0/175366734 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd4400cbb0 con 0x7fdd5c0cd760 2023-05-10T04:20:32.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.719+0000 7fdd537fe700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3c06ad10 0x7fdd3c06d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.719+0000 7fdd537fe700 1 -- 172.21.15.132:0/175366734 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdd44089af0 con 0x7fdd5c0cd760 2023-05-10T04:20:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.719+0000 7fdd5affd700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3c06ad10 0x7fdd3c06d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:32.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.720+0000 7fdd5affd700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3c06ad10 0x7fdd3c06d1c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009c10 tx=0x7fdd4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:32.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.723+0000 7fdd537fe700 1 -- 172.21.15.132:0/175366734 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fdd440582a0 con 0x7fdd5c0cd760 2023-05-10T04:20:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.936+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdd5c0cde50 con 0x7fdd5c0cd760 2023-05-10T04:20:32.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.936+0000 7fdd537fe700 1 -- 172.21.15.132:0/175366734 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdd4400ce60 con 0x7fdd5c0cd760 2023-05-10T04:20:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3c06ad10 msgr2=0x7fdd3c06d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3c06ad10 0x7fdd3c06d1c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009c10 tx=0x7fdd4c008030 comp rx=0 tx=0).stop 2023-05-10T04:20:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 msgr2=0x7fdd5c0c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0c31f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdd4400e900 tx=0x7fdd4400ec10 comp rx=0 tx=0).stop 2023-05-10T04:20:32.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 shutdown_connections 2023-05-10T04:20:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fdd3c06ad10 0x7fdd3c06d1c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fdd5c15cf10 0x7fdd5c0cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fdd5c0adf70 0x7fdd5c0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 --2- 172.21.15.132:0/175366734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5c0cd760 0x7fdd5c0c31f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 >> 172.21.15.132:0/175366734 conn(0x7fdd5c0cf720 msgr2=0x7fdd5c15aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 shutdown_connections 2023-05-10T04:20:32.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:32.939+0000 7fdd613ff700 1 -- 172.21.15.132:0/175366734 wait complete. 2023-05-10T04:20:32.943 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:20:32.958 DEBUG:teuthology.orchestra.run.smithi154:> set -ex 2023-05-10T04:20:32.958 DEBUG:teuthology.orchestra.run.smithi154:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-10T04:20:33.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:33.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.183+0000 7fb1c85ff700 1 Processor -- start 2023-05-10T04:20:33.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.183+0000 7fb1c85ff700 1 -- start start 2023-05-10T04:20:33.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.184+0000 7fb1c85ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb1c00cfbf0 0x7fb1c01608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.184+0000 7fb1c85ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00d1100 0x7fb1c00d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.184+0000 7fb1c85ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1c00d0020 con 0x7fb1c00b87a0 2023-05-10T04:20:33.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.184+0000 7fb1c85ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1c00d02d0 con 0x7fb1c00cfbf0 2023-05-10T04:20:33.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.184+0000 7fb1c85ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00d0cb0 con 0x7fb1c00d1100 2023-05-10T04:20:33.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5b9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb1c00cfbf0 0x7fb1c01608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5b9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb1c00cfbf0 0x7fb1c01608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40990/0 (socket says 172.21.15.132:40990) 2023-05-10T04:20:33.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c639b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb1c00b87a0 0x7fb1c01601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46918/0 (socket says 172.21.15.132:46918) 2023-05-10T04:20:33.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5b9a700 1 -- 172.21.15.132:0/325236177 learned_addr learned my addr 172.21.15.132:0/325236177 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:33.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c6b9c700 1 --2- 172.21.15.132:0/325236177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00d1100 0x7fb1c00d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5b9a700 1 -- 172.21.15.132:0/325236177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00d1100 msgr2=0x7fb1c00d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5b9a700 1 --2- 172.21.15.132:0/325236177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00d1100 0x7fb1c00d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5b9a700 1 -- 172.21.15.132:0/325236177 >> v1:172.21.15.132:6789/0 conn(0x7fb1c00b87a0 legacy=0x7fb1c01601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5b9a700 1 -- 172.21.15.132:0/325236177 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c00cdc60 con 0x7fb1c00cfbf0 2023-05-10T04:20:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c6b9c700 1 --2- 172.21.15.132:0/325236177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00d1100 0x7fb1c00d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:33.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5399700 1 -- 172.21.15.132:0/325236177 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430120587 0 0) 0x7fb1c00d0020 con 0x7fb1c00b87a0 2023-05-10T04:20:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5b9a700 1 --2- 172.21.15.132:0/325236177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00cfbf0 0x7fb1c01608f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00098f0 tx=0x7fb1b0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef49fbee07516462 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.185+0000 7fb1c5399700 1 -- 172.21.15.132:0/325236177 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b000b8a0 con 0x7fb1c00cfbf0 2023-05-10T04:20:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c5399700 1 -- 172.21.15.132:0/325236177 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b000ba00 con 0x7fb1c00cfbf0 2023-05-10T04:20:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c5399700 1 -- 172.21.15.132:0/325236177 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b000bd90 con 0x7fb1c00cfbf0 2023-05-10T04:20:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c85ff700 1 -- 172.21.15.132:0/325236177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00cfbf0 msgr2=0x7fb1c01608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/325236177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00cfbf0 0x7fb1c01608f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb1b00098f0 tx=0x7fb1b0009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:33.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c85ff700 1 -- 172.21.15.132:0/325236177 shutdown_connections 2023-05-10T04:20:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/325236177 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00d1100 0x7fb1c00d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/325236177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00cfbf0 0x7fb1c01608f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c85ff700 1 -- 172.21.15.132:0/325236177 >> 172.21.15.132:0/325236177 conn(0x7fb1c0071b10 msgr2=0x7fb1c0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c85ff700 1 -- 172.21.15.132:0/325236177 shutdown_connections 2023-05-10T04:20:33.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.186+0000 7fb1c85ff700 1 -- 172.21.15.132:0/325236177 wait complete. 2023-05-10T04:20:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.188+0000 7fb1c85ff700 1 Processor -- start 2023-05-10T04:20:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.188+0000 7fb1c85ff700 1 -- start start 2023-05-10T04:20:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c85ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c00b87a0 0x7fb1c00c7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c85ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00cfbf0 0x7fb1c01f33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c85ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00d1100 0x7fb1c015d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c85ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c01f1fd0 con 0x7fb1c00d1100 2023-05-10T04:20:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c85ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c015dc30 con 0x7fb1c00b87a0 2023-05-10T04:20:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c85ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c00c7ae0 con 0x7fb1c00cfbf0 2023-05-10T04:20:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c6b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00d1100 0x7fb1c015d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c6b9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00d1100 0x7fb1c015d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41000/0 (socket says 172.21.15.132:41000) 2023-05-10T04:20:33.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c6b9c700 1 -- 172.21.15.132:0/4246618911 learned_addr learned my addr 172.21.15.132:0/4246618911 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c6b9c700 1 -- 172.21.15.132:0/4246618911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00cfbf0 msgr2=0x7fb1c01f33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c6b9c700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00cfbf0 0x7fb1c01f33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c6b9c700 1 -- 172.21.15.132:0/4246618911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c00b87a0 msgr2=0x7fb1c00c7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c6b9c700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c00b87a0 0x7fb1c00c7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.189+0000 7fb1c6b9c700 1 -- 172.21.15.132:0/4246618911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b0009550 con 0x7fb1c00d1100 2023-05-10T04:20:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.190+0000 7fb1c6b9c700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00d1100 0x7fb1c015d6f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800cef0 tx=0x7fb1b800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.190+0000 7fb1b6ffd700 1 -- 172.21.15.132:0/4246618911 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b800ae50 con 0x7fb1c00d1100 2023-05-10T04:20:33.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.190+0000 7fb1b6ffd700 1 -- 172.21.15.132:0/4246618911 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1b8015440 con 0x7fb1c00d1100 2023-05-10T04:20:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.190+0000 7fb1b6ffd700 1 -- 172.21.15.132:0/4246618911 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1b80157f0 con 0x7fb1c00d1100 2023-05-10T04:20:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.190+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1c00cd980 con 0x7fb1c00d1100 2023-05-10T04:20:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.190+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1c00cd6a0 con 0x7fb1c00d1100 2023-05-10T04:20:33.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.191+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1c0160e30 con 0x7fb1c00d1100 2023-05-10T04:20:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.192+0000 7fb1b6ffd700 1 -- 172.21.15.132:0/4246618911 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb1b800d430 con 0x7fb1c00d1100 2023-05-10T04:20:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.193+0000 7fb1b6ffd700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb1a406ace0 0x7fb1a406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.193+0000 7fb1b6ffd700 1 -- 172.21.15.132:0/4246618911 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb1b8089de0 con 0x7fb1c00d1100 2023-05-10T04:20:33.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.193+0000 7fb1c639b700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb1a406ace0 0x7fb1a406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.194+0000 7fb1c639b700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb1a406ace0 0x7fb1a406d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc001610 tx=0x7fb1bc0079f0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:33.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.197+0000 7fb1b6ffd700 1 -- 172.21.15.132:0/4246618911 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb1b8054b90 con 0x7fb1c00d1100 2023-05-10T04:20:33.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.393+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1c0074430 con 0x7fb1c00d1100 2023-05-10T04:20:33.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.394+0000 7fb1b6ffd700 1 -- 172.21.15.132:0/4246618911 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fb1b801a090 con 0x7fb1c00d1100 2023-05-10T04:20:33.397 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:33.397 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:33.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb1a406ace0 msgr2=0x7fb1a406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb1a406ace0 0x7fb1a406d190 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb1bc001610 tx=0x7fb1bc0079f0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00d1100 msgr2=0x7fb1c015d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00d1100 0x7fb1c015d6f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb1b800cef0 tx=0x7fb1b800a340 comp rx=0 tx=0).stop 2023-05-10T04:20:33.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 shutdown_connections 2023-05-10T04:20:33.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb1a406ace0 0x7fb1a406d190 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb1c00d1100 0x7fb1c015d6f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1c00b87a0 0x7fb1c00c7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 --2- 172.21.15.132:0/4246618911 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1c00cfbf0 0x7fb1c01f33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 >> 172.21.15.132:0/4246618911 conn(0x7fb1c0071b10 msgr2=0x7fb1c00cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:33.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 shutdown_connections 2023-05-10T04:20:33.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.396+0000 7fb1c85ff700 1 -- 172.21.15.132:0/4246618911 wait complete. 2023-05-10T04:20:33.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:33.417 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.601+0000 7f6254dff700 1 Processor -- start 2023-05-10T04:20:33.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.601+0000 7f6254dff700 1 -- start start 2023-05-10T04:20:33.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.602+0000 7f6254dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62500ca210 0x7f62500b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.602+0000 7f6254dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f625006b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.602+0000 7f6254dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625006a5f0 con 0x7f62500cd790 2023-05-10T04:20:33.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.602+0000 7f6254dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62500ca6b0 con 0x7f62500ca210 2023-05-10T04:20:33.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.602+0000 7f6254dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625006a840 con 0x7f62500b1b80 2023-05-10T04:20:33.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.603+0000 7f6247fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62500ca210 0x7f62500b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.603+0000 7f624ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f625006b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.603+0000 7f624ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f625006b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:34726/0 (socket says 172.21.15.132:34726) 2023-05-10T04:20:33.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.603+0000 7f624ed9d700 1 -- 172.21.15.132:0/2927354695 learned_addr learned my addr 172.21.15.132:0/2927354695 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:33.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.603+0000 7f6247fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f62500ca210 0x7f62500b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:51888/0 (socket says 172.21.15.132:51888) 2023-05-10T04:20:33.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.603+0000 7f624dd9b700 1 -- 172.21.15.132:0/2927354695 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 61340372 0 0) 0x7f625006a5f0 con 0x7f62500cd790 2023-05-10T04:20:33.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.603+0000 7f624dd9b700 1 -- 172.21.15.132:0/2927354695 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f623c0035b0 con 0x7f62500cd790 2023-05-10T04:20:33.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f6247fff700 1 -- 172.21.15.132:0/2927354695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 msgr2=0x7f625006b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:33.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f6247fff700 1 --2- 172.21.15.132:0/2927354695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f625006b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f6247fff700 1 -- 172.21.15.132:0/2927354695 >> v1:172.21.15.154:6789/0 conn(0x7f62500cd790 legacy=0x7f62500cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f6247fff700 1 -- 172.21.15.132:0/2927354695 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625006ab20 con 0x7f62500ca210 2023-05-10T04:20:33.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f624ed9d700 1 --2- 172.21.15.132:0/2927354695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f625006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:33.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f6247fff700 1 --2- 172.21.15.132:0/2927354695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 0x7f62500b1640 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6238009870 tx=0x7f6238009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3796938c1f3fee3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:33.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f624dd9b700 1 -- 172.21.15.132:0/2927354695 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238011830 con 0x7f62500ca210 2023-05-10T04:20:33.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f624dd9b700 1 -- 172.21.15.132:0/2927354695 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6238011990 con 0x7f62500ca210 2023-05-10T04:20:33.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.604+0000 7f624dd9b700 1 -- 172.21.15.132:0/2927354695 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6238011d20 con 0x7f62500ca210 2023-05-10T04:20:33.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.605+0000 7f6254dff700 1 -- 172.21.15.132:0/2927354695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 msgr2=0x7f62500b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.605+0000 7f6254dff700 1 --2- 172.21.15.132:0/2927354695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 0x7f62500b1640 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6238009870 tx=0x7f6238009b80 comp rx=0 tx=0).stop 2023-05-10T04:20:33.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.605+0000 7f6254dff700 1 -- 172.21.15.132:0/2927354695 shutdown_connections 2023-05-10T04:20:33.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.605+0000 7f6254dff700 1 --2- 172.21.15.132:0/2927354695 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f625006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.605+0000 7f6254dff700 1 --2- 172.21.15.132:0/2927354695 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 0x7f62500b1640 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.605+0000 7f6254dff700 1 -- 172.21.15.132:0/2927354695 >> 172.21.15.132:0/2927354695 conn(0x7f625006e980 msgr2=0x7f62500cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:33.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.605+0000 7f6254dff700 1 -- 172.21.15.132:0/2927354695 shutdown_connections 2023-05-10T04:20:33.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.605+0000 7f6254dff700 1 -- 172.21.15.132:0/2927354695 wait complete. 2023-05-10T04:20:33.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.606+0000 7f6254dff700 1 Processor -- start 2023-05-10T04:20:33.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.607+0000 7f6254dff700 1 -- start start 2023-05-10T04:20:33.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.607+0000 7f6254dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f62500b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.607+0000 7f6254dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 0x7f625015d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.607+0000 7f6254dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62500cd790 0x7f62500c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.607+0000 7f6254dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500b59e0 con 0x7f62500cd790 2023-05-10T04:20:33.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.607+0000 7f6254dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625015ee30 con 0x7f62500ca210 2023-05-10T04:20:33.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.607+0000 7f6254dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62500c9430 con 0x7f62500b1b80 2023-05-10T04:20:33.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62500cd790 0x7f62500c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62500cd790 0x7f62500c5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41006/0 (socket says 172.21.15.132:41006) 2023-05-10T04:20:33.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 -- 172.21.15.132:0/2979604294 learned_addr learned my addr 172.21.15.132:0/2979604294 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:33.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f6247fff700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 0x7f625015d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624e59c700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f62500b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 -- 172.21.15.132:0/2979604294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 msgr2=0x7f62500b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f62500b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 -- 172.21.15.132:0/2979604294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 msgr2=0x7f625015d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 0x7f625015d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 -- 172.21.15.132:0/2979604294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6248009b30 con 0x7f62500cd790 2023-05-10T04:20:33.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.608+0000 7f624ed9d700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62500cd790 0x7f62500c5700 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6248009e70 tx=0x7f624800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:33.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.609+0000 7f6246ffd700 1 -- 172.21.15.132:0/2979604294 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248018070 con 0x7f62500cd790 2023-05-10T04:20:33.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.609+0000 7f6246ffd700 1 -- 172.21.15.132:0/2979604294 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624800f040 con 0x7f62500cd790 2023-05-10T04:20:33.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.609+0000 7f6246ffd700 1 -- 172.21.15.132:0/2979604294 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248003c40 con 0x7f62500cd790 2023-05-10T04:20:33.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.609+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62380094a0 con 0x7f62500cd790 2023-05-10T04:20:33.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.609+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625006b0e0 con 0x7f62500cd790 2023-05-10T04:20:33.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.610+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625006ae00 con 0x7f62500cd790 2023-05-10T04:20:33.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.611+0000 7f6246ffd700 1 -- 172.21.15.132:0/2979604294 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f624800c880 con 0x7f62500cd790 2023-05-10T04:20:33.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.611+0000 7f6246ffd700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f623006ace0 0x7f623006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:33.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.612+0000 7f6246ffd700 1 -- 172.21.15.132:0/2979604294 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6248089850 con 0x7f62500cd790 2023-05-10T04:20:33.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.612+0000 7f624e59c700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f623006ace0 0x7f623006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:33.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.612+0000 7f624e59c700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f623006ace0 0x7f623006d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62400011e0 tx=0x7f6240009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:33.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.616+0000 7f6246ffd700 1 -- 172.21.15.132:0/2979604294 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6248054600 con 0x7f62500cd790 2023-05-10T04:20:33.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.815+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62500b2000 con 0x7f62500cd790 2023-05-10T04:20:33.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.815+0000 7f6246ffd700 1 -- 172.21.15.132:0/2979604294 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6248057c20 con 0x7f62500cd790 2023-05-10T04:20:33.817 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f623006ace0 msgr2=0x7f623006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f623006ace0 0x7f623006d190 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f62400011e0 tx=0x7f6240009040 comp rx=0 tx=0).stop 2023-05-10T04:20:33.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62500cd790 msgr2=0x7f62500c5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:33.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62500cd790 0x7f62500c5700 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6248009e70 tx=0x7f624800c3a0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 shutdown_connections 2023-05-10T04:20:33.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f623006ace0 0x7f623006d190 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62500cd790 0x7f62500c5700 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f62500b1b80 0x7f62500b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 --2- 172.21.15.132:0/2979604294 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f62500ca210 0x7f625015d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:33.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 >> 172.21.15.132:0/2979604294 conn(0x7f625006e980 msgr2=0x7f62500cb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:33.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 shutdown_connections 2023-05-10T04:20:33.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:33.818+0000 7f6254dff700 1 -- 172.21.15.132:0/2979604294 wait complete. 2023-05-10T04:20:33.837 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:34.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.025+0000 7f779fbff700 1 Processor -- start 2023-05-10T04:20:34.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.025+0000 7f779fbff700 1 -- start start 2023-05-10T04:20:34.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.026+0000 7f779fbff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f779806b940 0x7f77980cf260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.026+0000 7f779fbff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77980aeed0 con 0x7f779806b4f0 2023-05-10T04:20:34.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.026+0000 7f779fbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77980af1b0 con 0x7f77980d0930 2023-05-10T04:20:34.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.026+0000 7f779fbff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980af490 con 0x7f779806b940 2023-05-10T04:20:34.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.026+0000 7f779d19a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f779806b4f0 0x7f77980ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46924/0 (socket says 172.21.15.132:46924) 2023-05-10T04:20:34.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.026+0000 7f779d19a700 1 -- 172.21.15.132:0/1273774591 learned_addr learned my addr 172.21.15.132:0/1273774591 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:34.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779e19c700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f779806b940 0x7f77980cf260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634855695 0 0) 0x7f77980aeed0 con 0x7f779806b4f0 2023-05-10T04:20:34.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77840035b0 con 0x7f779806b4f0 2023-05-10T04:20:34.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3176186843 0 0) 0x7f77980af1b0 con 0x7f77980d0930 2023-05-10T04:20:34.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77980aeed0 con 0x7f77980d0930 2023-05-10T04:20:34.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4099443100 0 0) 0x7f77840035b0 con 0x7f779806b4f0 2023-05-10T04:20:34.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f779806b940 msgr2=0x7f77980cf260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:34.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f779806b940 0x7f77980cf260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 >> v1:172.21.15.154:6789/0 conn(0x7f77980d0930 legacy=0x7f77980ae3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77980af770 con 0x7f779806b4f0 2023-05-10T04:20:34.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f77880017f0 con 0x7f779806b4f0 2023-05-10T04:20:34.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 >> v1:172.21.15.132:6789/0 conn(0x7f779806b4f0 legacy=0x7f77980ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7784003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f779806b940 0x7f7784004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784004d90 0x7f7784005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980af490 con 0x7f7784003bc0 2023-05-10T04:20:34.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778400bb40 con 0x7f7784004d90 2023-05-10T04:20:34.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.027+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778400bd00 con 0x7f779806b940 2023-05-10T04:20:34.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779d99b700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7784003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779d19a700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f779806b940 0x7f7784004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779e19c700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784004d90 0x7f7784005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779d99b700 1 -- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f779806b940 msgr2=0x7f7784004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:34.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779d99b700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f779806b940 0x7f7784004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779d99b700 1 -- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784004d90 msgr2=0x7f7784005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:34.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779d99b700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784004d90 0x7f7784005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779d99b700 1 -- 172.21.15.132:0/1273774591 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77840035b0 con 0x7f7784003bc0 2023-05-10T04:20:34.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779e19c700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7784004d90 0x7f7784005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:34.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779d99b700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7784003fb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7794001980 tx=0x7f7784005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bc5f11951c3b44 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794001470 con 0x7f7784003bc0 2023-05-10T04:20:34.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77940052d0 con 0x7f7784003bc0 2023-05-10T04:20:34.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.028+0000 7f779c999700 1 -- 172.21.15.132:0/1273774591 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794003680 con 0x7f7784003bc0 2023-05-10T04:20:34.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.029+0000 7f779fbff700 1 -- 172.21.15.132:0/1273774591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 msgr2=0x7f7784003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.029+0000 7f779fbff700 1 --2- 172.21.15.132:0/1273774591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7784003fb0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7794001980 tx=0x7f7784005880 comp rx=0 tx=0).stop 2023-05-10T04:20:34.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.029+0000 7f779e19c700 1 -- 172.21.15.132:0/1273774591 reap_dead start 2023-05-10T04:20:34.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.029+0000 7f779fbff700 1 -- 172.21.15.132:0/1273774591 shutdown_connections 2023-05-10T04:20:34.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.029+0000 7f779fbff700 1 -- 172.21.15.132:0/1273774591 >> 172.21.15.132:0/1273774591 conn(0x7f779809a0a0 msgr2=0x7f77980d0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:34.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.029+0000 7f779fbff700 1 -- 172.21.15.132:0/1273774591 shutdown_connections 2023-05-10T04:20:34.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.029+0000 7f779fbff700 1 -- 172.21.15.132:0/1273774591 wait complete. 2023-05-10T04:20:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.031+0000 7f779fbff700 1 Processor -- start 2023-05-10T04:20:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.031+0000 7f779fbff700 1 -- start start 2023-05-10T04:20:34.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779fbff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7798153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779fbff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77980b22b0 0x7f77981f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779fbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77980b54b0 0x7f77980b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779fbff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980b0540 con 0x7f7784003bc0 2023-05-10T04:20:34.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779fbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77980c4f00 con 0x7f77980b54b0 2023-05-10T04:20:34.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779fbff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77980b5e60 con 0x7f77980b22b0 2023-05-10T04:20:34.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d99b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7798153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d99b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7798153b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41028/0 (socket says 172.21.15.132:41028) 2023-05-10T04:20:34.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d99b700 1 -- 172.21.15.132:0/936203609 learned_addr learned my addr 172.21.15.132:0/936203609 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:34.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d19a700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77980b22b0 0x7f77981f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779e19c700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77980b54b0 0x7f77980b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d99b700 1 -- 172.21.15.132:0/936203609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77980b22b0 msgr2=0x7f77981f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d99b700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77980b22b0 0x7f77981f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d99b700 1 -- 172.21.15.132:0/936203609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77980b54b0 msgr2=0x7f77980b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d99b700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77980b54b0 0x7f77980b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.032+0000 7f779d99b700 1 -- 172.21.15.132:0/936203609 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779806bdc0 con 0x7f7784003bc0 2023-05-10T04:20:34.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.033+0000 7f779d99b700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7798153b90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f778400bb10 tx=0x7f7794001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.033+0000 7f778e7fc700 1 -- 172.21.15.132:0/936203609 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794001110 con 0x7f7784003bc0 2023-05-10T04:20:34.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.033+0000 7f778e7fc700 1 -- 172.21.15.132:0/936203609 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7794001410 con 0x7f7784003bc0 2023-05-10T04:20:34.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.033+0000 7f778e7fc700 1 -- 172.21.15.132:0/936203609 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7794006ea0 con 0x7f7784003bc0 2023-05-10T04:20:34.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.033+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77980b0060 con 0x7f7784003bc0 2023-05-10T04:20:34.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.033+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77980aeab0 con 0x7f7784003bc0 2023-05-10T04:20:34.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.034+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77981540d0 con 0x7f7784003bc0 2023-05-10T04:20:34.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.035+0000 7f778e7fc700 1 -- 172.21.15.132:0/936203609 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7794007260 con 0x7f7784003bc0 2023-05-10T04:20:34.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.036+0000 7f778e7fc700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f777c06ace0 0x7f777c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.036+0000 7f778e7fc700 1 -- 172.21.15.132:0/936203609 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f779408a5e0 con 0x7f7784003bc0 2023-05-10T04:20:34.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.036+0000 7f779d19a700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f777c06ace0 0x7f777c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.037+0000 7f779d19a700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f777c06ace0 0x7f777c06d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77980cf460 tx=0x7f7788009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.040+0000 7f778e7fc700 1 -- 172.21.15.132:0/936203609 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7794055440 con 0x7f7784003bc0 2023-05-10T04:20:34.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.239+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f77981f5ff0 con 0x7f7784003bc0 2023-05-10T04:20:34.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.239+0000 7f778e7fc700 1 -- 172.21.15.132:0/936203609 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7794058a60 con 0x7f7784003bc0 2023-05-10T04:20:34.242 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f777c06ace0 msgr2=0x7f777c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f777c06ace0 0x7f777c06d190 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f77980cf460 tx=0x7f7788009040 comp rx=0 tx=0).stop 2023-05-10T04:20:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 msgr2=0x7f7798153b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7798153b90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f778400bb10 tx=0x7f7794001310 comp rx=0 tx=0).stop 2023-05-10T04:20:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 shutdown_connections 2023-05-10T04:20:34.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f777c06ace0 0x7f777c06d190 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f77980b54b0 0x7f77980b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7784003bc0 0x7f7798153b90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 --2- 172.21.15.132:0/936203609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f77980b22b0 0x7f77981f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 >> 172.21.15.132:0/936203609 conn(0x7f779809a0a0 msgr2=0x7f77980cb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:34.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 shutdown_connections 2023-05-10T04:20:34.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.242+0000 7f779fbff700 1 -- 172.21.15.132:0/936203609 wait complete. 2023-05-10T04:20:34.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:34.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.447+0000 7f654a3ff700 1 Processor -- start 2023-05-10T04:20:34.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.448+0000 7f654a3ff700 1 -- start start 2023-05-10T04:20:34.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f654a3ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65440b87a0 0x7f65440cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f654a3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6544160d40 0x7f65440d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f654a3ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65440cdc60 con 0x7f65441601e0 2023-05-10T04:20:34.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f654a3ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65440d02d0 con 0x7f65440b87a0 2023-05-10T04:20:34.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f654a3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65440d0cb0 con 0x7f6544160d40 2023-05-10T04:20:34.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f6543fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65440b87a0 0x7f65440cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f653bfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f65441601e0 0x7f6544160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46928/0 (socket says 172.21.15.132:46928) 2023-05-10T04:20:34.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f6543fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f65440b87a0 0x7f65440cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41044/0 (socket says 172.21.15.132:41044) 2023-05-10T04:20:34.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f653bfff700 1 -- 172.21.15.132:0/1954549550 learned_addr learned my addr 172.21.15.132:0/1954549550 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:34.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f654899c700 1 --2- 172.21.15.132:0/1954549550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6544160d40 0x7f65440d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f6543fff700 1 -- 172.21.15.132:0/1954549550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6544160d40 msgr2=0x7f65440d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:34.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f6543fff700 1 --2- 172.21.15.132:0/1954549550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6544160d40 0x7f65440d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f6543fff700 1 -- 172.21.15.132:0/1954549550 >> v1:172.21.15.132:6789/0 conn(0x7f65441601e0 legacy=0x7f6544160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.449+0000 7f6543fff700 1 -- 172.21.15.132:0/1954549550 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440cd6a0 con 0x7f65440b87a0 2023-05-10T04:20:34.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.450+0000 7f6543fff700 1 --2- 172.21.15.132:0/1954549550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f65440cfbf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6534009840 tx=0x7f6534009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985ce4ba93e7f53d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.450+0000 7f65437fe700 1 -- 172.21.15.132:0/1954549550 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534011830 con 0x7f65440b87a0 2023-05-10T04:20:34.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.450+0000 7f65437fe700 1 -- 172.21.15.132:0/1954549550 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6534011990 con 0x7f65440b87a0 2023-05-10T04:20:34.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.450+0000 7f65437fe700 1 -- 172.21.15.132:0/1954549550 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534011d20 con 0x7f65440b87a0 2023-05-10T04:20:34.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.450+0000 7f654a3ff700 1 -- 172.21.15.132:0/1954549550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 msgr2=0x7f65440cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.450+0000 7f654a3ff700 1 --2- 172.21.15.132:0/1954549550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f65440cfbf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f6534009840 tx=0x7f6534009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:34.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.451+0000 7f654a3ff700 1 -- 172.21.15.132:0/1954549550 shutdown_connections 2023-05-10T04:20:34.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.451+0000 7f654a3ff700 1 --2- 172.21.15.132:0/1954549550 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6544160d40 0x7f65440d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.451+0000 7f654a3ff700 1 --2- 172.21.15.132:0/1954549550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f65440cfbf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.451+0000 7f654a3ff700 1 -- 172.21.15.132:0/1954549550 >> 172.21.15.132:0/1954549550 conn(0x7f6544071b10 msgr2=0x7f6544071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:34.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.451+0000 7f654a3ff700 1 -- 172.21.15.132:0/1954549550 shutdown_connections 2023-05-10T04:20:34.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.451+0000 7f654a3ff700 1 -- 172.21.15.132:0/1954549550 wait complete. 2023-05-10T04:20:34.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.452+0000 7f654a3ff700 1 Processor -- start 2023-05-10T04:20:34.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.452+0000 7f654a3ff700 1 -- start start 2023-05-10T04:20:34.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.453+0000 7f654a3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f654415cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.453+0000 7f654a3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65441601e0 0x7f65440ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.453+0000 7f654a3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6544160d40 0x7f6544150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.453+0000 7f654a3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654415dbd0 con 0x7f65440b87a0 2023-05-10T04:20:34.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.453+0000 7f654a3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6544150eb0 con 0x7f6544160d40 2023-05-10T04:20:34.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.453+0000 7f654a3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65440c9f80 con 0x7f65441601e0 2023-05-10T04:20:34.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.453+0000 7f6543fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f654415cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f6543fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f654415cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41050/0 (socket says 172.21.15.132:41050) 2023-05-10T04:20:34.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f6543fff700 1 -- 172.21.15.132:0/4214858775 learned_addr learned my addr 172.21.15.132:0/4214858775 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:34.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f653bfff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65441601e0 0x7f65440ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f654899c700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6544160d40 0x7f6544150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f6543fff700 1 -- 172.21.15.132:0/4214858775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65441601e0 msgr2=0x7f65440ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f6543fff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65441601e0 0x7f65440ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f6543fff700 1 -- 172.21.15.132:0/4214858775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6544160d40 msgr2=0x7f6544150970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f6543fff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6544160d40 0x7f6544150970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f6543fff700 1 -- 172.21.15.132:0/4214858775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65340094a0 con 0x7f65440b87a0 2023-05-10T04:20:34.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f6543fff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f654415cce0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6534009b90 tx=0x7f6534004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f65417fa700 1 -- 172.21.15.132:0/4214858775 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340036a0 con 0x7f65440b87a0 2023-05-10T04:20:34.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f65417fa700 1 -- 172.21.15.132:0/4214858775 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f653401f070 con 0x7f65440b87a0 2023-05-10T04:20:34.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f65417fa700 1 -- 172.21.15.132:0/4214858775 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6534003a40 con 0x7f65440b87a0 2023-05-10T04:20:34.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.454+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65440d1640 con 0x7f65440b87a0 2023-05-10T04:20:34.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.455+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65440cd980 con 0x7f65440b87a0 2023-05-10T04:20:34.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.455+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65440d17d0 con 0x7f65440b87a0 2023-05-10T04:20:34.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.456+0000 7f65417fa700 1 -- 172.21.15.132:0/4214858775 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6534003ba0 con 0x7f65440b87a0 2023-05-10T04:20:34.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.457+0000 7f65417fa700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f652406ace0 0x7f652406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.457+0000 7f65417fa700 1 -- 172.21.15.132:0/4214858775 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6534021070 con 0x7f65440b87a0 2023-05-10T04:20:34.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.458+0000 7f653bfff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f652406ace0 0x7f652406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.458+0000 7f653bfff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f652406ace0 0x7f652406d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f65440c9d10 tx=0x7f652c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.461+0000 7f65417fa700 1 -- 172.21.15.132:0/4214858775 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f65340bd2d0 con 0x7f65440b87a0 2023-05-10T04:20:34.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.658+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6544074430 con 0x7f65440b87a0 2023-05-10T04:20:34.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.658+0000 7f65417fa700 1 -- 172.21.15.132:0/4214858775 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6534055fa0 con 0x7f65440b87a0 2023-05-10T04:20:34.661 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:34.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.660+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f652406ace0 msgr2=0x7f652406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.660+0000 7f654a3ff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f652406ace0 0x7f652406d190 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f65440c9d10 tx=0x7f652c009040 comp rx=0 tx=0).stop 2023-05-10T04:20:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.660+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 msgr2=0x7f654415cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.660+0000 7f654a3ff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f654415cce0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6534009b90 tx=0x7f6534004750 comp rx=0 tx=0).stop 2023-05-10T04:20:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.661+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 shutdown_connections 2023-05-10T04:20:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.661+0000 7f654a3ff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f652406ace0 0x7f652406d190 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.661+0000 7f654a3ff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6544160d40 0x7f6544150970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.661+0000 7f654a3ff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65440b87a0 0x7f654415cce0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.661+0000 7f654a3ff700 1 --2- 172.21.15.132:0/4214858775 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f65441601e0 0x7f65440ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.661+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 >> 172.21.15.132:0/4214858775 conn(0x7f6544071b10 msgr2=0x7f6544071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.661+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 shutdown_connections 2023-05-10T04:20:34.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.661+0000 7f654a3ff700 1 -- 172.21.15.132:0/4214858775 wait complete. 2023-05-10T04:20:34.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:34.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.867+0000 7f44b91ff700 1 Processor -- start 2023-05-10T04:20:34.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.867+0000 7f44b91ff700 1 -- start start 2023-05-10T04:20:34.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.868+0000 7f44b91ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f44b415c590 0x7f44b4160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.868+0000 7f44b91ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cf010 0x7f44b40cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b91ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44b40cfd80 0x7f44b40d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b91ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40cd520 con 0x7f44b40cfd80 2023-05-10T04:20:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b91ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44b40d2640 con 0x7f44b415c590 2023-05-10T04:20:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b91ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41610d0 con 0x7f44b40cf010 2023-05-10T04:20:34.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b359e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44b40cfd80 0x7f44b40d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b359e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44b40cfd80 0x7f44b40d0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41058/0 (socket says 172.21.15.132:41058) 2023-05-10T04:20:34.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b359e700 1 -- 172.21.15.132:0/408141112 learned_addr learned my addr 172.21.15.132:0/408141112 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b2d9d700 1 --2- 172.21.15.132:0/408141112 >> v2:172.21.15.154:3300/0 conn(0x7f44b415c590 0x7f44b4160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44abfff700 1 --2- 172.21.15.132:0/408141112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cf010 0x7f44b40cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b359e700 1 -- 172.21.15.132:0/408141112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cf010 msgr2=0x7f44b40cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b359e700 1 --2- 172.21.15.132:0/408141112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cf010 0x7f44b40cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b359e700 1 -- 172.21.15.132:0/408141112 >> v2:172.21.15.154:3300/0 conn(0x7f44b415c590 msgr2=0x7f44b4160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b359e700 1 --2- 172.21.15.132:0/408141112 >> v2:172.21.15.154:3300/0 conn(0x7f44b415c590 0x7f44b4160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b359e700 1 -- 172.21.15.132:0/408141112 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b40d0200 con 0x7f44b40cfd80 2023-05-10T04:20:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44b2d9d700 1 --2- 172.21.15.132:0/408141112 >> v2:172.21.15.154:3300/0 conn(0x7f44b415c590 0x7f44b4160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.869+0000 7f44abfff700 1 --2- 172.21.15.132:0/408141112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cf010 0x7f44b40cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b359e700 1 --2- 172.21.15.132:0/408141112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cfd80 0x7f44b40d0aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f44b40d0a50 tx=0x7f44ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0edd4efd8b9200d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b259c700 1 -- 172.21.15.132:0/408141112 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00e070 con 0x7f44b40cfd80 2023-05-10T04:20:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b259c700 1 -- 172.21.15.132:0/408141112 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ac00b9c0 con 0x7f44b40cfd80 2023-05-10T04:20:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b259c700 1 -- 172.21.15.132:0/408141112 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ac00bd70 con 0x7f44b40cfd80 2023-05-10T04:20:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b91ff700 1 -- 172.21.15.132:0/408141112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cfd80 msgr2=0x7f44b40d0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b91ff700 1 --2- 172.21.15.132:0/408141112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cfd80 0x7f44b40d0aa0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f44b40d0a50 tx=0x7f44ac00b330 comp rx=0 tx=0).stop 2023-05-10T04:20:34.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b91ff700 1 -- 172.21.15.132:0/408141112 shutdown_connections 2023-05-10T04:20:34.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b91ff700 1 --2- 172.21.15.132:0/408141112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cfd80 0x7f44b40d0aa0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b91ff700 1 --2- 172.21.15.132:0/408141112 >> v2:172.21.15.154:3300/0 conn(0x7f44b415c590 0x7f44b4160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b91ff700 1 --2- 172.21.15.132:0/408141112 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cf010 0x7f44b40cf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b91ff700 1 -- 172.21.15.132:0/408141112 >> 172.21.15.132:0/408141112 conn(0x7f44b4071b10 msgr2=0x7f44b4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:34.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.870+0000 7f44b91ff700 1 -- 172.21.15.132:0/408141112 shutdown_connections 2023-05-10T04:20:34.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.871+0000 7f44b91ff700 1 -- 172.21.15.132:0/408141112 wait complete. 2023-05-10T04:20:34.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.872+0000 7f44b91ff700 1 Processor -- start 2023-05-10T04:20:34.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.872+0000 7f44b91ff700 1 -- start start 2023-05-10T04:20:34.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b91ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cf010 0x7f44b4154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b91ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cfd80 0x7f44b41f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b91ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b415c590 0x7f44b40b7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b91ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b41f65d0 con 0x7f44b40cf010 2023-05-10T04:20:34.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b91ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415ecc0 con 0x7f44b415c590 2023-05-10T04:20:34.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b91ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44b415efa0 con 0x7f44b40cfd80 2023-05-10T04:20:34.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b2d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cf010 0x7f44b4154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b2d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cf010 0x7f44b4154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41074/0 (socket says 172.21.15.132:41074) 2023-05-10T04:20:34.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.873+0000 7f44b2d9d700 1 -- 172.21.15.132:0/1884945016 learned_addr learned my addr 172.21.15.132:0/1884945016 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:34.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44abfff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cfd80 0x7f44b41f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b359e700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b415c590 0x7f44b40b7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b2d9d700 1 -- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cfd80 msgr2=0x7f44b41f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b2d9d700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cfd80 0x7f44b41f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b2d9d700 1 -- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b415c590 msgr2=0x7f44b40b7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:34.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b2d9d700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b415c590 0x7f44b40b7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:34.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b2d9d700 1 -- 172.21.15.132:0/1884945016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac009b30 con 0x7f44b40cf010 2023-05-10T04:20:34.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b359e700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b415c590 0x7f44b40b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:34.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b2d9d700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cf010 0x7f44b4154630 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f44a400c7f0 tx=0x7f44a400cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44ab7fe700 1 -- 172.21.15.132:0/1884945016 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4011800 con 0x7f44b40cf010 2023-05-10T04:20:34.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44ab7fe700 1 -- 172.21.15.132:0/1884945016 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a4011960 con 0x7f44b40cf010 2023-05-10T04:20:34.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44b40cf560 con 0x7f44b40cf010 2023-05-10T04:20:34.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.874+0000 7f44ab7fe700 1 -- 172.21.15.132:0/1884945016 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a4011d10 con 0x7f44b40cf010 2023-05-10T04:20:34.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.875+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44b40b23c0 con 0x7f44b40cf010 2023-05-10T04:20:34.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.876+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44b40cd770 con 0x7f44b40cf010 2023-05-10T04:20:34.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.876+0000 7f44ab7fe700 1 -- 172.21.15.132:0/1884945016 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f44a4018360 con 0x7f44b40cf010 2023-05-10T04:20:34.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.877+0000 7f44ab7fe700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f449406ace0 0x7f449406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:34.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.877+0000 7f44ab7fe700 1 -- 172.21.15.132:0/1884945016 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f44a4089620 con 0x7f44b40cf010 2023-05-10T04:20:34.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.878+0000 7f44abfff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f449406ace0 0x7f449406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:34.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.878+0000 7f44abfff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f449406ace0 0x7f449406d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f44b40b1280 tx=0x7f449c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:34.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:34.881+0000 7f44ab7fe700 1 -- 172.21.15.132:0/1884945016 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f44a4057f00 con 0x7f44b40cf010 2023-05-10T04:20:35.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.077+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f44b415fcb0 con 0x7f44b40cf010 2023-05-10T04:20:35.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.078+0000 7f44ab7fe700 1 -- 172.21.15.132:0/1884945016 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f44a4057a90 con 0x7f44b40cf010 2023-05-10T04:20:35.080 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:35.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f449406ace0 msgr2=0x7f449406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f449406ace0 0x7f449406d190 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f44b40b1280 tx=0x7f449c008040 comp rx=0 tx=0).stop 2023-05-10T04:20:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cf010 msgr2=0x7f44b4154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cf010 0x7f44b4154630 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f44a400c7f0 tx=0x7f44a400cbb0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 shutdown_connections 2023-05-10T04:20:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f449406ace0 0x7f449406d190 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f44b415c590 0x7f44b40b7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44b40cf010 0x7f44b4154630 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 --2- 172.21.15.132:0/1884945016 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f44b40cfd80 0x7f44b41f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 >> 172.21.15.132:0/1884945016 conn(0x7f44b4071b10 msgr2=0x7f44b4160180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:35.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 shutdown_connections 2023-05-10T04:20:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.080+0000 7f44b91ff700 1 -- 172.21.15.132:0/1884945016 wait complete. 2023-05-10T04:20:35.100 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.284+0000 7f1707fff700 1 Processor -- start 2023-05-10T04:20:35.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.284+0000 7f1707fff700 1 -- start start 2023-05-10T04:20:35.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.285+0000 7f1707fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f170006aaf0 0x7f1700070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.285+0000 7f1707fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1700071030 0x7f170006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.285+0000 7f1707fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17000cb280 con 0x7f170015a5a0 2023-05-10T04:20:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.285+0000 7f1707fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f170015a970 con 0x7f1700071030 2023-05-10T04:20:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.285+0000 7f1707fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1700071700 con 0x7f170006aaf0 2023-05-10T04:20:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.285+0000 7f170659c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1700071030 0x7f170006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.285+0000 7f170659c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1700071030 0x7f170006d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41086/0 (socket says 172.21.15.132:41086) 2023-05-10T04:20:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.285+0000 7f170659c700 1 -- 172.21.15.132:0/1986889673 learned_addr learned my addr 172.21.15.132:0/1986889673 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:35.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f170559a700 1 --2- 172.21.15.132:0/1986889673 >> v2:172.21.15.154:3300/0 conn(0x7f170006aaf0 0x7f1700070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f170659c700 1 -- 172.21.15.132:0/1986889673 >> v2:172.21.15.154:3300/0 conn(0x7f170006aaf0 msgr2=0x7f1700070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f170659c700 1 --2- 172.21.15.132:0/1986889673 >> v2:172.21.15.154:3300/0 conn(0x7f170006aaf0 0x7f1700070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f170659c700 1 -- 172.21.15.132:0/1986889673 >> v1:172.21.15.154:6789/0 conn(0x7f170015a5a0 legacy=0x7f170006a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f170659c700 1 -- 172.21.15.132:0/1986889673 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17000719e0 con 0x7f1700071030 2023-05-10T04:20:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f170559a700 1 --2- 172.21.15.132:0/1986889673 >> v2:172.21.15.154:3300/0 conn(0x7f170006aaf0 0x7f1700070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f170659c700 1 --2- 172.21.15.132:0/1986889673 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170006d1a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f170006f0c0 tx=0x7f16f800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8777a8e46406160d server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f1704d99700 1 -- 172.21.15.132:0/1986889673 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800e070 con 0x7f1700071030 2023-05-10T04:20:35.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f1704d99700 1 -- 172.21.15.132:0/1986889673 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f800b9c0 con 0x7f1700071030 2023-05-10T04:20:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.286+0000 7f1704d99700 1 -- 172.21.15.132:0/1986889673 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f800bd70 con 0x7f1700071030 2023-05-10T04:20:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.287+0000 7f1707fff700 1 -- 172.21.15.132:0/1986889673 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 msgr2=0x7f170006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.287+0000 7f1707fff700 1 --2- 172.21.15.132:0/1986889673 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170006d1a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f170006f0c0 tx=0x7f16f800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.287+0000 7f1707fff700 1 -- 172.21.15.132:0/1986889673 shutdown_connections 2023-05-10T04:20:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.287+0000 7f1707fff700 1 --2- 172.21.15.132:0/1986889673 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170006d1a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.287+0000 7f1707fff700 1 --2- 172.21.15.132:0/1986889673 >> v2:172.21.15.154:3300/0 conn(0x7f170006aaf0 0x7f1700070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.287+0000 7f1707fff700 1 -- 172.21.15.132:0/1986889673 >> 172.21.15.132:0/1986889673 conn(0x7f17000cf720 msgr2=0x7f17000cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:35.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.287+0000 7f1707fff700 1 -- 172.21.15.132:0/1986889673 shutdown_connections 2023-05-10T04:20:35.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.287+0000 7f1707fff700 1 -- 172.21.15.132:0/1986889673 wait complete. 2023-05-10T04:20:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.289+0000 7f1707fff700 1 Processor -- start 2023-05-10T04:20:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.289+0000 7f1707fff700 1 -- start start 2023-05-10T04:20:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f1707fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f170006aaf0 0x7f1700150b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f1707fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170015d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f1707fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015a5a0 0x7f1700158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f1707fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170015b500 con 0x7f1700071030 2023-05-10T04:20:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f1707fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f170015bd60 con 0x7f170015a5a0 2023-05-10T04:20:35.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f1707fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1700151600 con 0x7f170006aaf0 2023-05-10T04:20:35.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170559a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170015d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170559a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170015d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41094/0 (socket says 172.21.15.132:41094) 2023-05-10T04:20:35.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170559a700 1 -- 172.21.15.132:0/2050148313 learned_addr learned my addr 172.21.15.132:0/2050148313 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:35.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f1705d9b700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f170006aaf0 0x7f1700150b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170659c700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015a5a0 0x7f1700158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170559a700 1 -- 172.21.15.132:0/2050148313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f170006aaf0 msgr2=0x7f1700150b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170559a700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f170006aaf0 0x7f1700150b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170559a700 1 -- 172.21.15.132:0/2050148313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015a5a0 msgr2=0x7f1700158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170559a700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015a5a0 0x7f1700158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.290+0000 7f170559a700 1 -- 172.21.15.132:0/2050148313 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16f8009b30 con 0x7f1700071030 2023-05-10T04:20:35.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.291+0000 7f170559a700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170015d1e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f16f000e810 tx=0x7f16f000eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.291+0000 7f16f67fc700 1 -- 172.21.15.132:0/2050148313 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f000c070 con 0x7f1700071030 2023-05-10T04:20:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.291+0000 7f16f67fc700 1 -- 172.21.15.132:0/2050148313 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16f0005c20 con 0x7f1700071030 2023-05-10T04:20:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.291+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f170006c9a0 con 0x7f1700071030 2023-05-10T04:20:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.291+0000 7f16f67fc700 1 -- 172.21.15.132:0/2050148313 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16f0006030 con 0x7f1700071030 2023-05-10T04:20:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.291+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f170006c6c0 con 0x7f1700071030 2023-05-10T04:20:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.292+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f170006cc80 con 0x7f1700071030 2023-05-10T04:20:35.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.293+0000 7f16f67fc700 1 -- 172.21.15.132:0/2050148313 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f16f0006190 con 0x7f1700071030 2023-05-10T04:20:35.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.294+0000 7f16f67fc700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f16e406ace0 0x7f16e406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.294+0000 7f16f67fc700 1 -- 172.21.15.132:0/2050148313 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f16f0089460 con 0x7f1700071030 2023-05-10T04:20:35.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.294+0000 7f1705d9b700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f16e406ace0 0x7f16e406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.295+0000 7f1705d9b700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f16e406ace0 0x7f16e406d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f16fc007fd0 tx=0x7f16fc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:35.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.298+0000 7f16f67fc700 1 -- 172.21.15.132:0/2050148313 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f16f0054210 con 0x7f1700071030 2023-05-10T04:20:35.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.497+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1700074430 con 0x7f1700071030 2023-05-10T04:20:35.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.498+0000 7f16f67fc700 1 -- 172.21.15.132:0/2050148313 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f16f0057830 con 0x7f1700071030 2023-05-10T04:20:35.500 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:35.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f16e406ace0 msgr2=0x7f16e406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f16e406ace0 0x7f16e406d190 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f16fc007fd0 tx=0x7f16fc009040 comp rx=0 tx=0).stop 2023-05-10T04:20:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 msgr2=0x7f170015d1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170015d1e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f16f000e810 tx=0x7f16f000eb20 comp rx=0 tx=0).stop 2023-05-10T04:20:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 shutdown_connections 2023-05-10T04:20:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f16e406ace0 0x7f16e406d190 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f170015a5a0 0x7f1700158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f170006aaf0 0x7f1700150b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 --2- 172.21.15.132:0/2050148313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1700071030 0x7f170015d1e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 >> 172.21.15.132:0/2050148313 conn(0x7f17000cf720 msgr2=0x7f170006d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:35.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 shutdown_connections 2023-05-10T04:20:35.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.500+0000 7f1707fff700 1 -- 172.21.15.132:0/2050148313 wait complete. 2023-05-10T04:20:35.520 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-10T04:20:35.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.702+0000 7f4c25bff700 1 Processor -- start 2023-05-10T04:20:35.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.702+0000 7f4c25bff700 1 -- start start 2023-05-10T04:20:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.703+0000 7f4c25bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c200b87a0 0x7f4c200cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.703+0000 7f4c25bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f4c20160d40 0x7f4c200d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.703+0000 7f4c25bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c200cdc60 con 0x7f4c201601e0 2023-05-10T04:20:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.703+0000 7f4c25bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c200d02d0 con 0x7f4c20160d40 2023-05-10T04:20:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.703+0000 7f4c25bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200d0cb0 con 0x7f4c200b87a0 2023-05-10T04:20:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.703+0000 7f4c1effd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4c201601e0 0x7f4c20160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46934/0 (socket says 172.21.15.132:46934) 2023-05-10T04:20:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.703+0000 7f4c1effd700 1 -- 172.21.15.132:0/4281608735 learned_addr learned my addr 172.21.15.132:0/4281608735 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1f7fe700 1 --2- 172.21.15.132:0/4281608735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c200b87a0 0x7f4c200cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1ffff700 1 --2- 172.21.15.132:0/4281608735 >> v2:172.21.15.154:3300/0 conn(0x7f4c20160d40 0x7f4c200d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1e7fc700 1 -- 172.21.15.132:0/4281608735 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2363437796 0 0) 0x7f4c200cdc60 con 0x7f4c201601e0 2023-05-10T04:20:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1e7fc700 1 -- 172.21.15.132:0/4281608735 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c080035b0 con 0x7f4c201601e0 2023-05-10T04:20:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1f7fe700 1 -- 172.21.15.132:0/4281608735 >> v2:172.21.15.154:3300/0 conn(0x7f4c20160d40 msgr2=0x7f4c200d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1f7fe700 1 --2- 172.21.15.132:0/4281608735 >> v2:172.21.15.154:3300/0 conn(0x7f4c20160d40 0x7f4c200d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1f7fe700 1 -- 172.21.15.132:0/4281608735 >> v1:172.21.15.132:6789/0 conn(0x7f4c201601e0 legacy=0x7f4c20160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1f7fe700 1 -- 172.21.15.132:0/4281608735 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c200cd6a0 con 0x7f4c200b87a0 2023-05-10T04:20:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.704+0000 7f4c1f7fe700 1 --2- 172.21.15.132:0/4281608735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c200b87a0 0x7f4c200cfbf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009840 tx=0x7f4c10009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f54cbc842caa198e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:35.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c1e7fc700 1 -- 172.21.15.132:0/4281608735 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10011830 con 0x7f4c200b87a0 2023-05-10T04:20:35.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c1e7fc700 1 -- 172.21.15.132:0/4281608735 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10011990 con 0x7f4c200b87a0 2023-05-10T04:20:35.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c1e7fc700 1 -- 172.21.15.132:0/4281608735 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10011d00 con 0x7f4c200b87a0 2023-05-10T04:20:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c25bff700 1 -- 172.21.15.132:0/4281608735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c200b87a0 msgr2=0x7f4c200cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c25bff700 1 --2- 172.21.15.132:0/4281608735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c200b87a0 0x7f4c200cfbf0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009840 tx=0x7f4c10009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c25bff700 1 -- 172.21.15.132:0/4281608735 shutdown_connections 2023-05-10T04:20:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c25bff700 1 --2- 172.21.15.132:0/4281608735 >> v2:172.21.15.154:3300/0 conn(0x7f4c20160d40 0x7f4c200d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c25bff700 1 --2- 172.21.15.132:0/4281608735 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c200b87a0 0x7f4c200cfbf0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c25bff700 1 -- 172.21.15.132:0/4281608735 >> 172.21.15.132:0/4281608735 conn(0x7f4c20071b10 msgr2=0x7f4c20071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c25bff700 1 -- 172.21.15.132:0/4281608735 shutdown_connections 2023-05-10T04:20:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.705+0000 7f4c25bff700 1 -- 172.21.15.132:0/4281608735 wait complete. 2023-05-10T04:20:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.707+0000 7f4c25bff700 1 Processor -- start 2023-05-10T04:20:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.707+0000 7f4c25bff700 1 -- start start 2023-05-10T04:20:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c25bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c200b87a0 0x7f4c2015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c25bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c201601e0 0x7f4c20159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c25bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c20160d40 0x7f4c20159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c25bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200c8600 con 0x7f4c200b87a0 2023-05-10T04:20:35.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c25bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2015d940 con 0x7f4c201601e0 2023-05-10T04:20:35.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c25bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2015dc20 con 0x7f4c20160d40 2023-05-10T04:20:35.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c1f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c200b87a0 0x7f4c2015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c1f7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c200b87a0 0x7f4c2015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41106/0 (socket says 172.21.15.132:41106) 2023-05-10T04:20:35.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c1f7fe700 1 -- 172.21.15.132:0/3030282169 learned_addr learned my addr 172.21.15.132:0/3030282169 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:35.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c1ffff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c20160d40 0x7f4c20159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.708+0000 7f4c1effd700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c201601e0 0x7f4c20159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c1f7fe700 1 -- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c20160d40 msgr2=0x7f4c20159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c1f7fe700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c20160d40 0x7f4c20159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c1f7fe700 1 -- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c201601e0 msgr2=0x7f4c20159830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c1f7fe700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c201601e0 0x7f4c20159830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c1f7fe700 1 -- 172.21.15.132:0/3030282169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c100094a0 con 0x7f4c200b87a0 2023-05-10T04:20:35.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c1ffff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c20160d40 0x7f4c20159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:35.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c1f7fe700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c200b87a0 0x7f4c2015d2b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009b90 tx=0x7f4c10004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:35.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c07fff700 1 -- 172.21.15.132:0/3030282169 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100036a0 con 0x7f4c200b87a0 2023-05-10T04:20:35.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c07fff700 1 -- 172.21.15.132:0/3030282169 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1001f070 con 0x7f4c200b87a0 2023-05-10T04:20:35.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c200d1640 con 0x7f4c200b87a0 2023-05-10T04:20:35.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c07fff700 1 -- 172.21.15.132:0/3030282169 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10003a40 con 0x7f4c200b87a0 2023-05-10T04:20:35.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.709+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c200cd980 con 0x7f4c200b87a0 2023-05-10T04:20:35.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.710+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c200d17d0 con 0x7f4c200b87a0 2023-05-10T04:20:35.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.711+0000 7f4c07fff700 1 -- 172.21.15.132:0/3030282169 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c10003ba0 con 0x7f4c200b87a0 2023-05-10T04:20:35.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.712+0000 7f4c07fff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c0c06ace0 0x7f4c0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:35.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.712+0000 7f4c07fff700 1 -- 172.21.15.132:0/3030282169 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4c10021070 con 0x7f4c200b87a0 2023-05-10T04:20:35.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.712+0000 7f4c1effd700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c0c06ace0 0x7f4c0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:35.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.713+0000 7f4c1effd700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c0c06ace0 0x7f4c0c06d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4c200cfe00 tx=0x7f4c14009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:35.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.717+0000 7f4c07fff700 1 -- 172.21.15.132:0/3030282169 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f4c10055e00 con 0x7f4c200b87a0 2023-05-10T04:20:35.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.929+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4c20074430 con 0x7f4c200b87a0 2023-05-10T04:20:35.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.929+0000 7f4c07fff700 1 -- 172.21.15.132:0/3030282169 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4c10015080 con 0x7f4c200b87a0 2023-05-10T04:20:35.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c0c06ace0 msgr2=0x7f4c0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c0c06ace0 0x7f4c0c06d190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4c200cfe00 tx=0x7f4c14009040 comp rx=0 tx=0).stop 2023-05-10T04:20:35.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c200b87a0 msgr2=0x7f4c2015d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:35.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c200b87a0 0x7f4c2015d2b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009b90 tx=0x7f4c10004750 comp rx=0 tx=0).stop 2023-05-10T04:20:35.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 shutdown_connections 2023-05-10T04:20:35.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f4c0c06ace0 0x7f4c0c06d190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f4c20160d40 0x7f4c20159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c200b87a0 0x7f4c2015d2b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 --2- 172.21.15.132:0/3030282169 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f4c201601e0 0x7f4c20159830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:35.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 >> 172.21.15.132:0/3030282169 conn(0x7f4c20071b10 msgr2=0x7f4c20160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:35.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 shutdown_connections 2023-05-10T04:20:35.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:35.932+0000 7f4c25bff700 1 -- 172.21.15.132:0/3030282169 wait complete. 2023-05-10T04:20:35.936 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-05-10T04:20:35.951 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi154.front.sepia.ceph.com... 2023-05-10T04:20:35.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:20:35.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-05-10T04:20:36.021 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:20:36.022 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi154.front.sepia.ceph.com 2023-05-10T04:20:36.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:20:36.022 DEBUG:teuthology.orchestra.run.smithi154:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-05-10T04:20:36.063 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-05-10T04:20:36.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:20:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.245+0000 7f7007fff700 1 Processor -- start 2023-05-10T04:20:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.245+0000 7f7007fff700 1 -- start start 2023-05-10T04:20:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.246+0000 7f7007fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f70000cff50 0x7f7000160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.246+0000 7f7007fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000cd520 con 0x7f70000cf010 2023-05-10T04:20:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.246+0000 7f7007fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70000d2640 con 0x7f700015c590 2023-05-10T04:20:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.246+0000 7f7007fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70001610d0 con 0x7f70000cff50 2023-05-10T04:20:36.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f700559a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f70000cf010 0x7f70000d2ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46938/0 (socket says 172.21.15.132:46938) 2023-05-10T04:20:36.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f700559a700 1 -- 172.21.15.132:0/4113916565 learned_addr learned my addr 172.21.15.132:0/4113916565 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:36.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f700659c700 1 --2- 172.21.15.132:0/4113916565 >> v2:172.21.15.154:3300/0 conn(0x7f70000cff50 0x7f7000160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f7004d99700 1 -- 172.21.15.132:0/4113916565 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 137075074 0 0) 0x7f70000cd520 con 0x7f70000cf010 2023-05-10T04:20:36.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f7004d99700 1 -- 172.21.15.132:0/4113916565 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fec0035b0 con 0x7f70000cf010 2023-05-10T04:20:36.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f7004d99700 1 -- 172.21.15.132:0/4113916565 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1425744688 0 0) 0x7f70000d2640 con 0x7f700015c590 2023-05-10T04:20:36.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f7004d99700 1 -- 172.21.15.132:0/4113916565 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70000cd520 con 0x7f700015c590 2023-05-10T04:20:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f700659c700 1 -- 172.21.15.132:0/4113916565 >> v1:172.21.15.154:6789/0 conn(0x7f700015c590 legacy=0x7f70000cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f7004d99700 1 -- 172.21.15.132:0/4113916565 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2079005431 0 0) 0x7f6fec0035b0 con 0x7f70000cf010 2023-05-10T04:20:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f700659c700 1 -- 172.21.15.132:0/4113916565 >> v1:172.21.15.132:6789/0 conn(0x7f70000cf010 legacy=0x7f70000d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.247+0000 7f700659c700 1 -- 172.21.15.132:0/4113916565 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70000b23c0 con 0x7f70000cff50 2023-05-10T04:20:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.248+0000 7f700659c700 1 --2- 172.21.15.132:0/4113916565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cff50 0x7f7000160b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009d90 tx=0x7f6ff800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e16d9e024199f62 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.248+0000 7f7004d99700 1 -- 172.21.15.132:0/4113916565 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800e070 con 0x7f70000cff50 2023-05-10T04:20:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.248+0000 7f7004d99700 1 -- 172.21.15.132:0/4113916565 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff800bb20 con 0x7f70000cff50 2023-05-10T04:20:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.248+0000 7f7004d99700 1 -- 172.21.15.132:0/4113916565 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff800bed0 con 0x7f70000cff50 2023-05-10T04:20:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.248+0000 7f7007fff700 1 -- 172.21.15.132:0/4113916565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cff50 msgr2=0x7f7000160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.248+0000 7f7007fff700 1 --2- 172.21.15.132:0/4113916565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cff50 0x7f7000160b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009d90 tx=0x7f6ff800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.249+0000 7f7007fff700 1 -- 172.21.15.132:0/4113916565 shutdown_connections 2023-05-10T04:20:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.249+0000 7f7007fff700 1 --2- 172.21.15.132:0/4113916565 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cff50 0x7f7000160b90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.249+0000 7f7007fff700 1 -- 172.21.15.132:0/4113916565 >> 172.21.15.132:0/4113916565 conn(0x7f7000071b10 msgr2=0x7f7000071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.249+0000 7f7007fff700 1 -- 172.21.15.132:0/4113916565 shutdown_connections 2023-05-10T04:20:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.249+0000 7f7007fff700 1 -- 172.21.15.132:0/4113916565 wait complete. 2023-05-10T04:20:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.250+0000 7f7007fff700 1 Processor -- start 2023-05-10T04:20:36.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.250+0000 7f7007fff700 1 -- start start 2023-05-10T04:20:36.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.251+0000 7f7007fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cf010 0x7f700015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.251+0000 7f7007fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70000cff50 0x7f70000b4200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.251+0000 7f7007fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f700015c590 0x7f70001f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.251+0000 7f7007fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70001f5780 con 0x7f700015c590 2023-05-10T04:20:36.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.251+0000 7f7007fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70001f5450 con 0x7f70000cf010 2023-05-10T04:20:36.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.251+0000 7f7007fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700015e450 con 0x7f70000cff50 2023-05-10T04:20:36.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f700015c590 0x7f70001f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f700015c590 0x7f70001f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41110/0 (socket says 172.21.15.132:41110) 2023-05-10T04:20:36.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 -- 172.21.15.132:0/2772556230 learned_addr learned my addr 172.21.15.132:0/2772556230 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:36.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f7005d9b700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cf010 0x7f700015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 -- 172.21.15.132:0/2772556230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70000cff50 msgr2=0x7f70000b4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70000cff50 0x7f70000b4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 -- 172.21.15.132:0/2772556230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cf010 msgr2=0x7f700015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cf010 0x7f700015dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 -- 172.21.15.132:0/2772556230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff8009a70 con 0x7f700015c590 2023-05-10T04:20:36.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f7005d9b700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cf010 0x7f700015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:36.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f700659c700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f700015c590 0x7f70001f5c10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8014040 tx=0x7f6ff8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:36.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f6ff67fc700 1 -- 172.21.15.132:0/2772556230 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff801b810 con 0x7f700015c590 2023-05-10T04:20:36.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.252+0000 7f6ff67fc700 1 -- 172.21.15.132:0/2772556230 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff8020070 con 0x7f700015c590 2023-05-10T04:20:36.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.253+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70000cd770 con 0x7f700015c590 2023-05-10T04:20:36.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.253+0000 7f6ff67fc700 1 -- 172.21.15.132:0/2772556230 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff801bbb0 con 0x7f700015c590 2023-05-10T04:20:36.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.253+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70000cf560 con 0x7f700015c590 2023-05-10T04:20:36.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.254+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700015c960 con 0x7f700015c590 2023-05-10T04:20:36.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.254+0000 7f6ff67fc700 1 -- 172.21.15.132:0/2772556230 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ff801bd10 con 0x7f700015c590 2023-05-10T04:20:36.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.256+0000 7f6ff67fc700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6fe406ace0 0x7f6fe406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.256+0000 7f6ff67fc700 1 -- 172.21.15.132:0/2772556230 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ff8022070 con 0x7f700015c590 2023-05-10T04:20:36.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.256+0000 7f7005d9b700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6fe406ace0 0x7f6fe406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.257+0000 7f7005d9b700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6fe406ace0 0x7f6fe406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0011e0 tx=0x7f6ffc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:36.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.260+0000 7f6ff67fc700 1 -- 172.21.15.132:0/2772556230 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6ff80565e0 con 0x7f700015c590 2023-05-10T04:20:36.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.495+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70000b51f0 con 0x7f700015c590 2023-05-10T04:20:36.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.496+0000 7f6ff67fc700 1 -- 172.21.15.132:0/2772556230 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f6ff8059c00 con 0x7f700015c590 2023-05-10T04:20:36.498 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:36.499 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:31.478753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-10T04:20:36.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.498+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6fe406ace0 msgr2=0x7f6fe406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.498+0000 7f7007fff700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6fe406ace0 0x7f6fe406d190 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc0011e0 tx=0x7f6ffc009040 comp rx=0 tx=0).stop 2023-05-10T04:20:36.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.498+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f700015c590 msgr2=0x7f70001f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.498+0000 7f7007fff700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f700015c590 0x7f70001f5c10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8014040 tx=0x7f6ff8004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.499+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 shutdown_connections 2023-05-10T04:20:36.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.499+0000 7f7007fff700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6fe406ace0 0x7f6fe406d190 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.499+0000 7f7007fff700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f700015c590 0x7f70001f5c10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.499+0000 7f7007fff700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f70000cf010 0x7f700015dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.499+0000 7f7007fff700 1 --2- 172.21.15.132:0/2772556230 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f70000cff50 0x7f70000b4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.499+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 >> 172.21.15.132:0/2772556230 conn(0x7f7000071b10 msgr2=0x7f70000ca840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:36.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.499+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 shutdown_connections 2023-05-10T04:20:36.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.499+0000 7f7007fff700 1 -- 172.21.15.132:0/2772556230 wait complete. 2023-05-10T04:20:36.503 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2023-05-10T04:20:36.518 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:36.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.700+0000 7fb1951ff700 1 Processor -- start 2023-05-10T04:20:36.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.700+0000 7fb1951ff700 1 -- start start 2023-05-10T04:20:36.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb1951ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb19006b4f0 0x7fb19006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb1951ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1900d0130 0x7fb1900cf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb1951ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1900b26f0 con 0x7fb1900cd7d0 2023-05-10T04:20:36.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb1951ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb19006be00 con 0x7fb1900d0130 2023-05-10T04:20:36.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb1951ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900cf890 con 0x7fb19006b4f0 2023-05-10T04:20:36.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb18e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1900d0130 0x7fb1900cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb18ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb19006b4f0 0x7fb19006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb18e59c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fb1900d0130 0x7fb1900cf350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:51998/0 (socket says 172.21.15.132:51998) 2023-05-10T04:20:36.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb18ed9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb19006b4f0 0x7fb19006b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:34842/0 (socket says 172.21.15.132:34842) 2023-05-10T04:20:36.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb18e59c700 1 -- 172.21.15.132:0/1649406168 learned_addr learned my addr 172.21.15.132:0/1649406168 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:36.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.701+0000 7fb18f59e700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fb1900cd7d0 0x7fb1900cdc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:36960/0 (socket says 172.21.15.132:36960) 2023-05-10T04:20:36.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.702+0000 7fb18e59c700 1 -- 172.21.15.132:0/1649406168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb19006b4f0 msgr2=0x7fb19006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:36.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.702+0000 7fb18e59c700 1 --2- 172.21.15.132:0/1649406168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb19006b4f0 0x7fb19006b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.702+0000 7fb18e59c700 1 -- 172.21.15.132:0/1649406168 >> v1:172.21.15.154:6789/0 conn(0x7fb1900cd7d0 legacy=0x7fb1900cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.702+0000 7fb18e59c700 1 -- 172.21.15.132:0/1649406168 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1900cfb60 con 0x7fb1900d0130 2023-05-10T04:20:36.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.702+0000 7fb18ed9d700 1 --2- 172.21.15.132:0/1649406168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb19006b4f0 0x7fb19006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:36.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.702+0000 7fb18e59c700 1 --2- 172.21.15.132:0/1649406168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900d0130 0x7fb1900cf350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb1840098f0 tx=0x7fb184009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56f09fb64349ac7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:36.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.702+0000 7fb18dd9b700 1 -- 172.21.15.132:0/1649406168 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184011830 con 0x7fb1900d0130 2023-05-10T04:20:36.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb18dd9b700 1 -- 172.21.15.132:0/1649406168 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb184011990 con 0x7fb1900d0130 2023-05-10T04:20:36.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb18dd9b700 1 -- 172.21.15.132:0/1649406168 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184011d20 con 0x7fb1900d0130 2023-05-10T04:20:36.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb1951ff700 1 -- 172.21.15.132:0/1649406168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900d0130 msgr2=0x7fb1900cf350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb1951ff700 1 --2- 172.21.15.132:0/1649406168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900d0130 0x7fb1900cf350 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb1840098f0 tx=0x7fb184009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:36.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb1951ff700 1 -- 172.21.15.132:0/1649406168 shutdown_connections 2023-05-10T04:20:36.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb1951ff700 1 --2- 172.21.15.132:0/1649406168 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb19006b4f0 0x7fb19006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb1951ff700 1 --2- 172.21.15.132:0/1649406168 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900d0130 0x7fb1900cf350 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb1951ff700 1 -- 172.21.15.132:0/1649406168 >> 172.21.15.132:0/1649406168 conn(0x7fb19009a090 msgr2=0x7fb1900d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:36.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb1951ff700 1 -- 172.21.15.132:0/1649406168 shutdown_connections 2023-05-10T04:20:36.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.703+0000 7fb1951ff700 1 -- 172.21.15.132:0/1649406168 wait complete. 2023-05-10T04:20:36.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.705+0000 7fb1951ff700 1 Processor -- start 2023-05-10T04:20:36.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.705+0000 7fb1951ff700 1 -- start start 2023-05-10T04:20:36.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb1951ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb19006b4f0 0x7fb1900b6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb1951ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900cd7d0 0x7fb190155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb1951ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900d0130 0x7fb1900c63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb1951ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19015bb40 con 0x7fb19006b4f0 2023-05-10T04:20:36.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb1951ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1900c5cc0 con 0x7fb1900cd7d0 2023-05-10T04:20:36.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb1951ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb190155970 con 0x7fb1900d0130 2023-05-10T04:20:36.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb18ed9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb19006b4f0 0x7fb1900b6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb18ed9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb19006b4f0 0x7fb1900b6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41116/0 (socket says 172.21.15.132:41116) 2023-05-10T04:20:36.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb18ed9d700 1 -- 172.21.15.132:0/3153543606 learned_addr learned my addr 172.21.15.132:0/3153543606 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:36.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb18e59c700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900cd7d0 0x7fb190155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb18f59e700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900d0130 0x7fb1900c63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.706+0000 7fb18ed9d700 1 -- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900d0130 msgr2=0x7fb1900c63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb18ed9d700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900d0130 0x7fb1900c63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb18ed9d700 1 -- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900cd7d0 msgr2=0x7fb190155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb18ed9d700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900cd7d0 0x7fb190155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb18ed9d700 1 -- 172.21.15.132:0/3153543606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1800094a0 con 0x7fb19006b4f0 2023-05-10T04:20:36.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb18e59c700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900cd7d0 0x7fb190155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:36.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb18ed9d700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb19006b4f0 0x7fb1900b6430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb18000ebe0 tx=0x7fb18000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:36.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb1777fe700 1 -- 172.21.15.132:0/3153543606 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18000c850 con 0x7fb19006b4f0 2023-05-10T04:20:36.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb1777fe700 1 -- 172.21.15.132:0/3153543606 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18000c9b0 con 0x7fb19006b4f0 2023-05-10T04:20:36.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb1777fe700 1 -- 172.21.15.132:0/3153543606 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18000cd40 con 0x7fb19006b4f0 2023-05-10T04:20:36.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb184009550 con 0x7fb19006b4f0 2023-05-10T04:20:36.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.707+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1900cb4b0 con 0x7fb19006b4f0 2023-05-10T04:20:36.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.708+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb19015bf60 con 0x7fb19006b4f0 2023-05-10T04:20:36.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.709+0000 7fb1777fe700 1 -- 172.21.15.132:0/3153543606 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb180013470 con 0x7fb19006b4f0 2023-05-10T04:20:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.710+0000 7fb1777fe700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb17c06ace0 0x7fb17c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.710+0000 7fb1777fe700 1 -- 172.21.15.132:0/3153543606 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb180089bc0 con 0x7fb19006b4f0 2023-05-10T04:20:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.710+0000 7fb18e59c700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb17c06ace0 0x7fb17c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.711+0000 7fb18e59c700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb17c06ace0 0x7fb17c06d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb184009840 tx=0x7fb184008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.714+0000 7fb1777fe700 1 -- 172.21.15.132:0/3153543606 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb180054980 con 0x7fb19006b4f0 2023-05-10T04:20:36.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.910+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1900cb790 con 0x7fb19006b4f0 2023-05-10T04:20:36.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.911+0000 7fb1777fe700 1 -- 172.21.15.132:0/3153543606 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7fb18000cea0 con 0x7fb19006b4f0 2023-05-10T04:20:36.913 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:36.914 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:36.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb17c06ace0 msgr2=0x7fb17c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb17c06ace0 0x7fb17c06d190 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb184009840 tx=0x7fb184008030 comp rx=0 tx=0).stop 2023-05-10T04:20:36.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb19006b4f0 msgr2=0x7fb1900b6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:36.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb19006b4f0 0x7fb1900b6430 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb18000ebe0 tx=0x7fb18000eef0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 shutdown_connections 2023-05-10T04:20:36.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb17c06ace0 0x7fb17c06d190 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb1900d0130 0x7fb1900c63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb19006b4f0 0x7fb1900b6430 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 --2- 172.21.15.132:0/3153543606 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb1900cd7d0 0x7fb190155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:36.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 >> 172.21.15.132:0/3153543606 conn(0x7fb19009a090 msgr2=0x7fb1901e4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:36.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 shutdown_connections 2023-05-10T04:20:36.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:36.914+0000 7fb1951ff700 1 -- 172.21.15.132:0/3153543606 wait complete. 2023-05-10T04:20:36.933 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-10T04:19:08.301407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-10T04:19:08.922877+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-05-10T04:19:11.995669+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-05-10T04:20:36.934 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:37.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.117+0000 7f7b2b3ff700 1 Processor -- start 2023-05-10T04:20:37.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.117+0000 7f7b2b3ff700 1 -- start start 2023-05-10T04:20:37.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.118+0000 7f7b2b3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b240d2110 0x7f7b24167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.118+0000 7f7b2b3ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b24161000 con 0x7f7b240cfbf0 2023-05-10T04:20:37.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.118+0000 7f7b2b3ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b240d0020 con 0x7f7b240b87a0 2023-05-10T04:20:37.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.118+0000 7f7b2b3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240d02d0 con 0x7f7b240d2110 2023-05-10T04:20:37.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.118+0000 7f7b2899a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7b240cfbf0 0x7f7b241608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46944/0 (socket says 172.21.15.132:46944) 2023-05-10T04:20:37.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b2899a700 1 -- 172.21.15.132:0/3041238424 learned_addr learned my addr 172.21.15.132:0/3041238424 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:37.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b2999c700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b240d2110 0x7f7b24167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2488825642 0 0) 0x7f7b24161000 con 0x7f7b240cfbf0 2023-05-10T04:20:37.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b100035b0 con 0x7f7b240cfbf0 2023-05-10T04:20:37.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544894215 0 0) 0x7f7b240d0020 con 0x7f7b240b87a0 2023-05-10T04:20:37.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b24161000 con 0x7f7b240b87a0 2023-05-10T04:20:37.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 208474630 0 0) 0x7f7b100035b0 con 0x7f7b240cfbf0 2023-05-10T04:20:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b240d2110 msgr2=0x7f7b24167550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b240d2110 0x7f7b24167550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 >> v1:172.21.15.154:6789/0 conn(0x7f7b240b87a0 legacy=0x7f7b241601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240cdc60 con 0x7f7b240cfbf0 2023-05-10T04:20:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f7b14001670 con 0x7f7b240cfbf0 2023-05-10T04:20:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 >> v1:172.21.15.132:6789/0 conn(0x7f7b240cfbf0 legacy=0x7f7b241608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b10003bc0 0x7f7b10003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b240d2110 0x7f7b10004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.119+0000 7f7b1bfff700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b10004d90 0x7f7b10005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240d02d0 con 0x7f7b10004d90 2023-05-10T04:20:37.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1000bac0 con 0x7f7b10003bc0 2023-05-10T04:20:37.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1000bc30 con 0x7f7b240d2110 2023-05-10T04:20:37.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2999c700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b10004d90 0x7f7b10005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2899a700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b240d2110 0x7f7b10004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2919b700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b10003bc0 0x7f7b10003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2999c700 1 -- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b240d2110 msgr2=0x7f7b10004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2999c700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b240d2110 0x7f7b10004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2999c700 1 -- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b10003bc0 msgr2=0x7f7b10003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2999c700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b10003bc0 0x7f7b10003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2999c700 1 -- 172.21.15.132:0/3041238424 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100035b0 con 0x7f7b10004d90 2023-05-10T04:20:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.120+0000 7f7b2999c700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b10004d90 0x7f7b10005200 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009fc0 tx=0x7f7b10005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b154e04fb1544891 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00ebd0 con 0x7f7b10004d90 2023-05-10T04:20:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c00f040 con 0x7f7b10004d90 2023-05-10T04:20:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b1bfff700 1 -- 172.21.15.132:0/3041238424 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c014480 con 0x7f7b10004d90 2023-05-10T04:20:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/3041238424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b10004d90 msgr2=0x7f7b10005200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b2b3ff700 1 --2- 172.21.15.132:0/3041238424 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b10004d90 0x7f7b10005200 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009fc0 tx=0x7f7b10005880 comp rx=0 tx=0).stop 2023-05-10T04:20:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b2999c700 1 -- 172.21.15.132:0/3041238424 reap_dead start 2023-05-10T04:20:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/3041238424 shutdown_connections 2023-05-10T04:20:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/3041238424 >> 172.21.15.132:0/3041238424 conn(0x7f7b24071b10 msgr2=0x7f7b24071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/3041238424 shutdown_connections 2023-05-10T04:20:37.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.121+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/3041238424 wait complete. 2023-05-10T04:20:37.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.123+0000 7f7b2b3ff700 1 Processor -- start 2023-05-10T04:20:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.123+0000 7f7b2b3ff700 1 -- start start 2023-05-10T04:20:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2b3ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b10004d90 0x7f7b2414fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2b3ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2414ef70 0x7f7b2414f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2b3ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b241585f0 0x7f7b24158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2b3ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b2414f920 con 0x7f7b241585f0 2023-05-10T04:20:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2b3ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24159be0 con 0x7f7b10004d90 2023-05-10T04:20:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2b3ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24159340 con 0x7f7b2414ef70 2023-05-10T04:20:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2999c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b241585f0 0x7f7b24158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2999c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b241585f0 0x7f7b24158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41144/0 (socket says 172.21.15.132:41144) 2023-05-10T04:20:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2999c700 1 -- 172.21.15.132:0/4185870453 learned_addr learned my addr 172.21.15.132:0/4185870453 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2999c700 1 -- 172.21.15.132:0/4185870453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2414ef70 msgr2=0x7f7b2414f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2999c700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2414ef70 0x7f7b2414f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2999c700 1 -- 172.21.15.132:0/4185870453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b10004d90 msgr2=0x7f7b2414fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2999c700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b10004d90 0x7f7b2414fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.124+0000 7f7b2999c700 1 -- 172.21.15.132:0/4185870453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240cd980 con 0x7f7b241585f0 2023-05-10T04:20:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.125+0000 7f7b2999c700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b241585f0 0x7f7b24158a60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009f90 tx=0x7f7b1c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.125+0000 7f7b19ffb700 1 -- 172.21.15.132:0/4185870453 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c007000 con 0x7f7b241585f0 2023-05-10T04:20:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.125+0000 7f7b19ffb700 1 -- 172.21.15.132:0/4185870453 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c022070 con 0x7f7b241585f0 2023-05-10T04:20:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.125+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b240cd6a0 con 0x7f7b241585f0 2023-05-10T04:20:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.125+0000 7f7b19ffb700 1 -- 172.21.15.132:0/4185870453 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c029480 con 0x7f7b241585f0 2023-05-10T04:20:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.125+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b24165540 con 0x7f7b241585f0 2023-05-10T04:20:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.126+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b240b52f0 con 0x7f7b241585f0 2023-05-10T04:20:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.127+0000 7f7b19ffb700 1 -- 172.21.15.132:0/4185870453 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b1c01e430 con 0x7f7b241585f0 2023-05-10T04:20:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.128+0000 7f7b19ffb700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b0806ace0 0x7f7b0806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.128+0000 7f7b19ffb700 1 -- 172.21.15.132:0/4185870453 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7b1c024070 con 0x7f7b241585f0 2023-05-10T04:20:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.128+0000 7f7b2919b700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b0806ace0 0x7f7b0806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.129+0000 7f7b2919b700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b0806ace0 0x7f7b0806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007fd0 tx=0x7f7b20009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.132+0000 7f7b19ffb700 1 -- 172.21.15.132:0/4185870453 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f7b1c056480 con 0x7f7b241585f0 2023-05-10T04:20:37.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.326+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7b2415aa90 con 0x7f7b241585f0 2023-05-10T04:20:37.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.327+0000 7f7b19ffb700 1 -- 172.21.15.132:0/4185870453 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7b1c059aa0 con 0x7f7b241585f0 2023-05-10T04:20:37.329 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:37.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b0806ace0 msgr2=0x7f7b0806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b0806ace0 0x7f7b0806d190 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7b20007fd0 tx=0x7f7b20009040 comp rx=0 tx=0).stop 2023-05-10T04:20:37.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b241585f0 msgr2=0x7f7b24158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b241585f0 0x7f7b24158a60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c009f90 tx=0x7f7b1c009750 comp rx=0 tx=0).stop 2023-05-10T04:20:37.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 shutdown_connections 2023-05-10T04:20:37.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f7b0806ace0 0x7f7b0806d190 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b241585f0 0x7f7b24158a60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7b10004d90 0x7f7b2414fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 --2- 172.21.15.132:0/4185870453 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f7b2414ef70 0x7f7b2414f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.329+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 >> 172.21.15.132:0/4185870453 conn(0x7f7b24071b10 msgr2=0x7f7b240b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:37.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.330+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 shutdown_connections 2023-05-10T04:20:37.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.330+0000 7f7b2b3ff700 1 -- 172.21.15.132:0/4185870453 wait complete. 2023-05-10T04:20:37.349 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:37.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.537+0000 7f9702bff700 1 Processor -- start 2023-05-10T04:20:37.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.537+0000 7f9702bff700 1 -- start start 2023-05-10T04:20:37.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f9702bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f96fc0b87a0 0x7f96fc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f9702bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96fc1601e0 0x7f96fc160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f9702bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 0x7f96fc0d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f9702bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc0d02d0 con 0x7f96fc1601e0 2023-05-10T04:20:37.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f9702bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96fc0d0cb0 con 0x7f96fc0b87a0 2023-05-10T04:20:37.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f9702bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc0b2730 con 0x7f96fc160b70 2023-05-10T04:20:37.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f96fbfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96fc1601e0 0x7f96fc160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f96fbfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96fc1601e0 0x7f96fc160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41152/0 (socket says 172.21.15.132:41152) 2023-05-10T04:20:37.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.538+0000 7f96fbfff700 1 -- 172.21.15.132:0/1070150426 learned_addr learned my addr 172.21.15.132:0/1070150426 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:37.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f970119c700 1 --2- 172.21.15.132:0/1070150426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 0x7f96fc0d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f970099b700 1 --2- 172.21.15.132:0/1070150426 >> v2:172.21.15.154:3300/0 conn(0x7f96fc0b87a0 0x7f96fc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fbfff700 1 -- 172.21.15.132:0/1070150426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 msgr2=0x7f96fc0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:37.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fbfff700 1 --2- 172.21.15.132:0/1070150426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 0x7f96fc0d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fbfff700 1 -- 172.21.15.132:0/1070150426 >> v2:172.21.15.154:3300/0 conn(0x7f96fc0b87a0 msgr2=0x7f96fc0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:37.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fbfff700 1 --2- 172.21.15.132:0/1070150426 >> v2:172.21.15.154:3300/0 conn(0x7f96fc0b87a0 0x7f96fc0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fbfff700 1 -- 172.21.15.132:0/1070150426 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96fc0cdc60 con 0x7f96fc1601e0 2023-05-10T04:20:37.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f970099b700 1 --2- 172.21.15.132:0/1070150426 >> v2:172.21.15.154:3300/0 conn(0x7f96fc0b87a0 0x7f96fc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:37.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fbfff700 1 --2- 172.21.15.132:0/1070150426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc1601e0 0x7f96fc160630 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0b4ac0 tx=0x7f96e8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57c7365a50caa5 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fb7fe700 1 -- 172.21.15.132:0/1070150426 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800b870 con 0x7f96fc1601e0 2023-05-10T04:20:37.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fb7fe700 1 -- 172.21.15.132:0/1070150426 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e800b9d0 con 0x7f96fc1601e0 2023-05-10T04:20:37.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.539+0000 7f96fb7fe700 1 -- 172.21.15.132:0/1070150426 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e800bd60 con 0x7f96fc1601e0 2023-05-10T04:20:37.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 -- 172.21.15.132:0/1070150426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc1601e0 msgr2=0x7f96fc160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 --2- 172.21.15.132:0/1070150426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc1601e0 0x7f96fc160630 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f96fc0b4ac0 tx=0x7f96e8009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 -- 172.21.15.132:0/1070150426 shutdown_connections 2023-05-10T04:20:37.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 --2- 172.21.15.132:0/1070150426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 0x7f96fc0d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 --2- 172.21.15.132:0/1070150426 >> v2:172.21.15.154:3300/0 conn(0x7f96fc0b87a0 0x7f96fc0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 --2- 172.21.15.132:0/1070150426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc1601e0 0x7f96fc160630 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 -- 172.21.15.132:0/1070150426 >> 172.21.15.132:0/1070150426 conn(0x7f96fc071b10 msgr2=0x7f96fc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:37.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 -- 172.21.15.132:0/1070150426 shutdown_connections 2023-05-10T04:20:37.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.540+0000 7f9702bff700 1 -- 172.21.15.132:0/1070150426 wait complete. 2023-05-10T04:20:37.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.542+0000 7f9702bff700 1 Processor -- start 2023-05-10T04:20:37.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.542+0000 7f9702bff700 1 -- start start 2023-05-10T04:20:37.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f9702bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc0b87a0 0x7f96fc151330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f9702bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96fc1601e0 0x7f96fc15e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f9702bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 0x7f96fc0b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f9702bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc15f240 con 0x7f96fc0b87a0 2023-05-10T04:20:37.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f9702bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc15f520 con 0x7f96fc1601e0 2023-05-10T04:20:37.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f9702bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96fc15f800 con 0x7f96fc160b70 2023-05-10T04:20:37.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970099b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc0b87a0 0x7f96fc151330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970099b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc0b87a0 0x7f96fc151330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41166/0 (socket says 172.21.15.132:41166) 2023-05-10T04:20:37.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970099b700 1 -- 172.21.15.132:0/4073504443 learned_addr learned my addr 172.21.15.132:0/4073504443 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:37.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970119c700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 0x7f96fc0b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f96fbfff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96fc1601e0 0x7f96fc15e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970099b700 1 -- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 msgr2=0x7f96fc0b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970099b700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 0x7f96fc0b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970099b700 1 -- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96fc1601e0 msgr2=0x7f96fc15e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970099b700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96fc1601e0 0x7f96fc15e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f970099b700 1 -- 172.21.15.132:0/4073504443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e8009550 con 0x7f96fc0b87a0 2023-05-10T04:20:37.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.543+0000 7f96fbfff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96fc1601e0 0x7f96fc15e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:37.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.544+0000 7f970099b700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc0b87a0 0x7f96fc151330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f96f000c740 tx=0x7f96f000ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.544+0000 7f96f97fa700 1 -- 172.21.15.132:0/4073504443 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0011800 con 0x7f96fc0b87a0 2023-05-10T04:20:37.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.544+0000 7f96f97fa700 1 -- 172.21.15.132:0/4073504443 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f0011960 con 0x7f96fc0b87a0 2023-05-10T04:20:37.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.544+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96fc0cd6a0 con 0x7f96fc0b87a0 2023-05-10T04:20:37.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.544+0000 7f96f97fa700 1 -- 172.21.15.132:0/4073504443 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f0011cd0 con 0x7f96fc0b87a0 2023-05-10T04:20:37.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.544+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96fc160fd0 con 0x7f96fc0b87a0 2023-05-10T04:20:37.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.545+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96fc0cd980 con 0x7f96fc0b87a0 2023-05-10T04:20:37.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.546+0000 7f96f97fa700 1 -- 172.21.15.132:0/4073504443 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f96f0021350 con 0x7f96fc0b87a0 2023-05-10T04:20:37.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.547+0000 7f96f97fa700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f96e006ace0 0x7f96e006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.547+0000 7f96f97fa700 1 -- 172.21.15.132:0/4073504443 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f96f0089610 con 0x7f96fc0b87a0 2023-05-10T04:20:37.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.547+0000 7f96fbfff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f96e006ace0 0x7f96e006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.548+0000 7f96fbfff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f96e006ace0 0x7f96e006d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f96e8000c00 tx=0x7f96e8008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.551+0000 7f96f97fa700 1 -- 172.21.15.132:0/4073504443 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f96f0057e60 con 0x7f96fc0b87a0 2023-05-10T04:20:37.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.751+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f96fc074430 con 0x7f96fc0b87a0 2023-05-10T04:20:37.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.752+0000 7f96f97fa700 1 -- 172.21.15.132:0/4073504443 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f96f00579f0 con 0x7f96fc0b87a0 2023-05-10T04:20:37.756 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.754+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f96e006ace0 msgr2=0x7f96e006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.754+0000 7f9702bff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f96e006ace0 0x7f96e006d190 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f96e8000c00 tx=0x7f96e8008030 comp rx=0 tx=0).stop 2023-05-10T04:20:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.754+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc0b87a0 msgr2=0x7f96fc151330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.754+0000 7f9702bff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc0b87a0 0x7f96fc151330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f96f000c740 tx=0x7f96f000ca50 comp rx=0 tx=0).stop 2023-05-10T04:20:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.755+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 shutdown_connections 2023-05-10T04:20:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.755+0000 7f9702bff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f96e006ace0 0x7f96e006d190 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.755+0000 7f9702bff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f96fc160b70 0x7f96fc0b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.755+0000 7f9702bff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96fc0b87a0 0x7f96fc151330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.755+0000 7f9702bff700 1 --2- 172.21.15.132:0/4073504443 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f96fc1601e0 0x7f96fc15e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.755+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 >> 172.21.15.132:0/4073504443 conn(0x7f96fc071b10 msgr2=0x7f96fc0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.755+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 shutdown_connections 2023-05-10T04:20:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.755+0000 7f9702bff700 1 -- 172.21.15.132:0/4073504443 wait complete. 2023-05-10T04:20:37.775 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-10T04:20:37.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.961+0000 7f3dc07ff700 1 Processor -- start 2023-05-10T04:20:37.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.961+0000 7f3dc07ff700 1 -- start start 2023-05-10T04:20:37.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.962+0000 7f3dc07ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3db80adf70 0x7f3db80cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.962+0000 7f3dc07ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 0x7f3db806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.962+0000 7f3dc07ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80cc9e0 con 0x7f3db80cd760 2023-05-10T04:20:37.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.962+0000 7f3dc07ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db815de20 con 0x7f3db80adf70 2023-05-10T04:20:37.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.962+0000 7f3dc07ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db815d860 con 0x7f3db815cf10 2023-05-10T04:20:37.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbdd9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3db80adf70 0x7f3db80cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbe59b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3db80cd760 0x7f3db80cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46954/0 (socket says 172.21.15.132:46954) 2023-05-10T04:20:37.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbe59b700 1 -- 172.21.15.132:0/330565977 learned_addr learned my addr 172.21.15.132:0/330565977 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:37.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbed9c700 1 --2- 172.21.15.132:0/330565977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 0x7f3db806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbd599700 1 -- 172.21.15.132:0/330565977 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712098741 0 0) 0x7f3db80cc9e0 con 0x7f3db80cd760 2023-05-10T04:20:37.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbd599700 1 -- 172.21.15.132:0/330565977 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3da40035b0 con 0x7f3db80cd760 2023-05-10T04:20:37.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbdd9a700 1 -- 172.21.15.132:0/330565977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 msgr2=0x7f3db806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:37.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbdd9a700 1 --2- 172.21.15.132:0/330565977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 0x7f3db806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbdd9a700 1 -- 172.21.15.132:0/330565977 >> v1:172.21.15.132:6789/0 conn(0x7f3db80cd760 legacy=0x7f3db80cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.963+0000 7f3dbdd9a700 1 -- 172.21.15.132:0/330565977 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db815db40 con 0x7f3db80adf70 2023-05-10T04:20:37.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dbdd9a700 1 --2- 172.21.15.132:0/330565977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80adf70 0x7f3db80cce70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009820 tx=0x7f3da8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15bf91cc50fc2293 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dbd599700 1 -- 172.21.15.132:0/330565977 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8005e30 con 0x7f3db80adf70 2023-05-10T04:20:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dbd599700 1 -- 172.21.15.132:0/330565977 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8006030 con 0x7f3db80adf70 2023-05-10T04:20:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dbd599700 1 -- 172.21.15.132:0/330565977 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da80063c0 con 0x7f3db80adf70 2023-05-10T04:20:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dc07ff700 1 -- 172.21.15.132:0/330565977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80adf70 msgr2=0x7f3db80cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/330565977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80adf70 0x7f3db80cce70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009820 tx=0x7f3da8009b30 comp rx=0 tx=0).stop 2023-05-10T04:20:37.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dc07ff700 1 -- 172.21.15.132:0/330565977 shutdown_connections 2023-05-10T04:20:37.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/330565977 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 0x7f3db806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/330565977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80adf70 0x7f3db80cce70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.964+0000 7f3dc07ff700 1 -- 172.21.15.132:0/330565977 >> 172.21.15.132:0/330565977 conn(0x7f3db80cf720 msgr2=0x7f3db80cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:37.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.965+0000 7f3dc07ff700 1 -- 172.21.15.132:0/330565977 shutdown_connections 2023-05-10T04:20:37.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.965+0000 7f3dc07ff700 1 -- 172.21.15.132:0/330565977 wait complete. 2023-05-10T04:20:37.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.966+0000 7f3dc07ff700 1 Processor -- start 2023-05-10T04:20:37.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.967+0000 7f3dc07ff700 1 -- start start 2023-05-10T04:20:37.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.967+0000 7f3dc07ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80adf70 0x7f3db80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.967+0000 7f3dc07ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80cd760 0x7f3db80c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.967+0000 7f3dc07ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 0x7f3db80b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.967+0000 7f3dc07ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80b22d0 con 0x7f3db80cd760 2023-05-10T04:20:37.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dc07ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80c8360 con 0x7f3db80adf70 2023-05-10T04:20:37.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dc07ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80b4630 con 0x7f3db815cf10 2023-05-10T04:20:37.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80cd760 0x7f3db80c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80cd760 0x7f3db80c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41176/0 (socket says 172.21.15.132:41176) 2023-05-10T04:20:37.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 -- 172.21.15.132:0/2151236857 learned_addr learned my addr 172.21.15.132:0/2151236857 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:37.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbe59b700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80adf70 0x7f3db80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbed9c700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 0x7f3db80b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 -- 172.21.15.132:0/2151236857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 msgr2=0x7f3db80b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 0x7f3db80b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 -- 172.21.15.132:0/2151236857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80adf70 msgr2=0x7f3db80b3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:37.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80adf70 0x7f3db80b3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:37.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 -- 172.21.15.132:0/2151236857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da8009430 con 0x7f3db80cd760 2023-05-10T04:20:37.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.968+0000 7f3dbdd9a700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80cd760 0x7f3db80c7e20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3da8000c00 tx=0x7f3da8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.969+0000 7f3daeffd700 1 -- 172.21.15.132:0/2151236857 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da80061a0 con 0x7f3db80cd760 2023-05-10T04:20:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.969+0000 7f3daeffd700 1 -- 172.21.15.132:0/2151236857 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8020070 con 0x7f3db80cd760 2023-05-10T04:20:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.969+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db8071600 con 0x7f3db80cd760 2023-05-10T04:20:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.969+0000 7f3daeffd700 1 -- 172.21.15.132:0/2151236857 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8006560 con 0x7f3db80cd760 2023-05-10T04:20:37.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.969+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db80cc670 con 0x7f3db80cd760 2023-05-10T04:20:37.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.970+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db80cd3b0 con 0x7f3db80cd760 2023-05-10T04:20:37.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.971+0000 7f3daeffd700 1 -- 172.21.15.132:0/2151236857 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3da8022030 con 0x7f3db80cd760 2023-05-10T04:20:37.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.972+0000 7f3daeffd700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d9c06ace0 0x7f3d9c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:37.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.972+0000 7f3daeffd700 1 -- 172.21.15.132:0/2151236857 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3da808abe0 con 0x7f3db80cd760 2023-05-10T04:20:37.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.972+0000 7f3dbe59b700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d9c06ace0 0x7f3d9c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:37.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.973+0000 7f3dbe59b700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d9c06ace0 0x7f3d9c06d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3db4007fd0 tx=0x7f3db4007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:37.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:37.976+0000 7f3daeffd700 1 -- 172.21.15.132:0/2151236857 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3da8055990 con 0x7f3db80cd760 2023-05-10T04:20:38.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.173+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3db80b4a10 con 0x7f3db80cd760 2023-05-10T04:20:38.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.173+0000 7f3daeffd700 1 -- 172.21.15.132:0/2151236857 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3da8058fb0 con 0x7f3db80cd760 2023-05-10T04:20:38.176 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:38.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d9c06ace0 msgr2=0x7f3d9c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d9c06ace0 0x7f3d9c06d190 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3db4007fd0 tx=0x7f3db4007dc0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80cd760 msgr2=0x7f3db80c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80cd760 0x7f3db80c7e20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3da8000c00 tx=0x7f3da8004750 comp rx=0 tx=0).stop 2023-05-10T04:20:38.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 shutdown_connections 2023-05-10T04:20:38.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3d9c06ace0 0x7f3d9c06d190 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3db815cf10 0x7f3db80b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3db80adf70 0x7f3db80b3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 --2- 172.21.15.132:0/2151236857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3db80cd760 0x7f3db80c7e20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 >> 172.21.15.132:0/2151236857 conn(0x7f3db80cf720 msgr2=0x7f3db80c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:38.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 shutdown_connections 2023-05-10T04:20:38.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.176+0000 7f3dc07ff700 1 -- 172.21.15.132:0/2151236857 wait complete. 2023-05-10T04:20:38.196 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-10T04:20:38.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.380+0000 7f6ad21ff700 1 Processor -- start 2023-05-10T04:20:38.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.380+0000 7f6ad21ff700 1 -- start start 2023-05-10T04:20:38.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.381+0000 7f6ad21ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6acc0b87a0 0x7f6acc0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.381+0000 7f6ad21ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 0x7f6acc160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.381+0000 7f6ad21ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6acc160ff0 con 0x7f6acc160b70 2023-05-10T04:20:38.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.381+0000 7f6ad21ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6acc0d02d0 con 0x7f6acc0b87a0 2023-05-10T04:20:38.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.381+0000 7f6ad21ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc0d0cb0 con 0x7f6acc1601e0 2023-05-10T04:20:38.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.381+0000 7f6acb7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6acc0b87a0 0x7f6acc0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6acb7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6acc0b87a0 0x7f6acc0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41190/0 (socket says 172.21.15.132:41190) 2023-05-10T04:20:38.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6acb7fe700 1 -- 172.21.15.132:0/3228167464 learned_addr learned my addr 172.21.15.132:0/3228167464 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:38.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6acb7fe700 1 -- 172.21.15.132:0/3228167464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 msgr2=0x7f6acc160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:38.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6acb7fe700 1 --2- 172.21.15.132:0/3228167464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 0x7f6acc160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6acb7fe700 1 -- 172.21.15.132:0/3228167464 >> v1:172.21.15.154:6789/0 conn(0x7f6acc160b70 legacy=0x7f6acc0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:38.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6acb7fe700 1 -- 172.21.15.132:0/3228167464 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6acc0cdc60 con 0x7f6acc0b87a0 2023-05-10T04:20:38.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6acb7fe700 1 --2- 172.21.15.132:0/3228167464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc0b87a0 0x7f6acc0cfbf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0098f0 tx=0x7f6abc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dafe70e78179292 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:38.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6aca7fc700 1 -- 172.21.15.132:0/3228167464 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc004230 con 0x7f6acc0b87a0 2023-05-10T04:20:38.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6aca7fc700 1 -- 172.21.15.132:0/3228167464 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6abc004390 con 0x7f6acc0b87a0 2023-05-10T04:20:38.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.382+0000 7f6aca7fc700 1 -- 172.21.15.132:0/3228167464 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6abc0036a0 con 0x7f6acc0b87a0 2023-05-10T04:20:38.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.383+0000 7f6ad21ff700 1 -- 172.21.15.132:0/3228167464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc0b87a0 msgr2=0x7f6acc0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.383+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/3228167464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc0b87a0 0x7f6acc0cfbf0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6abc0098f0 tx=0x7f6abc009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:38.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.383+0000 7f6ad21ff700 1 -- 172.21.15.132:0/3228167464 shutdown_connections 2023-05-10T04:20:38.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.383+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/3228167464 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc0b87a0 0x7f6acc0cfbf0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.383+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/3228167464 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 0x7f6acc160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.383+0000 7f6ad21ff700 1 -- 172.21.15.132:0/3228167464 >> 172.21.15.132:0/3228167464 conn(0x7f6acc071b10 msgr2=0x7f6acc071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:38.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.383+0000 7f6ad21ff700 1 -- 172.21.15.132:0/3228167464 shutdown_connections 2023-05-10T04:20:38.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.383+0000 7f6ad21ff700 1 -- 172.21.15.132:0/3228167464 wait complete. 2023-05-10T04:20:38.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.385+0000 7f6ad21ff700 1 Processor -- start 2023-05-10T04:20:38.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.385+0000 7f6ad21ff700 1 -- start start 2023-05-10T04:20:38.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6ad21ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6acc0b87a0 0x7f6acc151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6ad21ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 0x7f6acc0c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6ad21ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc160b70 0x7f6acc0c89d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6ad21ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc15d920 con 0x7f6acc160b70 2023-05-10T04:20:38.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6ad21ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc15dc00 con 0x7f6acc0b87a0 2023-05-10T04:20:38.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6ad21ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6acc15dee0 con 0x7f6acc1601e0 2023-05-10T04:20:38.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6acbfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc160b70 0x7f6acc0c89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6acb7fe700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6acc0b87a0 0x7f6acc151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6acbfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc160b70 0x7f6acc0c89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41196/0 (socket says 172.21.15.132:41196) 2023-05-10T04:20:38.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6acbfff700 1 -- 172.21.15.132:0/2082538533 learned_addr learned my addr 172.21.15.132:0/2082538533 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:38.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.386+0000 7f6acaffd700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 0x7f6acc0c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6acbfff700 1 -- 172.21.15.132:0/2082538533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 msgr2=0x7f6acc0c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6acbfff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 0x7f6acc0c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6acbfff700 1 -- 172.21.15.132:0/2082538533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6acc0b87a0 msgr2=0x7f6acc151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6acbfff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6acc0b87a0 0x7f6acc151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6acbfff700 1 -- 172.21.15.132:0/2082538533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc009550 con 0x7f6acc160b70 2023-05-10T04:20:38.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6acb7fe700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6acc0b87a0 0x7f6acc151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:38.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6acbfff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc160b70 0x7f6acc0c89d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400b990 tx=0x7f6ac400bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:38.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6ab3fff700 1 -- 172.21.15.132:0/2082538533 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400d890 con 0x7f6acc160b70 2023-05-10T04:20:38.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6ab3fff700 1 -- 172.21.15.132:0/2082538533 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac400d9f0 con 0x7f6acc160b70 2023-05-10T04:20:38.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6ab3fff700 1 -- 172.21.15.132:0/2082538533 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400dda0 con 0x7f6acc160b70 2023-05-10T04:20:38.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6acc0cd980 con 0x7f6acc160b70 2023-05-10T04:20:38.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.387+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6acc0cd6a0 con 0x7f6acc160b70 2023-05-10T04:20:38.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.388+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6acc0d2110 con 0x7f6acc160b70 2023-05-10T04:20:38.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.389+0000 7f6ab3fff700 1 -- 172.21.15.132:0/2082538533 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6ac4006d50 con 0x7f6acc160b70 2023-05-10T04:20:38.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.390+0000 7f6ab3fff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6ab806ace0 0x7f6ab806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.390+0000 7f6ab3fff700 1 -- 172.21.15.132:0/2082538533 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6ac40896b0 con 0x7f6acc160b70 2023-05-10T04:20:38.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.390+0000 7f6acb7fe700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6ab806ace0 0x7f6ab806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.391+0000 7f6acb7fe700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6ab806ace0 0x7f6ab806d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009130 tx=0x7f6abc008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:38.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.394+0000 7f6ab3fff700 1 -- 172.21.15.132:0/2082538533 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6ac40543d0 con 0x7f6acc160b70 2023-05-10T04:20:38.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.587+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6acc0b52f0 con 0x7f6acc160b70 2023-05-10T04:20:38.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.588+0000 7f6ab3fff700 1 -- 172.21.15.132:0/2082538533 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ac401c020 con 0x7f6acc160b70 2023-05-10T04:20:38.590 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-05-10T04:20:38.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6ab806ace0 msgr2=0x7f6ab806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6ab806ace0 0x7f6ab806d190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009130 tx=0x7f6abc008030 comp rx=0 tx=0).stop 2023-05-10T04:20:38.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc160b70 msgr2=0x7f6acc0c89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc160b70 0x7f6acc0c89d0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6ac400b990 tx=0x7f6ac400bca0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 shutdown_connections 2023-05-10T04:20:38.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6ab806ace0 0x7f6ab806d190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6acc160b70 0x7f6acc0c89d0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6acc0b87a0 0x7f6acc151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 --2- 172.21.15.132:0/2082538533 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6acc1601e0 0x7f6acc0c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 >> 172.21.15.132:0/2082538533 conn(0x7f6acc071b10 msgr2=0x7f6acc0b6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:38.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 shutdown_connections 2023-05-10T04:20:38.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.590+0000 7f6ad21ff700 1 -- 172.21.15.132:0/2082538533 wait complete. 2023-05-10T04:20:38.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-05-10T04:20:38.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.797+0000 7f3984fff700 1 Processor -- start 2023-05-10T04:20:38.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.797+0000 7f3984fff700 1 -- start start 2023-05-10T04:20:38.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.798+0000 7f3984fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f39800b87a0 0x7f39800cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.798+0000 7f3984fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39801601e0 0x7f3980160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.798+0000 7f3984fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39800cdc60 con 0x7f3980160b70 2023-05-10T04:20:38.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.798+0000 7f3984fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800d02d0 con 0x7f39801601e0 2023-05-10T04:20:38.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.798+0000 7f3984fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39800d0cb0 con 0x7f39800b87a0 2023-05-10T04:20:38.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.798+0000 7f397dd9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39801601e0 0x7f3980160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397dd9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39801601e0 0x7f3980160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41210/0 (socket says 172.21.15.132:41210) 2023-05-10T04:20:38.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397dd9b700 1 -- 172.21.15.132:0/2598676490 learned_addr learned my addr 172.21.15.132:0/2598676490 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:38.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397e59c700 1 --2- 172.21.15.132:0/2598676490 >> v2:172.21.15.154:3300/0 conn(0x7f39800b87a0 0x7f39800cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397dd9b700 1 -- 172.21.15.132:0/2598676490 >> v2:172.21.15.154:3300/0 conn(0x7f39800b87a0 msgr2=0x7f39800cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:38.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397dd9b700 1 --2- 172.21.15.132:0/2598676490 >> v2:172.21.15.154:3300/0 conn(0x7f39800b87a0 0x7f39800cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397dd9b700 1 -- 172.21.15.132:0/2598676490 >> v1:172.21.15.154:6789/0 conn(0x7f3980160b70 legacy=0x7f39800d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397dd9b700 1 -- 172.21.15.132:0/2598676490 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800cd6a0 con 0x7f39801601e0 2023-05-10T04:20:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397dd9b700 1 --2- 172.21.15.132:0/2598676490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39801601e0 0x7f3980160630 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f39800b4ac0 tx=0x7f3974009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0462c9e1d5c20f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397d59a700 1 -- 172.21.15.132:0/2598676490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974011830 con 0x7f39801601e0 2023-05-10T04:20:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397d59a700 1 -- 172.21.15.132:0/2598676490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3974011990 con 0x7f39801601e0 2023-05-10T04:20:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.799+0000 7f397d59a700 1 -- 172.21.15.132:0/2598676490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974011d20 con 0x7f39801601e0 2023-05-10T04:20:38.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.800+0000 7f3984fff700 1 -- 172.21.15.132:0/2598676490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39801601e0 msgr2=0x7f3980160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.800+0000 7f3984fff700 1 --2- 172.21.15.132:0/2598676490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39801601e0 0x7f3980160630 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f39800b4ac0 tx=0x7f3974009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:38.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.800+0000 7f3984fff700 1 -- 172.21.15.132:0/2598676490 shutdown_connections 2023-05-10T04:20:38.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.800+0000 7f3984fff700 1 --2- 172.21.15.132:0/2598676490 >> v2:172.21.15.154:3300/0 conn(0x7f39800b87a0 0x7f39800cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.800+0000 7f3984fff700 1 --2- 172.21.15.132:0/2598676490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39801601e0 0x7f3980160630 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.800+0000 7f3984fff700 1 -- 172.21.15.132:0/2598676490 >> 172.21.15.132:0/2598676490 conn(0x7f3980071b10 msgr2=0x7f3980071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:38.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.800+0000 7f3984fff700 1 -- 172.21.15.132:0/2598676490 shutdown_connections 2023-05-10T04:20:38.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.800+0000 7f3984fff700 1 -- 172.21.15.132:0/2598676490 wait complete. 2023-05-10T04:20:38.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.802+0000 7f3984fff700 1 Processor -- start 2023-05-10T04:20:38.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.802+0000 7f3984fff700 1 -- start start 2023-05-10T04:20:38.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f3984fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39800b87a0 0x7f39801f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f3984fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39801601e0 0x7f39801f2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f3984fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3980160b70 0x7f39800b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f3984fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801f1e30 con 0x7f39800b87a0 2023-05-10T04:20:38.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f3984fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39800c87e0 con 0x7f39801601e0 2023-05-10T04:20:38.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f3984fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3980151c70 con 0x7f3980160b70 2023-05-10T04:20:38.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39800b87a0 0x7f39801f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39800b87a0 0x7f39801f18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41226/0 (socket says 172.21.15.132:41226) 2023-05-10T04:20:38.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397e59c700 1 -- 172.21.15.132:0/467873965 learned_addr learned my addr 172.21.15.132:0/467873965 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:38.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397dd9b700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39801601e0 0x7f39801f2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397ed9d700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3980160b70 0x7f39800b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397e59c700 1 -- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3980160b70 msgr2=0x7f39800b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397e59c700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3980160b70 0x7f39800b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397e59c700 1 -- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39801601e0 msgr2=0x7f39801f2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:38.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397e59c700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39801601e0 0x7f39801f2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:38.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397e59c700 1 -- 172.21.15.132:0/467873965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974009550 con 0x7f39800b87a0 2023-05-10T04:20:38.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.804+0000 7f397dd9b700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39801601e0 0x7f39801f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:38.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.805+0000 7f397e59c700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39800b87a0 0x7f39801f18f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f397000e9e0 tx=0x7f397000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:38.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.805+0000 7f396effd700 1 -- 172.21.15.132:0/467873965 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970009710 con 0x7f39800b87a0 2023-05-10T04:20:38.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.805+0000 7f396effd700 1 -- 172.21.15.132:0/467873965 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397000c850 con 0x7f39800b87a0 2023-05-10T04:20:38.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.805+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3980160f90 con 0x7f39800b87a0 2023-05-10T04:20:38.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.805+0000 7f396effd700 1 -- 172.21.15.132:0/467873965 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397000cbc0 con 0x7f39800b87a0 2023-05-10T04:20:38.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.805+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39800cd980 con 0x7f39800b87a0 2023-05-10T04:20:38.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.806+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39800d2110 con 0x7f39800b87a0 2023-05-10T04:20:38.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.807+0000 7f396effd700 1 -- 172.21.15.132:0/467873965 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f397000cd20 con 0x7f39800b87a0 2023-05-10T04:20:38.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.808+0000 7f396effd700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f396006ace0 0x7f396006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:38.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.808+0000 7f396effd700 1 -- 172.21.15.132:0/467873965 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3970089890 con 0x7f39800b87a0 2023-05-10T04:20:38.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.808+0000 7f397dd9b700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f396006ace0 0x7f396006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:38.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.809+0000 7f397dd9b700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f396006ace0 0x7f396006d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3974009870 tx=0x7f3974008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:38.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:38.812+0000 7f396effd700 1 -- 172.21.15.132:0/467873965 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f39700580d0 con 0x7f39800b87a0 2023-05-10T04:20:39.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.005+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3980074430 con 0x7f39800b87a0 2023-05-10T04:20:39.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.005+0000 7f396effd700 1 -- 172.21.15.132:0/467873965 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3970057c60 con 0x7f39800b87a0 2023-05-10T04:20:39.008 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-05-10T04:20:39.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.007+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f396006ace0 msgr2=0x7f396006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.007+0000 7f3984fff700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f396006ace0 0x7f396006d190 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3974009870 tx=0x7f3974008030 comp rx=0 tx=0).stop 2023-05-10T04:20:39.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.007+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39800b87a0 msgr2=0x7f39801f18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.007+0000 7f3984fff700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39800b87a0 0x7f39801f18f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f397000e9e0 tx=0x7f397000eda0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.008+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 shutdown_connections 2023-05-10T04:20:39.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.008+0000 7f3984fff700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f396006ace0 0x7f396006d190 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.008+0000 7f3984fff700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3980160b70 0x7f39800b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.008+0000 7f3984fff700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39800b87a0 0x7f39801f18f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.008+0000 7f3984fff700 1 --2- 172.21.15.132:0/467873965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f39801601e0 0x7f39801f2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.008+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 >> 172.21.15.132:0/467873965 conn(0x7f3980071b10 msgr2=0x7f398015ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:39.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.008+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 shutdown_connections 2023-05-10T04:20:39.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.008+0000 7f3984fff700 1 -- 172.21.15.132:0/467873965 wait complete. 2023-05-10T04:20:39.027 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:20:39.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.208+0000 7f0fa09ff700 1 Processor -- start 2023-05-10T04:20:39.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.208+0000 7f0fa09ff700 1 -- start start 2023-05-10T04:20:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.209+0000 7f0fa09ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f9c0cfbf0 0x7f0f9c1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.209+0000 7f0fa09ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c0d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.209+0000 7f0fa09ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f9c0d0020 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.209+0000 7f0fa09ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f9c0d02d0 con 0x7f0f9c0cfbf0 2023-05-10T04:20:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.209+0000 7f0fa09ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0d0cb0 con 0x7f0f9c0d1100 2023-05-10T04:20:39.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.209+0000 7f0f93fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f9c0cfbf0 0x7f0f9c1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f9ad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c0d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f93fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f0f9c0cfbf0 0x7f0f9c1608f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3300/0 says I am v2:172.21.15.132:52080/0 (socket says 172.21.15.132:52080) 2023-05-10T04:20:39.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f93fff700 1 -- 172.21.15.132:0/462354563 learned_addr learned my addr 172.21.15.132:0/462354563 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f9a59c700 1 --1- 172.21.15.132:0/462354563 >> v1:172.21.15.154:6789/0 conn(0x7f0f9c0b87a0 0x7f0f9c1601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:37006/0 (socket says 172.21.15.132:37006) 2023-05-10T04:20:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f9ad9d700 1 -- 172.21.15.132:0/462354563 >> v2:172.21.15.154:3300/0 conn(0x7f0f9c0cfbf0 msgr2=0x7f0f9c1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f9ad9d700 1 --2- 172.21.15.132:0/462354563 >> v2:172.21.15.154:3300/0 conn(0x7f0f9c0cfbf0 0x7f0f9c1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f9ad9d700 1 -- 172.21.15.132:0/462354563 >> v1:172.21.15.154:6789/0 conn(0x7f0f9c0b87a0 legacy=0x7f0f9c1601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f9ad9d700 1 -- 172.21.15.132:0/462354563 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0cdc60 con 0x7f0f9c0d1100 2023-05-10T04:20:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f93fff700 1 --2- 172.21.15.132:0/462354563 >> v2:172.21.15.154:3300/0 conn(0x7f0f9c0cfbf0 0x7f0f9c1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f9ad9d700 1 --2- 172.21.15.132:0/462354563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c0d1560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009d90 tx=0x7f0f9400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f2562ea826def11 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.210+0000 7f0f99d9b700 1 -- 172.21.15.132:0/462354563 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9400e070 con 0x7f0f9c0d1100 2023-05-10T04:20:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0f99d9b700 1 -- 172.21.15.132:0/462354563 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f9400bb20 con 0x7f0f9c0d1100 2023-05-10T04:20:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0f99d9b700 1 -- 172.21.15.132:0/462354563 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94012430 con 0x7f0f9c0d1100 2023-05-10T04:20:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0fa09ff700 1 -- 172.21.15.132:0/462354563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 msgr2=0x7f0f9c0d1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/462354563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c0d1560 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0f94009d90 tx=0x7f0f9400b330 comp rx=0 tx=0).stop 2023-05-10T04:20:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0fa09ff700 1 -- 172.21.15.132:0/462354563 shutdown_connections 2023-05-10T04:20:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/462354563 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c0d1560 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/462354563 >> v2:172.21.15.154:3300/0 conn(0x7f0f9c0cfbf0 0x7f0f9c1608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0fa09ff700 1 -- 172.21.15.132:0/462354563 >> 172.21.15.132:0/462354563 conn(0x7f0f9c071b10 msgr2=0x7f0f9c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:39.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0fa09ff700 1 -- 172.21.15.132:0/462354563 shutdown_connections 2023-05-10T04:20:39.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.211+0000 7f0fa09ff700 1 -- 172.21.15.132:0/462354563 wait complete. 2023-05-10T04:20:39.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.213+0000 7f0fa09ff700 1 Processor -- start 2023-05-10T04:20:39.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.213+0000 7f0fa09ff700 1 -- start start 2023-05-10T04:20:39.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0fa09ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f9c0b87a0 0x7f0f9c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0fa09ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c0cfbf0 0x7f0f9c15eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0fa09ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0fa09ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0c7790 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0fa09ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0c7a70 con 0x7f0f9c0cfbf0 2023-05-10T04:20:39.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0fa09ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f9c0c7d50 con 0x7f0f9c0d1100 2023-05-10T04:20:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0f9a59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f9c0b87a0 0x7f0f9c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0f9a59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f9c0b87a0 0x7f0f9c0c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41242/0 (socket says 172.21.15.132:41242) 2023-05-10T04:20:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0f9a59c700 1 -- 172.21.15.132:0/2809867818 learned_addr learned my addr 172.21.15.132:0/2809867818 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0f93fff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c0cfbf0 0x7f0f9c15eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.214+0000 7f0f9ad9d700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f9a59c700 1 -- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 msgr2=0x7f0f9c15f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f9a59c700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c15f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f9a59c700 1 -- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c0cfbf0 msgr2=0x7f0f9c15eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f9a59c700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c0cfbf0 0x7f0f9c15eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f9a59c700 1 -- 172.21.15.132:0/2809867818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84009550 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f9ad9d700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c15f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f9a59c700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f9c0b87a0 0x7f0f9c0c8fd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00c520 tx=0x7f0f8c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f92ffd700 1 -- 172.21.15.132:0/2809867818 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c005cb0 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f92ffd700 1 -- 172.21.15.132:0/2809867818 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c005e10 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f94009a70 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0f92ffd700 1 -- 172.21.15.132:0/2809867818 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0072d0 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.215+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f9c0cd980 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.216+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f9c160e30 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.217+0000 7f0f92ffd700 1 -- 172.21.15.132:0/2809867818 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f8c007430 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.218+0000 7f0f92ffd700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7c06ace0 0x7f0f7c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.218+0000 7f0f92ffd700 1 -- 172.21.15.132:0/2809867818 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0f8c088c10 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.218+0000 7f0f93fff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7c06ace0 0x7f0f7c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.219+0000 7f0f93fff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7c06ace0 0x7f0f7c06d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0c8c90 tx=0x7f0f84008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:39.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.222+0000 7f0f92ffd700 1 -- 172.21.15.132:0/2809867818 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f0f8c0539e0 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.462+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f9c074430 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.463+0000 7f0f92ffd700 1 -- 172.21.15.132:0/2809867818 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f0f8c017090 con 0x7f0f9c0b87a0 2023-05-10T04:20:39.465 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:31.478753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-10T04:20:39.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7c06ace0 msgr2=0x7f0f7c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7c06ace0 0x7f0f7c06d190 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0c8c90 tx=0x7f0f84008040 comp rx=0 tx=0).stop 2023-05-10T04:20:39.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f9c0b87a0 msgr2=0x7f0f9c0c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f9c0b87a0 0x7f0f9c0c8fd0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00c520 tx=0x7f0f8c00c8e0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 shutdown_connections 2023-05-10T04:20:39.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f0f7c06ace0 0x7f0f7c06d190 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f0f9c0d1100 0x7f0f9c15f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f9c0b87a0 0x7f0f9c0c8fd0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 --2- 172.21.15.132:0/2809867818 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f0f9c0cfbf0 0x7f0f9c15eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.465+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 >> 172.21.15.132:0/2809867818 conn(0x7f0f9c071b10 msgr2=0x7f0f9c15ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:39.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.466+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 shutdown_connections 2023-05-10T04:20:39.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.466+0000 7f0fa09ff700 1 -- 172.21.15.132:0/2809867818 wait complete. 2023-05-10T04:20:39.470 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2023-05-10T04:20:39.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:39.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.667+0000 7f864f7ff700 1 Processor -- start 2023-05-10T04:20:39.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.667+0000 7f864f7ff700 1 -- start start 2023-05-10T04:20:39.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.668+0000 7f864f7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f86481608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.668+0000 7f864f7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86480d0020 con 0x7f86480b87a0 2023-05-10T04:20:39.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.668+0000 7f864f7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86480cdc60 con 0x7f86480d1100 2023-05-10T04:20:39.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.668+0000 7f864f7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86480d02d0 con 0x7f86480cfbf0 2023-05-10T04:20:39.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.668+0000 7f864d59b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f86480b87a0 0x7f86481601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46958/0 (socket says 172.21.15.132:46958) 2023-05-10T04:20:39.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.668+0000 7f864d59b700 1 -- 172.21.15.132:0/1907778609 learned_addr learned my addr 172.21.15.132:0/1907778609 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:39.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.668+0000 7f864cd9a700 1 --2- 172.21.15.132:0/1907778609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f86481608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.668+0000 7f863ffff700 1 -- 172.21.15.132:0/1907778609 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 182091370 0 0) 0x7f86480d0020 con 0x7f86480b87a0 2023-05-10T04:20:39.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f863ffff700 1 -- 172.21.15.132:0/1907778609 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86340035b0 con 0x7f86480b87a0 2023-05-10T04:20:39.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f863ffff700 1 -- 172.21.15.132:0/1907778609 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716390957 0 0) 0x7f86480cdc60 con 0x7f86480d1100 2023-05-10T04:20:39.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f863ffff700 1 -- 172.21.15.132:0/1907778609 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86480d0020 con 0x7f86480d1100 2023-05-10T04:20:39.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f864cd9a700 1 -- 172.21.15.132:0/1907778609 >> v1:172.21.15.154:6789/0 conn(0x7f86480d1100 legacy=0x7f86480d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f864cd9a700 1 -- 172.21.15.132:0/1907778609 >> v1:172.21.15.132:6789/0 conn(0x7f86480b87a0 legacy=0x7f86481601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f864cd9a700 1 -- 172.21.15.132:0/1907778609 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86480cd6a0 con 0x7f86480cfbf0 2023-05-10T04:20:39.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f864cd9a700 1 --2- 172.21.15.132:0/1907778609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f86481608f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8638009870 tx=0x7f8638009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ac957776642cc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:39.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f863ffff700 1 -- 172.21.15.132:0/1907778609 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638011830 con 0x7f86480cfbf0 2023-05-10T04:20:39.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f863ffff700 1 -- 172.21.15.132:0/1907778609 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8638011990 con 0x7f86480cfbf0 2023-05-10T04:20:39.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.669+0000 7f863ffff700 1 -- 172.21.15.132:0/1907778609 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8638011d20 con 0x7f86480cfbf0 2023-05-10T04:20:39.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.670+0000 7f864f7ff700 1 -- 172.21.15.132:0/1907778609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 msgr2=0x7f86481608f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.670+0000 7f864f7ff700 1 --2- 172.21.15.132:0/1907778609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f86481608f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8638009870 tx=0x7f8638009b80 comp rx=0 tx=0).stop 2023-05-10T04:20:39.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.670+0000 7f864f7ff700 1 -- 172.21.15.132:0/1907778609 shutdown_connections 2023-05-10T04:20:39.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.670+0000 7f864f7ff700 1 --2- 172.21.15.132:0/1907778609 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f86481608f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.670+0000 7f864f7ff700 1 -- 172.21.15.132:0/1907778609 >> 172.21.15.132:0/1907778609 conn(0x7f8648071b10 msgr2=0x7f8648071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:39.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.670+0000 7f864f7ff700 1 -- 172.21.15.132:0/1907778609 shutdown_connections 2023-05-10T04:20:39.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.670+0000 7f864f7ff700 1 -- 172.21.15.132:0/1907778609 wait complete. 2023-05-10T04:20:39.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.672+0000 7f864f7ff700 1 Processor -- start 2023-05-10T04:20:39.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.672+0000 7f864f7ff700 1 -- start start 2023-05-10T04:20:39.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864f7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86480b87a0 0x7f864815f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864f7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f864815f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864f7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86480d1100 0x7f86481f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864f7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86480c6d60 con 0x7f86480b87a0 2023-05-10T04:20:39.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864f7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86480c7040 con 0x7f86480d1100 2023-05-10T04:20:39.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864f7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86480c7320 con 0x7f86480cfbf0 2023-05-10T04:20:39.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864d59b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86480b87a0 0x7f864815f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864d59b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86480b87a0 0x7f864815f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41252/0 (socket says 172.21.15.132:41252) 2023-05-10T04:20:39.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864d59b700 1 -- 172.21.15.132:0/2713176701 learned_addr learned my addr 172.21.15.132:0/2713176701 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:39.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864cd9a700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f864815f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864dd9c700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86480d1100 0x7f86481f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864d59b700 1 -- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 msgr2=0x7f864815f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864d59b700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f864815f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864d59b700 1 -- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86480d1100 msgr2=0x7f86481f2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864d59b700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86480d1100 0x7f86481f2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864d59b700 1 -- 172.21.15.132:0/2713176701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86380094a0 con 0x7f86480b87a0 2023-05-10T04:20:39.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.673+0000 7f864dd9c700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86480d1100 0x7f86481f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:39.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.674+0000 7f864d59b700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86480b87a0 0x7f864815f0f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8644001eb0 tx=0x7f864400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:39.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.674+0000 7f863dffb700 1 -- 172.21.15.132:0/2713176701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644005d70 con 0x7f86480b87a0 2023-05-10T04:20:39.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.674+0000 7f863dffb700 1 -- 172.21.15.132:0/2713176701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86440070d0 con 0x7f86480b87a0 2023-05-10T04:20:39.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.674+0000 7f863dffb700 1 -- 172.21.15.132:0/2713176701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8644007460 con 0x7f86480b87a0 2023-05-10T04:20:39.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.674+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8648160e30 con 0x7f86480b87a0 2023-05-10T04:20:39.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.674+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86480cd980 con 0x7f86480b87a0 2023-05-10T04:20:39.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.675+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8648160fc0 con 0x7f86480b87a0 2023-05-10T04:20:39.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.676+0000 7f863dffb700 1 -- 172.21.15.132:0/2713176701 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f86440075c0 con 0x7f86480b87a0 2023-05-10T04:20:39.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.677+0000 7f863dffb700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f862c06ace0 0x7f862c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:39.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.677+0000 7f863dffb700 1 -- 172.21.15.132:0/2713176701 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8644088db0 con 0x7f86480b87a0 2023-05-10T04:20:39.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.677+0000 7f864cd9a700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f862c06ace0 0x7f862c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:39.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.678+0000 7f864cd9a700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f862c06ace0 0x7f862c06d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f86380097c0 tx=0x7f863801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:39.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.681+0000 7f863dffb700 1 -- 172.21.15.132:0/2713176701 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f864408d070 con 0x7f86480b87a0 2023-05-10T04:20:39.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.882+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8648158cd0 con 0x7f86480b87a0 2023-05-10T04:20:39.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.883+0000 7f863dffb700 1 -- 172.21.15.132:0/2713176701 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f8644053ad0 con 0x7f86480b87a0 2023-05-10T04:20:39.885 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:39.886 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:39.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f862c06ace0 msgr2=0x7f862c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f862c06ace0 0x7f862c06d190 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f86380097c0 tx=0x7f863801c040 comp rx=0 tx=0).stop 2023-05-10T04:20:39.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86480b87a0 msgr2=0x7f864815f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:39.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86480b87a0 0x7f864815f0f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8644001eb0 tx=0x7f864400c860 comp rx=0 tx=0).stop 2023-05-10T04:20:39.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 shutdown_connections 2023-05-10T04:20:39.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f862c06ace0 0x7f862c06d190 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f86480d1100 0x7f86481f2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86480b87a0 0x7f864815f0f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 --2- 172.21.15.132:0/2713176701 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f86480cfbf0 0x7f864815f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:39.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 >> 172.21.15.132:0/2713176701 conn(0x7f8648071b10 msgr2=0x7f86480b7bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:39.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 shutdown_connections 2023-05-10T04:20:39.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:39.886+0000 7f864f7ff700 1 -- 172.21.15.132:0/2713176701 wait complete. 2023-05-10T04:20:39.905 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-10T04:20:39.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:20:40.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.087+0000 7f71c0dff700 1 Processor -- start 2023-05-10T04:20:40.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.087+0000 7f71c0dff700 1 -- start start 2023-05-10T04:20:40.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.088+0000 7f71c0dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71bc0cd790 0x7f71bc0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.088+0000 7f71c0dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f71bc0cdb60 0x7f71bc0b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.088+0000 7f71c0dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71bc06a5f0 con 0x7f71bc0b1b80 2023-05-10T04:20:40.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.088+0000 7f71c0dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc06a840 con 0x7f71bc0cd790 2023-05-10T04:20:40.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.088+0000 7f71c0dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71bc06ab20 con 0x7f71bc0cdb60 2023-05-10T04:20:40.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.088+0000 7f71ba59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71bc0cd790 0x7f71bc0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.088+0000 7f71ba59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71bc0cd790 0x7f71bc0ca210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41264/0 (socket says 172.21.15.132:41264) 2023-05-10T04:20:40.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71ba59c700 1 -- 172.21.15.132:0/1505038383 learned_addr learned my addr 172.21.15.132:0/1505038383 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:40.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71ba59c700 1 -- 172.21.15.132:0/1505038383 >> v2:172.21.15.154:3300/0 conn(0x7f71bc0cdb60 msgr2=0x7f71bc0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:40.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71b9d9b700 1 --2- 172.21.15.132:0/1505038383 >> v2:172.21.15.154:3300/0 conn(0x7f71bc0cdb60 0x7f71bc0b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71ba59c700 1 --2- 172.21.15.132:0/1505038383 >> v2:172.21.15.154:3300/0 conn(0x7f71bc0cdb60 0x7f71bc0b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71ba59c700 1 -- 172.21.15.132:0/1505038383 >> v1:172.21.15.154:6789/0 conn(0x7f71bc0b1b80 legacy=0x7f71bc06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:40.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71ba59c700 1 -- 172.21.15.132:0/1505038383 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71bc06ae00 con 0x7f71bc0cd790 2023-05-10T04:20:40.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71b9d9b700 1 --2- 172.21.15.132:0/1505038383 >> v2:172.21.15.154:3300/0 conn(0x7f71bc0cdb60 0x7f71bc0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:40.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71ba59c700 1 --2- 172.21.15.132:0/1505038383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cd790 0x7f71bc0ca210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0098f0 tx=0x7f71ac009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a311fb4756caabfb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:40.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.089+0000 7f71b959a700 1 -- 172.21.15.132:0/1505038383 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac004230 con 0x7f71bc0cd790 2023-05-10T04:20:40.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71b959a700 1 -- 172.21.15.132:0/1505038383 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac004390 con 0x7f71bc0cd790 2023-05-10T04:20:40.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71b959a700 1 -- 172.21.15.132:0/1505038383 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0036a0 con 0x7f71bc0cd790 2023-05-10T04:20:40.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71c0dff700 1 -- 172.21.15.132:0/1505038383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cd790 msgr2=0x7f71bc0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71c0dff700 1 --2- 172.21.15.132:0/1505038383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cd790 0x7f71bc0ca210 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0098f0 tx=0x7f71ac009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:40.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71c0dff700 1 -- 172.21.15.132:0/1505038383 shutdown_connections 2023-05-10T04:20:40.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71c0dff700 1 --2- 172.21.15.132:0/1505038383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cd790 0x7f71bc0ca210 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71c0dff700 1 --2- 172.21.15.132:0/1505038383 >> v2:172.21.15.154:3300/0 conn(0x7f71bc0cdb60 0x7f71bc0b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71c0dff700 1 -- 172.21.15.132:0/1505038383 >> 172.21.15.132:0/1505038383 conn(0x7f71bc06e980 msgr2=0x7f71bc0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:40.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71c0dff700 1 -- 172.21.15.132:0/1505038383 shutdown_connections 2023-05-10T04:20:40.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.090+0000 7f71c0dff700 1 -- 172.21.15.132:0/1505038383 wait complete. 2023-05-10T04:20:40.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.092+0000 7f71c0dff700 1 Processor -- start 2023-05-10T04:20:40.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.092+0000 7f71c0dff700 1 -- start start 2023-05-10T04:20:40.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71c0dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc0b1b80 0x7f71bc1e6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71c0dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc0cd790 0x7f71bc15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71c0dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cdb60 0x7f71bc0c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71c0dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc144e60 con 0x7f71bc0cdb60 2023-05-10T04:20:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71c0dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc145140 con 0x7f71bc0b1b80 2023-05-10T04:20:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71c0dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71bc145420 con 0x7f71bc0cd790 2023-05-10T04:20:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71bad9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cdb60 0x7f71bc0c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71bad9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cdb60 0x7f71bc0c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41272/0 (socket says 172.21.15.132:41272) 2023-05-10T04:20:40.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.093+0000 7f71bad9d700 1 -- 172.21.15.132:0/3846994004 learned_addr learned my addr 172.21.15.132:0/3846994004 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:40.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71bad9d700 1 -- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc0cd790 msgr2=0x7f71bc15ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71b9d9b700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc0cd790 0x7f71bc15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71bad9d700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc0cd790 0x7f71bc15ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71bad9d700 1 -- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc0b1b80 msgr2=0x7f71bc1e6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71ba59c700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc0b1b80 0x7f71bc1e6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71bad9d700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc0b1b80 0x7f71bc1e6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71bad9d700 1 -- 172.21.15.132:0/3846994004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac009550 con 0x7f71bc0cdb60 2023-05-10T04:20:40.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71ba59c700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc0b1b80 0x7f71bc1e6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:40.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71bad9d700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cdb60 0x7f71bc0c4ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b970 tx=0x7f71b400bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71aaffd700 1 -- 172.21.15.132:0/3846994004 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b400c9b0 con 0x7f71bc0cdb60 2023-05-10T04:20:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71aaffd700 1 -- 172.21.15.132:0/3846994004 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b400cb10 con 0x7f71bc0cdb60 2023-05-10T04:20:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71bc0b2000 con 0x7f71bc0cdb60 2023-05-10T04:20:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71aaffd700 1 -- 172.21.15.132:0/3846994004 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4014440 con 0x7f71bc0cdb60 2023-05-10T04:20:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.094+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71bc06b0e0 con 0x7f71bc0cdb60 2023-05-10T04:20:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.096+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71bc0ce000 con 0x7f71bc0cdb60 2023-05-10T04:20:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.096+0000 7f71aaffd700 1 -- 172.21.15.132:0/3846994004 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f71b401d3b0 con 0x7f71bc0cdb60 2023-05-10T04:20:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.097+0000 7f71aaffd700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f719c06ace0 0x7f719c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.097+0000 7f71aaffd700 1 -- 172.21.15.132:0/3846994004 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f71b4089420 con 0x7f71bc0cdb60 2023-05-10T04:20:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.097+0000 7f71ba59c700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f719c06ace0 0x7f719c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.098+0000 7f71ba59c700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f719c06ace0 0x7f719c06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0c5a90 tx=0x7f71ac008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:40.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.102+0000 7f71aaffd700 1 -- 172.21.15.132:0/3846994004 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f71b40541e0 con 0x7f71bc0cdb60 2023-05-10T04:20:40.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.341+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71bc1585e0 con 0x7f71bc0cdb60 2023-05-10T04:20:40.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.342+0000 7f71aaffd700 1 -- 172.21.15.132:0/3846994004 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7f71b4057800 con 0x7f71bc0cdb60 2023-05-10T04:20:40.344 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:40.344 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:31.478753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-10T04:20:40.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f719c06ace0 msgr2=0x7f719c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f719c06ace0 0x7f719c06d190 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f71bc0c5a90 tx=0x7f71ac008030 comp rx=0 tx=0).stop 2023-05-10T04:20:40.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cdb60 msgr2=0x7f71bc0c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cdb60 0x7f71bc0c4ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f71b400b970 tx=0x7f71b400bd30 comp rx=0 tx=0).stop 2023-05-10T04:20:40.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 shutdown_connections 2023-05-10T04:20:40.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f719c06ace0 0x7f719c06d190 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71bc0cdb60 0x7f71bc0c4ce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f71bc0b1b80 0x7f71bc1e6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 --2- 172.21.15.132:0/3846994004 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f71bc0cd790 0x7f71bc15ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 >> 172.21.15.132:0/3846994004 conn(0x7f71bc06e980 msgr2=0x7f71bc0ca8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:40.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 shutdown_connections 2023-05-10T04:20:40.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.345+0000 7f71c0dff700 1 -- 172.21.15.132:0/3846994004 wait complete. 2023-05-10T04:20:40.348 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2023-05-10T04:20:40.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:20:40.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.545+0000 7fe2e95ff700 1 Processor -- start 2023-05-10T04:20:40.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.545+0000 7fe2e95ff700 1 -- start start 2023-05-10T04:20:40.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e95ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e4071200 0x7fe2e4165340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e95ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e40cb280 con 0x7fe2e415a5a0 2023-05-10T04:20:40.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e95ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e4071700 con 0x7fe2e406aaf0 2023-05-10T04:20:40.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e95ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e415a970 con 0x7fe2e4071200 2023-05-10T04:20:40.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e2ffd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe2e415a5a0 0x7fe2e406a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46960/0 (socket says 172.21.15.132:46960) 2023-05-10T04:20:40.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e2ffd700 1 -- 172.21.15.132:0/245312388 learned_addr learned my addr 172.21.15.132:0/245312388 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:40.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e37fe700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e4071200 0x7fe2e4165340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399758204 0 0) 0x7fe2d4001110 con 0x7fe2e415a5a0 2023-05-10T04:20:40.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.547+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d00035b0 con 0x7fe2e415a5a0 2023-05-10T04:20:40.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 634401864 0 0) 0x7fe2e4071700 con 0x7fe2e406aaf0 2023-05-10T04:20:40.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2d4001110 con 0x7fe2e406aaf0 2023-05-10T04:20:40.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000524773 0 0) 0x7fe2d00035b0 con 0x7fe2e415a5a0 2023-05-10T04:20:40.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e4071200 msgr2=0x7fe2e4165340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:40.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e4071200 0x7fe2e4165340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 >> v1:172.21.15.154:6789/0 conn(0x7fe2e406aaf0 legacy=0x7fe2e4070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e40719e0 con 0x7fe2e415a5a0 2023-05-10T04:20:40.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7fe2d4001800 con 0x7fe2e415a5a0 2023-05-10T04:20:40.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 >> v1:172.21.15.132:6789/0 conn(0x7fe2e415a5a0 legacy=0x7fe2e406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0003bc0 0x7fe2d0003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2d0004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e4071200 0x7fe2d0005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e415a970 con 0x7fe2d0004850 2023-05-10T04:20:40.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d000bac0 con 0x7fe2d0003bc0 2023-05-10T04:20:40.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d000bc30 con 0x7fe2e4071200 2023-05-10T04:20:40.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2dbfff700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2d0004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e2ffd700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0003bc0 0x7fe2d0003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2e37fe700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e4071200 0x7fe2d0005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2dbfff700 1 -- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e4071200 msgr2=0x7fe2d0005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:40.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2dbfff700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e4071200 0x7fe2d0005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2dbfff700 1 -- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0003bc0 msgr2=0x7fe2d0003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:40.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2dbfff700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2d0003bc0 0x7fe2d0003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.548+0000 7fe2dbfff700 1 -- 172.21.15.132:0/245312388 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00035b0 con 0x7fe2d0004850 2023-05-10T04:20:40.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.549+0000 7fe2dbfff700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2d0004cc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0019a0 tx=0x7fe2d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e789f01a83c0b6cc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:40.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.549+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc001dd0 con 0x7fe2d0004850 2023-05-10T04:20:40.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.549+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0052d0 con 0x7fe2d0004850 2023-05-10T04:20:40.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.549+0000 7fe2e27fc700 1 -- 172.21.15.132:0/245312388 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc001460 con 0x7fe2d0004850 2023-05-10T04:20:40.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.549+0000 7fe2e95ff700 1 -- 172.21.15.132:0/245312388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 msgr2=0x7fe2d0004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.549+0000 7fe2e95ff700 1 --2- 172.21.15.132:0/245312388 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2d0004cc0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0019a0 tx=0x7fe2d0005880 comp rx=0 tx=0).stop 2023-05-10T04:20:40.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.549+0000 7fe2e37fe700 1 -- 172.21.15.132:0/245312388 reap_dead start 2023-05-10T04:20:40.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.550+0000 7fe2e95ff700 1 -- 172.21.15.132:0/245312388 shutdown_connections 2023-05-10T04:20:40.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.550+0000 7fe2e95ff700 1 -- 172.21.15.132:0/245312388 >> 172.21.15.132:0/245312388 conn(0x7fe2e40cf720 msgr2=0x7fe2e40cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:40.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.550+0000 7fe2e95ff700 1 -- 172.21.15.132:0/245312388 shutdown_connections 2023-05-10T04:20:40.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.550+0000 7fe2e95ff700 1 -- 172.21.15.132:0/245312388 wait complete. 2023-05-10T04:20:40.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.551+0000 7fe2e95ff700 1 Processor -- start 2023-05-10T04:20:40.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.552+0000 7fe2e95ff700 1 -- start start 2023-05-10T04:20:40.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.552+0000 7fe2e95ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2e41439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.552+0000 7fe2e95ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e415c880 0x7fe2e40af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.552+0000 7fe2e95ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e41f5250 0x7fe2e40afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.552+0000 7fe2e95ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e4143f20 con 0x7fe2d0004850 2023-05-10T04:20:40.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.552+0000 7fe2e95ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e415cd20 con 0x7fe2e41f5250 2023-05-10T04:20:40.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.552+0000 7fe2e95ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e415d000 con 0x7fe2e415c880 2023-05-10T04:20:40.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2e41439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2e41439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41292/0 (socket says 172.21.15.132:41292) 2023-05-10T04:20:40.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 -- 172.21.15.132:0/2566557342 learned_addr learned my addr 172.21.15.132:0/2566557342 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:40.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e37fe700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e41f5250 0x7fe2e40afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2dbfff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e415c880 0x7fe2e40af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 -- 172.21.15.132:0/2566557342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e415c880 msgr2=0x7fe2e40af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e415c880 0x7fe2e40af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 -- 172.21.15.132:0/2566557342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e41f5250 msgr2=0x7fe2e40afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e41f5250 0x7fe2e40afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 -- 172.21.15.132:0/2566557342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e406c9a0 con 0x7fe2d0004850 2023-05-10T04:20:40.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2e2ffd700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2e41439e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4007310 tx=0x7fe2d40076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:40.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2db7fe700 1 -- 172.21.15.132:0/2566557342 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400f870 con 0x7fe2d0004850 2023-05-10T04:20:40.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2db7fe700 1 -- 172.21.15.132:0/2566557342 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2d400f9d0 con 0x7fe2d0004850 2023-05-10T04:20:40.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.553+0000 7fe2db7fe700 1 -- 172.21.15.132:0/2566557342 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2d400fd60 con 0x7fe2d0004850 2023-05-10T04:20:40.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.554+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e406c6c0 con 0x7fe2d0004850 2023-05-10T04:20:40.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.554+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e406cc80 con 0x7fe2d0004850 2023-05-10T04:20:40.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.555+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e40cbcf0 con 0x7fe2d0004850 2023-05-10T04:20:40.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.555+0000 7fe2db7fe700 1 -- 172.21.15.132:0/2566557342 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2d401d460 con 0x7fe2d0004850 2023-05-10T04:20:40.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.556+0000 7fe2db7fe700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2c406ad10 0x7fe2c406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:40.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.556+0000 7fe2db7fe700 1 -- 172.21.15.132:0/2566557342 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe2d4089850 con 0x7fe2d0004850 2023-05-10T04:20:40.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.556+0000 7fe2dbfff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2c406ad10 0x7fe2c406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:40.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.557+0000 7fe2dbfff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2c406ad10 0x7fe2c406d1c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc008fd0 tx=0x7fe2cc00a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:40.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.561+0000 7fe2db7fe700 1 -- 172.21.15.132:0/2566557342 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe2d4054580 con 0x7fe2d0004850 2023-05-10T04:20:40.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.802+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe2e40cb280 con 0x7fe2d0004850 2023-05-10T04:20:40.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.803+0000 7fe2db7fe700 1 -- 172.21.15.132:0/2566557342 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4670 (secure 0 0 0) 0x7fe2e40cb280 con 0x7fe2d0004850 2023-05-10T04:20:40.805 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:40.805 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/959179154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":959179154},{"type":"v1","addr":"172.21.15.132:6837","nonce":959179154}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/1192168619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":1192168619},{"type":"v1","addr":"172.21.15.154:6834","nonce":1192168619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1806534797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1806534797},{"type":"v1","addr":"172.21.15.132:6836","nonce":1806534797}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:19:09.944202+0000","modified":"2023-05-10T04:19:31.478753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4315},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4315":{"gid":4315,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.154:6835/36374977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":36374977},{"type":"v1","addr":"172.21.15.154:6835","nonce":36374977}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-10T04:20:40.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.805+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2c406ad10 msgr2=0x7fe2c406d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.805+0000 7fe2e95ff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2c406ad10 0x7fe2c406d1c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc008fd0 tx=0x7fe2cc00a000 comp rx=0 tx=0).stop 2023-05-10T04:20:40.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.805+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 msgr2=0x7fe2e41439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:40.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.805+0000 7fe2e95ff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2e41439e0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4007310 tx=0x7fe2d40076d0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.805+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 shutdown_connections 2023-05-10T04:20:40.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.805+0000 7fe2e95ff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2c406ad10 0x7fe2c406d1c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.805+0000 7fe2e95ff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2e41f5250 0x7fe2e40afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.806+0000 7fe2e95ff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2d0004850 0x7fe2e41439e0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.806+0000 7fe2e95ff700 1 --2- 172.21.15.132:0/2566557342 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2e415c880 0x7fe2e40af7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:40.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.806+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 >> 172.21.15.132:0/2566557342 conn(0x7fe2e40cf720 msgr2=0x7fe2e40acad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:40.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.806+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 shutdown_connections 2023-05-10T04:20:40.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:40.806+0000 7fe2e95ff700 1 -- 172.21.15.132:0/2566557342 wait complete. 2023-05-10T04:20:40.810 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2023-05-10T04:20:40.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:41.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.005+0000 7f12411ff700 1 Processor -- start 2023-05-10T04:20:41.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.005+0000 7f12411ff700 1 -- start start 2023-05-10T04:20:41.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.006+0000 7f12411ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f123c0b87a0 0x7f123c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.006+0000 7f12411ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f123c160d40 0x7f123c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.006+0000 7f12411ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123c0cdc60 con 0x7f123c1601e0 2023-05-10T04:20:41.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.006+0000 7f12411ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0d02d0 con 0x7f123c160d40 2023-05-10T04:20:41.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.006+0000 7f12411ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123c0d0cb0 con 0x7f123c0b87a0 2023-05-10T04:20:41.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123b59e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f123c160d40 0x7f123c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123b59e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f123c160d40 0x7f123c0d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41298/0 (socket says 172.21.15.132:41298) 2023-05-10T04:20:41.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123b59e700 1 -- 172.21.15.132:0/4122099505 learned_addr learned my addr 172.21.15.132:0/4122099505 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:41.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123ad9d700 1 --2- 172.21.15.132:0/4122099505 >> v2:172.21.15.154:3300/0 conn(0x7f123c0b87a0 0x7f123c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123b59e700 1 -- 172.21.15.132:0/4122099505 >> v2:172.21.15.154:3300/0 conn(0x7f123c0b87a0 msgr2=0x7f123c0cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:41.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123b59e700 1 --2- 172.21.15.132:0/4122099505 >> v2:172.21.15.154:3300/0 conn(0x7f123c0b87a0 0x7f123c0cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123b59e700 1 -- 172.21.15.132:0/4122099505 >> v1:172.21.15.132:6789/0 conn(0x7f123c1601e0 legacy=0x7f123c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123b59e700 1 -- 172.21.15.132:0/4122099505 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c0cd6a0 con 0x7f123c160d40 2023-05-10T04:20:41.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f1239d9b700 1 -- 172.21.15.132:0/4122099505 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364553792 0 0) 0x7f123c0cdc60 con 0x7f123c1601e0 2023-05-10T04:20:41.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123ad9d700 1 --2- 172.21.15.132:0/4122099505 >> v2:172.21.15.154:3300/0 conn(0x7f123c0b87a0 0x7f123c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:41.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.007+0000 7f123b59e700 1 --2- 172.21.15.132:0/4122099505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c160d40 0x7f123c0d1100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f123c0b4ac0 tx=0x7f123400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67add2cceb1f88da server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f1239d9b700 1 -- 172.21.15.132:0/4122099505 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400e070 con 0x7f123c160d40 2023-05-10T04:20:41.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f1239d9b700 1 -- 172.21.15.132:0/4122099505 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f123400b980 con 0x7f123c160d40 2023-05-10T04:20:41.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f1239d9b700 1 -- 172.21.15.132:0/4122099505 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f123400bd30 con 0x7f123c160d40 2023-05-10T04:20:41.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f12411ff700 1 -- 172.21.15.132:0/4122099505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c160d40 msgr2=0x7f123c0d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f12411ff700 1 --2- 172.21.15.132:0/4122099505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c160d40 0x7f123c0d1100 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f123c0b4ac0 tx=0x7f123400b330 comp rx=0 tx=0).stop 2023-05-10T04:20:41.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f12411ff700 1 -- 172.21.15.132:0/4122099505 shutdown_connections 2023-05-10T04:20:41.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f12411ff700 1 --2- 172.21.15.132:0/4122099505 >> v2:172.21.15.154:3300/0 conn(0x7f123c0b87a0 0x7f123c0cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f12411ff700 1 --2- 172.21.15.132:0/4122099505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c160d40 0x7f123c0d1100 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f12411ff700 1 -- 172.21.15.132:0/4122099505 >> 172.21.15.132:0/4122099505 conn(0x7f123c071b10 msgr2=0x7f123c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:41.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f12411ff700 1 -- 172.21.15.132:0/4122099505 shutdown_connections 2023-05-10T04:20:41.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.008+0000 7f12411ff700 1 -- 172.21.15.132:0/4122099505 wait complete. 2023-05-10T04:20:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.010+0000 7f12411ff700 1 Processor -- start 2023-05-10T04:20:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.010+0000 7f12411ff700 1 -- start start 2023-05-10T04:20:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f12411ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123c0b87a0 0x7f123c1e6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f12411ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c1601e0 0x7f123c151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f12411ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c160d40 0x7f123c1e7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f12411ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1e6760 con 0x7f123c1601e0 2023-05-10T04:20:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f12411ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1e83d0 con 0x7f123c160d40 2023-05-10T04:20:41.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f12411ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f123c1e80f0 con 0x7f123c0b87a0 2023-05-10T04:20:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f123a59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c1601e0 0x7f123c151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f123a59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c1601e0 0x7f123c151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41302/0 (socket says 172.21.15.132:41302) 2023-05-10T04:20:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f123a59c700 1 -- 172.21.15.132:0/561421269 learned_addr learned my addr 172.21.15.132:0/561421269 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.011+0000 7f123ad9d700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123c0b87a0 0x7f123c1e6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f123b59e700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c160d40 0x7f123c1e7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f123a59c700 1 -- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123c0b87a0 msgr2=0x7f123c1e6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f123a59c700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123c0b87a0 0x7f123c1e6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f123a59c700 1 -- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c160d40 msgr2=0x7f123c1e7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f123a59c700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c160d40 0x7f123c1e7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f123a59c700 1 -- 172.21.15.132:0/561421269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1234009b30 con 0x7f123c1601e0 2023-05-10T04:20:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f123b59e700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c160d40 0x7f123c1e7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f123a59c700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c1601e0 0x7f123c151450 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f12300011e0 tx=0x7f123000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f12237fe700 1 -- 172.21.15.132:0/561421269 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12300054e0 con 0x7f123c1601e0 2023-05-10T04:20:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f12237fe700 1 -- 172.21.15.132:0/561421269 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1230003680 con 0x7f123c1601e0 2023-05-10T04:20:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f12237fe700 1 -- 172.21.15.132:0/561421269 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1230003a30 con 0x7f123c1601e0 2023-05-10T04:20:41.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f123c0d1640 con 0x7f123c1601e0 2023-05-10T04:20:41.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.012+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f123c0cd980 con 0x7f123c1601e0 2023-05-10T04:20:41.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.013+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123c0d17d0 con 0x7f123c1601e0 2023-05-10T04:20:41.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.014+0000 7f12237fe700 1 -- 172.21.15.132:0/561421269 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1230003b90 con 0x7f123c1601e0 2023-05-10T04:20:41.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.015+0000 7f12237fe700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f122806ace0 0x7f122806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.015+0000 7f12237fe700 1 -- 172.21.15.132:0/561421269 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1230088ce0 con 0x7f123c1601e0 2023-05-10T04:20:41.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.015+0000 7f123ad9d700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f122806ace0 0x7f122806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.016+0000 7f123ad9d700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f122806ace0 0x7f122806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f122c006fd0 tx=0x7f122c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.019+0000 7f12237fe700 1 -- 172.21.15.132:0/561421269 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1230053a90 con 0x7f123c1601e0 2023-05-10T04:20:41.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.218+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f123c074430 con 0x7f123c1601e0 2023-05-10T04:20:41.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.219+0000 7f12237fe700 1 -- 172.21.15.132:0/561421269 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+20254 (secure 0 0 0) 0x7f12300570b0 con 0x7f123c1601e0 2023-05-10T04:20:41.222 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:41.222 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:19:14.463021+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:19:08.301407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-10T04:19:08.922877+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-05-10T04:19:11.995669+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:41.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f122806ace0 msgr2=0x7f122806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f122806ace0 0x7f122806d190 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f122c006fd0 tx=0x7f122c008040 comp rx=0 tx=0).stop 2023-05-10T04:20:41.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c1601e0 msgr2=0x7f123c151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c1601e0 0x7f123c151450 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f12300011e0 tx=0x7f123000cae0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 shutdown_connections 2023-05-10T04:20:41.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f122806ace0 0x7f122806d190 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f123c160d40 0x7f123c1e7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f123c0b87a0 0x7f123c1e6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 --2- 172.21.15.132:0/561421269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f123c1601e0 0x7f123c151450 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 >> 172.21.15.132:0/561421269 conn(0x7f123c071b10 msgr2=0x7f123c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:41.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 shutdown_connections 2023-05-10T04:20:41.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.222+0000 7f12411ff700 1 -- 172.21.15.132:0/561421269 wait complete. 2023-05-10T04:20:41.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-10T04:20:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.425+0000 7fb8581ff700 1 Processor -- start 2023-05-10T04:20:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.425+0000 7fb8581ff700 1 -- start start 2023-05-10T04:20:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.426+0000 7fb8581ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb85006b4f0 0x7fb85006b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.426+0000 7fb8581ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8500cbf90 0x7fb8500cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.426+0000 7fb8581ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8500b26f0 con 0x7fb8500d0130 2023-05-10T04:20:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.426+0000 7fb8581ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85006be00 con 0x7fb8500cbf90 2023-05-10T04:20:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.426+0000 7fb8581ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500cfb60 con 0x7fb85006b4f0 2023-05-10T04:20:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.426+0000 7fb85679c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8500cbf90 0x7fb8500cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.426+0000 7fb85679c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb8500cbf90 0x7fb8500cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41308/0 (socket says 172.21.15.132:41308) 2023-05-10T04:20:41.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.426+0000 7fb85679c700 1 -- 172.21.15.132:0/689177832 learned_addr learned my addr 172.21.15.132:0/689177832 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:41.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.427+0000 7fb85679c700 1 -- 172.21.15.132:0/689177832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb85006b4f0 msgr2=0x7fb85006b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.427+0000 7fb85679c700 1 --2- 172.21.15.132:0/689177832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb85006b4f0 0x7fb85006b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.427+0000 7fb85679c700 1 -- 172.21.15.132:0/689177832 >> v1:172.21.15.154:6789/0 conn(0x7fb8500d0130 legacy=0x7fb8500cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:41.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.427+0000 7fb85679c700 1 -- 172.21.15.132:0/689177832 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500cfe40 con 0x7fb8500cbf90 2023-05-10T04:20:41.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.427+0000 7fb85679c700 1 --2- 172.21.15.132:0/689177832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500cc410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb848009e50 tx=0x7fb84800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322e895ed1c0093c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.427+0000 7fb854f99700 1 -- 172.21.15.132:0/689177832 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800e070 con 0x7fb8500cbf90 2023-05-10T04:20:41.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.427+0000 7fb854f99700 1 -- 172.21.15.132:0/689177832 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb848003a20 con 0x7fb8500cbf90 2023-05-10T04:20:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.427+0000 7fb854f99700 1 -- 172.21.15.132:0/689177832 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb848003dd0 con 0x7fb8500cbf90 2023-05-10T04:20:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.428+0000 7fb8581ff700 1 -- 172.21.15.132:0/689177832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 msgr2=0x7fb8500cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.428+0000 7fb8581ff700 1 --2- 172.21.15.132:0/689177832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500cc410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb848009e50 tx=0x7fb84800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.428+0000 7fb8581ff700 1 -- 172.21.15.132:0/689177832 shutdown_connections 2023-05-10T04:20:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.428+0000 7fb8581ff700 1 --2- 172.21.15.132:0/689177832 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb85006b4f0 0x7fb85006b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.428+0000 7fb8581ff700 1 --2- 172.21.15.132:0/689177832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500cc410 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.428+0000 7fb8581ff700 1 -- 172.21.15.132:0/689177832 >> 172.21.15.132:0/689177832 conn(0x7fb85009a090 msgr2=0x7fb8500d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:41.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.428+0000 7fb8581ff700 1 -- 172.21.15.132:0/689177832 shutdown_connections 2023-05-10T04:20:41.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.428+0000 7fb8581ff700 1 -- 172.21.15.132:0/689177832 wait complete. 2023-05-10T04:20:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.430+0000 7fb8581ff700 1 Processor -- start 2023-05-10T04:20:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.430+0000 7fb8581ff700 1 -- start start 2023-05-10T04:20:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb8581ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85006b4f0 0x7fb850148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb8581ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb8581ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8500d0130 0x7fb8500cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb8581ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8501490a0 con 0x7fb8500cbf90 2023-05-10T04:20:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb8581ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c9140 con 0x7fb85006b4f0 2023-05-10T04:20:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb8581ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c9420 con 0x7fb8500d0130 2023-05-10T04:20:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85579a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85579a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500c8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41314/0 (socket says 172.21.15.132:41314) 2023-05-10T04:20:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85579a700 1 -- 172.21.15.132:0/2618985094 learned_addr learned my addr 172.21.15.132:0/2618985094 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:41.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb855f9b700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85006b4f0 0x7fb850148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85679c700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8500d0130 0x7fb8500cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85579a700 1 -- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8500d0130 msgr2=0x7fb8500cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85579a700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8500d0130 0x7fb8500cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85579a700 1 -- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85006b4f0 msgr2=0x7fb850148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85579a700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85006b4f0 0x7fb850148b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb85579a700 1 -- 172.21.15.132:0/2618985094 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb848009b30 con 0x7fb8500cbf90 2023-05-10T04:20:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.431+0000 7fb855f9b700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85006b4f0 0x7fb850148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.432+0000 7fb85579a700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500c8830 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b470 tx=0x7fb84000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.432+0000 7fb8467fc700 1 -- 172.21.15.132:0/2618985094 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840011830 con 0x7fb8500cbf90 2023-05-10T04:20:41.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.432+0000 7fb8467fc700 1 -- 172.21.15.132:0/2618985094 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8400119b0 con 0x7fb8500cbf90 2023-05-10T04:20:41.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.432+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8500cb790 con 0x7fb8500cbf90 2023-05-10T04:20:41.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.432+0000 7fb8467fc700 1 -- 172.21.15.132:0/2618985094 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840011d60 con 0x7fb8500cbf90 2023-05-10T04:20:41.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.432+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8500cb4b0 con 0x7fb8500cbf90 2023-05-10T04:20:41.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.433+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8500cba70 con 0x7fb8500cbf90 2023-05-10T04:20:41.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.434+0000 7fb8467fc700 1 -- 172.21.15.132:0/2618985094 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb84001a400 con 0x7fb8500cbf90 2023-05-10T04:20:41.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.435+0000 7fb8467fc700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb83406ace0 0x7fb83406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.435+0000 7fb8467fc700 1 -- 172.21.15.132:0/2618985094 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb840089800 con 0x7fb8500cbf90 2023-05-10T04:20:41.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.435+0000 7fb855f9b700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb83406ace0 0x7fb83406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.436+0000 7fb855f9b700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb83406ace0 0x7fb83406d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0099d0 tx=0x7fb84c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.439+0000 7fb8467fc700 1 -- 172.21.15.132:0/2618985094 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fb840054520 con 0x7fb8500cbf90 2023-05-10T04:20:41.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.678+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb850074430 con 0x7fb8500cbf90 2023-05-10T04:20:41.744 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-05-10T04:20:41.741+0000 7f9e78ff9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-10T04:20:41.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.747+0000 7fb8467fc700 1 -- 172.21.15.132:0/2618985094 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb840057b40 con 0x7fb8500cbf90 2023-05-10T04:20:41.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb83406ace0 msgr2=0x7fb83406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb83406ace0 0x7fb83406d190 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0099d0 tx=0x7fb84c008040 comp rx=0 tx=0).stop 2023-05-10T04:20:41.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 msgr2=0x7fb8500c8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500c8830 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb84000b470 tx=0x7fb84000b780 comp rx=0 tx=0).stop 2023-05-10T04:20:41.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 shutdown_connections 2023-05-10T04:20:41.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fb83406ace0 0x7fb83406d190 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fb8500d0130 0x7fb8500cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fb85006b4f0 0x7fb850148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 --2- 172.21.15.132:0/2618985094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8500cbf90 0x7fb8500c8830 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 >> 172.21.15.132:0/2618985094 conn(0x7fb85009a090 msgr2=0x7fb85006f900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:41.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 shutdown_connections 2023-05-10T04:20:41.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.750+0000 7fb8581ff700 1 -- 172.21.15.132:0/2618985094 wait complete. 2023-05-10T04:20:41.754 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-10T04:20:41.760 INFO:tasks.ceph.mds.b.smithi154.stderr: -5911> 2023-05-10T04:19:15.628+0000 7f111ddf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T04:20:41.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-10T04:20:41.813 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-05-10T04:20:41.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.953+0000 7f186ebff700 1 Processor -- start 2023-05-10T04:20:41.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.954+0000 7f186ebff700 1 -- start start 2023-05-10T04:20:41.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f186ebff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f18680ccfa0 0x7f18681676c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f186ebff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18680b26f0 con 0x7f18680d0130 2023-05-10T04:20:41.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f186ebff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18680cfb60 con 0x7f186806b4f0 2023-05-10T04:20:41.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f186ebff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18680cfe40 con 0x7f18680ccfa0 2023-05-10T04:20:41.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f1867fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f18680d0130 0x7f18680cf350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46986/0 (socket says 172.21.15.132:46986) 2023-05-10T04:20:41.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f1867fff700 1 -- 172.21.15.132:0/345396815 learned_addr learned my addr 172.21.15.132:0/345396815 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:41.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f186d19c700 1 --2- 172.21.15.132:0/345396815 >> v2:172.21.15.154:3300/0 conn(0x7f18680ccfa0 0x7f18681676c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f18677fe700 1 -- 172.21.15.132:0/345396815 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919711899 0 0) 0x7f18680b26f0 con 0x7f18680d0130 2023-05-10T04:20:41.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f18677fe700 1 -- 172.21.15.132:0/345396815 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18580035b0 con 0x7f18680d0130 2023-05-10T04:20:41.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f18677fe700 1 -- 172.21.15.132:0/345396815 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 119795803 0 0) 0x7f18680cfb60 con 0x7f186806b4f0 2023-05-10T04:20:41.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.955+0000 7f18677fe700 1 -- 172.21.15.132:0/345396815 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18680b26f0 con 0x7f186806b4f0 2023-05-10T04:20:41.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.956+0000 7f186d19c700 1 -- 172.21.15.132:0/345396815 >> v1:172.21.15.154:6789/0 conn(0x7f186806b4f0 legacy=0x7f186806b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.956+0000 7f186d19c700 1 -- 172.21.15.132:0/345396815 >> v1:172.21.15.132:6789/0 conn(0x7f18680d0130 legacy=0x7f18680cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.956+0000 7f186d19c700 1 -- 172.21.15.132:0/345396815 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18680cb4b0 con 0x7f18680ccfa0 2023-05-10T04:20:41.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.956+0000 7f186d19c700 1 --2- 172.21.15.132:0/345396815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 0x7f18681676c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1860009dc0 tx=0x7f186000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2bdf1d2bdaa5910 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.956+0000 7f18677fe700 1 -- 172.21.15.132:0/345396815 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186000e070 con 0x7f18680ccfa0 2023-05-10T04:20:41.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.956+0000 7f18677fe700 1 -- 172.21.15.132:0/345396815 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f186000bae0 con 0x7f18680ccfa0 2023-05-10T04:20:41.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.956+0000 7f18677fe700 1 -- 172.21.15.132:0/345396815 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f186000be90 con 0x7f18680ccfa0 2023-05-10T04:20:41.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.957+0000 7f186ebff700 1 -- 172.21.15.132:0/345396815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 msgr2=0x7f18681676c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.957+0000 7f186ebff700 1 --2- 172.21.15.132:0/345396815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 0x7f18681676c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1860009dc0 tx=0x7f186000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:41.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.957+0000 7f186ebff700 1 -- 172.21.15.132:0/345396815 shutdown_connections 2023-05-10T04:20:41.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.957+0000 7f186ebff700 1 --2- 172.21.15.132:0/345396815 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 0x7f18681676c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.957+0000 7f186ebff700 1 -- 172.21.15.132:0/345396815 >> 172.21.15.132:0/345396815 conn(0x7f186809a090 msgr2=0x7f18680d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:41.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.957+0000 7f186ebff700 1 -- 172.21.15.132:0/345396815 shutdown_connections 2023-05-10T04:20:41.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.957+0000 7f186ebff700 1 -- 172.21.15.132:0/345396815 wait complete. 2023-05-10T04:20:41.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.958+0000 7f186ebff700 1 Processor -- start 2023-05-10T04:20:41.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.959+0000 7f186ebff700 1 -- start start 2023-05-10T04:20:41.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.959+0000 7f186ebff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f186806b4f0 0x7f186815bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.959+0000 7f186ebff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 0x7f18680c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186ebff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18680d0130 0x7f18681e5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186ebff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c53a0 con 0x7f186806b4f0 2023-05-10T04:20:41.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186ebff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186815c500 con 0x7f18680ccfa0 2023-05-10T04:20:41.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186ebff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18680c5640 con 0x7f18680d0130 2023-05-10T04:20:41.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f186806b4f0 0x7f186815bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f186806b4f0 0x7f186815bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41324/0 (socket says 172.21.15.132:41324) 2023-05-10T04:20:41.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 -- 172.21.15.132:0/273074158 learned_addr learned my addr 172.21.15.132:0/273074158 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:41.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186d19c700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18680d0130 0x7f18681e5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f1867fff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 0x7f18680c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 -- 172.21.15.132:0/273074158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18680d0130 msgr2=0x7f18681e5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18680d0130 0x7f18681e5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 -- 172.21.15.132:0/273074158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 msgr2=0x7f18680c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:41.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 0x7f18680c6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:41.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 -- 172.21.15.132:0/273074158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1860009a70 con 0x7f186806b4f0 2023-05-10T04:20:41.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.960+0000 7f186c99b700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f186806b4f0 0x7f186815bfc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f185c00c500 tx=0x7f185c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.961+0000 7f18657fa700 1 -- 172.21.15.132:0/273074158 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0052d0 con 0x7f186806b4f0 2023-05-10T04:20:41.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.961+0000 7f18657fa700 1 -- 172.21.15.132:0/273074158 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185c005450 con 0x7f186806b4f0 2023-05-10T04:20:41.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.961+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18680cba70 con 0x7f186806b4f0 2023-05-10T04:20:41.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.961+0000 7f18657fa700 1 -- 172.21.15.132:0/273074158 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185c0038c0 con 0x7f186806b4f0 2023-05-10T04:20:41.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.961+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18680cb790 con 0x7f186806b4f0 2023-05-10T04:20:41.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.962+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186815ced0 con 0x7f186806b4f0 2023-05-10T04:20:41.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.963+0000 7f18657fa700 1 -- 172.21.15.132:0/273074158 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f185c003a20 con 0x7f186806b4f0 2023-05-10T04:20:41.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.964+0000 7f18657fa700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f184c06ace0 0x7f184c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:41.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.964+0000 7f18657fa700 1 -- 172.21.15.132:0/273074158 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6899+0+0 (secure 0 0 0) 0x7f185c088b90 con 0x7f186806b4f0 2023-05-10T04:20:41.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.964+0000 7f1867fff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f184c06ace0 0x7f184c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:41.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.965+0000 7f1867fff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f184c06ace0 0x7f184c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f18681f5740 tx=0x7f1854007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:41.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:41.968+0000 7f18657fa700 1 -- 172.21.15.132:0/273074158 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f185c0538e0 con 0x7f186806b4f0 2023-05-10T04:20:42.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.214+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f18680b2ea0 con 0x7f186806b4f0 2023-05-10T04:20:42.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.755+0000 7f18657fa700 1 -- 172.21.15.132:0/273074158 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f185c056f00 con 0x7f186806b4f0 2023-05-10T04:20:42.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f184c06ace0 msgr2=0x7f184c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:42.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f184c06ace0 0x7f184c06d190 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f18681f5740 tx=0x7f1854007dc0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f186806b4f0 msgr2=0x7f186815bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:42.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f186806b4f0 0x7f186815bfc0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f185c00c500 tx=0x7f185c00c810 comp rx=0 tx=0).stop 2023-05-10T04:20:42.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 shutdown_connections 2023-05-10T04:20:42.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f184c06ace0 0x7f184c06d190 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f18680d0130 0x7f18681e5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f186806b4f0 0x7f186815bfc0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 --2- 172.21.15.132:0/273074158 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f18680ccfa0 0x7f18680c6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 >> 172.21.15.132:0/273074158 conn(0x7f186809a090 msgr2=0x7f18681e7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:42.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 shutdown_connections 2023-05-10T04:20:42.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.757+0000 7f186ebff700 1 -- 172.21.15.132:0/273074158 wait complete. 2023-05-10T04:20:42.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-10T04:20:42.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.965+0000 7fec391ff700 1 Processor -- start 2023-05-10T04:20:42.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.965+0000 7fec391ff700 1 -- start start 2023-05-10T04:20:42.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec391ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3415a5a0 0x7fec3406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:42.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec391ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec34071200 0x7fec3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:42.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec391ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec340cb280 con 0x7fec3406a920 2023-05-10T04:20:42.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec391ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec3415a970 con 0x7fec34071200 2023-05-10T04:20:42.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec391ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec3406ad90 con 0x7fec3415a5a0 2023-05-10T04:20:42.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec3359e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec34071200 0x7fec3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:42.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec3359e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec34071200 0x7fec3406d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38686/0 (socket says 172.21.15.132:38686) 2023-05-10T04:20:42.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec3359e700 1 -- 172.21.15.132:0/1801436652 learned_addr learned my addr 172.21.15.132:0/1801436652 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:42.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec2bfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fec3406a920 0x7fec34070af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53046/0 (socket says 172.21.15.132:53046) 2023-05-10T04:20:42.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec32d9d700 1 --2- 172.21.15.132:0/1801436652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3415a5a0 0x7fec3406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:42.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec3359e700 1 -- 172.21.15.132:0/1801436652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3415a5a0 msgr2=0x7fec3406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:42.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec3359e700 1 --2- 172.21.15.132:0/1801436652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3415a5a0 0x7fec3406a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec3359e700 1 -- 172.21.15.132:0/1801436652 >> v1:172.21.15.132:6789/0 conn(0x7fec3406a920 legacy=0x7fec34070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:42.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec3259c700 1 -- 172.21.15.132:0/1801436652 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2381457660 0 0) 0x7fec1c0011d0 con 0x7fec3406a920 2023-05-10T04:20:42.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.967+0000 7fec3359e700 1 -- 172.21.15.132:0/1801436652 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec34071700 con 0x7fec34071200 2023-05-10T04:20:42.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.968+0000 7fec3359e700 1 --2- 172.21.15.132:0/1801436652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec34071200 0x7fec3406d1a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009e50 tx=0x7fec2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fb4bbf506c1e8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:42.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.968+0000 7fec3259c700 1 -- 172.21.15.132:0/1801436652 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00e070 con 0x7fec34071200 2023-05-10T04:20:42.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.968+0000 7fec3259c700 1 -- 172.21.15.132:0/1801436652 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c00b910 con 0x7fec34071200 2023-05-10T04:20:42.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.968+0000 7fec3259c700 1 -- 172.21.15.132:0/1801436652 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c00bcc0 con 0x7fec34071200 2023-05-10T04:20:42.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.968+0000 7fec391ff700 1 -- 172.21.15.132:0/1801436652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec34071200 msgr2=0x7fec3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:42.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.968+0000 7fec391ff700 1 --2- 172.21.15.132:0/1801436652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec34071200 0x7fec3406d1a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009e50 tx=0x7fec2c00b330 comp rx=0 tx=0).stop 2023-05-10T04:20:42.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.968+0000 7fec391ff700 1 -- 172.21.15.132:0/1801436652 shutdown_connections 2023-05-10T04:20:42.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.968+0000 7fec391ff700 1 --2- 172.21.15.132:0/1801436652 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3415a5a0 0x7fec3406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.969+0000 7fec391ff700 1 --2- 172.21.15.132:0/1801436652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec34071200 0x7fec3406d1a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.969+0000 7fec391ff700 1 -- 172.21.15.132:0/1801436652 >> 172.21.15.132:0/1801436652 conn(0x7fec340cf720 msgr2=0x7fec340cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:42.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.969+0000 7fec391ff700 1 -- 172.21.15.132:0/1801436652 shutdown_connections 2023-05-10T04:20:42.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.969+0000 7fec391ff700 1 -- 172.21.15.132:0/1801436652 wait complete. 2023-05-10T04:20:42.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.970+0000 7fec391ff700 1 Processor -- start 2023-05-10T04:20:42.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.970+0000 7fec391ff700 1 -- start start 2023-05-10T04:20:42.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.971+0000 7fec391ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a920 0x7fec34158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:42.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.971+0000 7fec391ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec34071200 0x7fec340b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:42.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.971+0000 7fec391ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec3415a5a0 0x7fec340b3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:42.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.971+0000 7fec391ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec34154540 con 0x7fec3415a5a0 2023-05-10T04:20:42.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.971+0000 7fec391ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec340b3650 con 0x7fec34071200 2023-05-10T04:20:42.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.971+0000 7fec391ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec341558a0 con 0x7fec3406a920 2023-05-10T04:20:42.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec3415a5a0 0x7fec340b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:42.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec3415a5a0 0x7fec340b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38698/0 (socket says 172.21.15.132:38698) 2023-05-10T04:20:42.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 -- 172.21.15.132:0/3300131337 learned_addr learned my addr 172.21.15.132:0/3300131337 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:42.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec32d9d700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a920 0x7fec34158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:42.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec2bfff700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec34071200 0x7fec340b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:42.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 -- 172.21.15.132:0/3300131337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a920 msgr2=0x7fec34158e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:42.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a920 0x7fec34158e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 -- 172.21.15.132:0/3300131337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec34071200 msgr2=0x7fec340b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:42.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec34071200 0x7fec340b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:42.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 -- 172.21.15.132:0/3300131337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c009b30 con 0x7fec3415a5a0 2023-05-10T04:20:42.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec3359e700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec3415a5a0 0x7fec340b3020 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fec2c012000 tx=0x7fec2c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:42.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec2b7fe700 1 -- 172.21.15.132:0/3300131337 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c003ea0 con 0x7fec3415a5a0 2023-05-10T04:20:42.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec2b7fe700 1 -- 172.21.15.132:0/3300131337 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2c0099b0 con 0x7fec3415a5a0 2023-05-10T04:20:42.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3406c6c0 con 0x7fec3415a5a0 2023-05-10T04:20:42.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.972+0000 7fec2b7fe700 1 -- 172.21.15.132:0/3300131337 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2c01c680 con 0x7fec3415a5a0 2023-05-10T04:20:42.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.973+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec340719e0 con 0x7fec3415a5a0 2023-05-10T04:20:42.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.973+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3406c9a0 con 0x7fec3415a5a0 2023-05-10T04:20:42.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.974+0000 7fec2b7fe700 1 -- 172.21.15.132:0/3300131337 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec2c01c7e0 con 0x7fec3415a5a0 2023-05-10T04:20:42.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.975+0000 7fec2b7fe700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec1406ace0 0x7fec1406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:42.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.975+0000 7fec2b7fe700 1 -- 172.21.15.132:0/3300131337 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6899+0+0 (secure 0 0 0) 0x7fec2c08b480 con 0x7fec3415a5a0 2023-05-10T04:20:42.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.975+0000 7fec32d9d700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec1406ace0 0x7fec1406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:42.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.976+0000 7fec32d9d700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec1406ace0 0x7fec1406d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fec24009ad0 tx=0x7fec24008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:42.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:42.980+0000 7fec2b7fe700 1 -- 172.21.15.132:0/3300131337 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fec2c056270 con 0x7fec3415a5a0 2023-05-10T04:20:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.174+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fec34074430 con 0x7fec3415a5a0 2023-05-10T04:20:43.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.767+0000 7fec2b7fe700 1 -- 172.21.15.132:0/3300131337 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7fec2c059890 con 0x7fec3415a5a0 2023-05-10T04:20:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec1406ace0 msgr2=0x7fec1406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:43.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec1406ace0 0x7fec1406d190 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fec24009ad0 tx=0x7fec24008040 comp rx=0 tx=0).stop 2023-05-10T04:20:43.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec3415a5a0 msgr2=0x7fec340b3020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:43.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec3415a5a0 0x7fec340b3020 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fec2c012000 tx=0x7fec2c004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:43.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 shutdown_connections 2023-05-10T04:20:43.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fec1406ace0 0x7fec1406d190 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:43.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec3415a5a0 0x7fec340b3020 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:43.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fec3406a920 0x7fec34158e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:43.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 --2- 172.21.15.132:0/3300131337 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fec34071200 0x7fec340b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:43.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 >> 172.21.15.132:0/3300131337 conn(0x7fec340cf720 msgr2=0x7fec340ae7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:43.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 shutdown_connections 2023-05-10T04:20:43.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.772+0000 7fec391ff700 1 -- 172.21.15.132:0/3300131337 wait complete. 2023-05-10T04:20:43.776 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-05-10T04:20:43.797 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-10T04:20:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.988+0000 7f798efff700 1 Processor -- start 2023-05-10T04:20:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.988+0000 7f798efff700 1 -- start start 2023-05-10T04:20:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.989+0000 7f798efff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798806aaf0 0x7f7988070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.989+0000 7f798efff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7988071030 0x7f798806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.989+0000 7f798efff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79880cb280 con 0x7f798815a5a0 2023-05-10T04:20:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.989+0000 7f798efff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f798815a970 con 0x7f7988071030 2023-05-10T04:20:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.989+0000 7f798efff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79880714b0 con 0x7f798806aaf0 2023-05-10T04:20:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.989+0000 7f798d59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7988071030 0x7f798806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.989+0000 7f798cd9b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f798815a5a0 0x7f798806a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53062/0 (socket says 172.21.15.132:53062) 2023-05-10T04:20:43.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.989+0000 7f798cd9b700 1 -- 172.21.15.132:0/3913114835 learned_addr learned my addr 172.21.15.132:0/3913114835 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f798d59c700 1 -- 172.21.15.132:0/3913114835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798806aaf0 msgr2=0x7f7988070af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f7987fff700 1 --2- 172.21.15.132:0/3913114835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798806aaf0 0x7f7988070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f79877fe700 1 -- 172.21.15.132:0/3913114835 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2206897637 0 0) 0x7f797c001110 con 0x7f798815a5a0 2023-05-10T04:20:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f798d59c700 1 --2- 172.21.15.132:0/3913114835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798806aaf0 0x7f7988070af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f798d59c700 1 -- 172.21.15.132:0/3913114835 >> v1:172.21.15.132:6789/0 conn(0x7f798815a5a0 legacy=0x7f798806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f798d59c700 1 -- 172.21.15.132:0/3913114835 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7988071700 con 0x7f7988071030 2023-05-10T04:20:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f7987fff700 1 --2- 172.21.15.132:0/3913114835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798806aaf0 0x7f7988070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f798d59c700 1 --2- 172.21.15.132:0/3913114835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7988071030 0x7f798806d1a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7980009d90 tx=0x7f798000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb2b13cdc5a23c8 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f79877fe700 1 -- 172.21.15.132:0/3913114835 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798000e070 con 0x7f7988071030 2023-05-10T04:20:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f79877fe700 1 -- 172.21.15.132:0/3913114835 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f798000bbd0 con 0x7f7988071030 2023-05-10T04:20:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.990+0000 7f79877fe700 1 -- 172.21.15.132:0/3913114835 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7980012430 con 0x7f7988071030 2023-05-10T04:20:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.991+0000 7f798efff700 1 -- 172.21.15.132:0/3913114835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7988071030 msgr2=0x7f798806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.991+0000 7f798efff700 1 --2- 172.21.15.132:0/3913114835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7988071030 0x7f798806d1a0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7980009d90 tx=0x7f798000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.991+0000 7f798efff700 1 -- 172.21.15.132:0/3913114835 shutdown_connections 2023-05-10T04:20:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.991+0000 7f798efff700 1 --2- 172.21.15.132:0/3913114835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7988071030 0x7f798806d1a0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.991+0000 7f798efff700 1 --2- 172.21.15.132:0/3913114835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798806aaf0 0x7f7988070af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.991+0000 7f798efff700 1 -- 172.21.15.132:0/3913114835 >> 172.21.15.132:0/3913114835 conn(0x7f79880cf720 msgr2=0x7f79880cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.991+0000 7f798efff700 1 -- 172.21.15.132:0/3913114835 shutdown_connections 2023-05-10T04:20:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.991+0000 7f798efff700 1 -- 172.21.15.132:0/3913114835 wait complete. 2023-05-10T04:20:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.992+0000 7f798efff700 1 Processor -- start 2023-05-10T04:20:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.993+0000 7f798efff700 1 -- start start 2023-05-10T04:20:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.993+0000 7f798efff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f798806aaf0 0x7f79881f3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.993+0000 7f798efff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7988071030 0x7f798815c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.993+0000 7f798efff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798815a5a0 0x7f79881f5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.993+0000 7f798efff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798815cd90 con 0x7f798806aaf0 2023-05-10T04:20:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.993+0000 7f798efff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79880b19f0 con 0x7f7988071030 2023-05-10T04:20:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.993+0000 7f798efff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79880b1cd0 con 0x7f798815a5a0 2023-05-10T04:20:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f798806aaf0 0x7f79881f3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f798806aaf0 0x7f79881f3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38706/0 (socket says 172.21.15.132:38706) 2023-05-10T04:20:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 -- 172.21.15.132:0/4000919542 learned_addr learned my addr 172.21.15.132:0/4000919542 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798d59c700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798815a5a0 0x7f79881f5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f7987fff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7988071030 0x7f798815c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 -- 172.21.15.132:0/4000919542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798815a5a0 msgr2=0x7f79881f5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798815a5a0 0x7f79881f5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 -- 172.21.15.132:0/4000919542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7988071030 msgr2=0x7f798815c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7988071030 0x7f798815c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 -- 172.21.15.132:0/4000919542 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7980009a70 con 0x7f798806aaf0 2023-05-10T04:20:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.994+0000 7f798cd9b700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f798806aaf0 0x7f79881f3560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f797c00c550 tx=0x7f797c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.995+0000 7f79857fa700 1 -- 172.21.15.132:0/4000919542 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c004c80 con 0x7f798806aaf0 2023-05-10T04:20:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.995+0000 7f79857fa700 1 -- 172.21.15.132:0/4000919542 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797c004e00 con 0x7f798806aaf0 2023-05-10T04:20:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.995+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798806c6c0 con 0x7f798806aaf0 2023-05-10T04:20:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.995+0000 7f79857fa700 1 -- 172.21.15.132:0/4000919542 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797c007310 con 0x7f798806aaf0 2023-05-10T04:20:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.995+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79880719e0 con 0x7f798806aaf0 2023-05-10T04:20:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.996+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798806c9a0 con 0x7f798806aaf0 2023-05-10T04:20:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.997+0000 7f79857fa700 1 -- 172.21.15.132:0/4000919542 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f797c007470 con 0x7f798806aaf0 2023-05-10T04:20:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.998+0000 7f79857fa700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f796c06ace0 0x7f796c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.998+0000 7f79857fa700 1 -- 172.21.15.132:0/4000919542 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6461+0+0 (secure 0 0 0) 0x7f797c089210 con 0x7f798806aaf0 2023-05-10T04:20:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.998+0000 7f7987fff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f796c06ace0 0x7f796c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:43.999+0000 7f7987fff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f796c06ace0 0x7f796c06d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79880c9290 tx=0x7f7974008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.002+0000 7f79857fa700 1 -- 172.21.15.132:0/4000919542 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f797c054120 con 0x7f798806aaf0 2023-05-10T04:20:44.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.197+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7988074430 con 0x7f798806aaf0 2023-05-10T04:20:44.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.769+0000 7f79857fa700 1 -- 172.21.15.132:0/4000919542 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7f797c057740 con 0x7f798806aaf0 2023-05-10T04:20:44.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.774+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f796c06ace0 msgr2=0x7f796c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:44.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.774+0000 7f798efff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f796c06ace0 0x7f796c06d190 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79880c9290 tx=0x7f7974008040 comp rx=0 tx=0).stop 2023-05-10T04:20:44.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.774+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f798806aaf0 msgr2=0x7f79881f3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:44.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.774+0000 7f798efff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f798806aaf0 0x7f79881f3560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f797c00c550 tx=0x7f797c00c910 comp rx=0 tx=0).stop 2023-05-10T04:20:44.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.775+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 shutdown_connections 2023-05-10T04:20:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.775+0000 7f798efff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f796c06ace0 0x7f796c06d190 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.775+0000 7f798efff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f798815a5a0 0x7f79881f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.775+0000 7f798efff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f798806aaf0 0x7f79881f3560 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.775+0000 7f798efff700 1 --2- 172.21.15.132:0/4000919542 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f7988071030 0x7f798815c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.775+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 >> 172.21.15.132:0/4000919542 conn(0x7f79880cf720 msgr2=0x7f79880ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.775+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 shutdown_connections 2023-05-10T04:20:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.776+0000 7f798efff700 1 -- 172.21.15.132:0/4000919542 wait complete. 2023-05-10T04:20:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-05-10T04:20:44.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-05-10T04:20:44.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.986+0000 7f61519ff700 1 Processor -- start 2023-05-10T04:20:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.986+0000 7f61519ff700 1 -- start start 2023-05-10T04:20:44.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f61519ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f614c0adf70 0x7f614c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f61519ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c0cc9e0 con 0x7f614c0cd760 2023-05-10T04:20:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f61519ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f614c15de20 con 0x7f614c15cf10 2023-05-10T04:20:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f61519ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f614c15d860 con 0x7f614c0adf70 2023-05-10T04:20:44.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f614affd700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f614c0cd760 0x7f614c0cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53068/0 (socket says 172.21.15.132:53068) 2023-05-10T04:20:44.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f614affd700 1 -- 172.21.15.132:0/3949780325 learned_addr learned my addr 172.21.15.132:0/3949780325 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1031022382 0 0) 0x7f614c0cc9e0 con 0x7f614c0cd760 2023-05-10T04:20:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f6143fff700 1 --2- 172.21.15.132:0/3949780325 >> v2:172.21.15.154:3300/0 conn(0x7f614c0adf70 0x7f614c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.988+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61380035b0 con 0x7f614c0cd760 2023-05-10T04:20:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 458018760 0 0) 0x7f61380035b0 con 0x7f614c0cd760 2023-05-10T04:20:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 >> v2:172.21.15.154:3300/0 conn(0x7f614c0adf70 msgr2=0x7f614c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:44.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 --2- 172.21.15.132:0/3949780325 >> v2:172.21.15.154:3300/0 conn(0x7f614c0adf70 0x7f614c0cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 >> v1:172.21.15.154:6789/0 conn(0x7f614c15cf10 legacy=0x7f614c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:44.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c15db40 con 0x7f614c0cd760 2023-05-10T04:20:44.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f613c001670 con 0x7f614c0cd760 2023-05-10T04:20:44.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 >> v1:172.21.15.132:6789/0 conn(0x7f614c0cd760 legacy=0x7f614c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:44.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6138003a50 0x7f6138003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:44.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138004850 0x7f6138004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:44.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6138005200 0x7f613800dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:44.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c15d860 con 0x7f6138005200 2023-05-10T04:20:44.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613800e2f0 con 0x7f6138003a50 2023-05-10T04:20:44.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f613800e4b0 con 0x7f6138004850 2023-05-10T04:20:44.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614b7fe700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6138005200 0x7f613800dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:44.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614affd700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6138003a50 0x7f6138003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:44.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f6143fff700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138004850 0x7f6138004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:44.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.989+0000 7f614b7fe700 1 -- 172.21.15.132:0/3949780325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138004850 msgr2=0x7f6138004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:44.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614b7fe700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138004850 0x7f6138004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614b7fe700 1 -- 172.21.15.132:0/3949780325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6138003a50 msgr2=0x7f6138003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:44.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614b7fe700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6138003a50 0x7f6138003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614b7fe700 1 -- 172.21.15.132:0/3949780325 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61380035b0 con 0x7f6138005200 2023-05-10T04:20:44.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614b7fe700 1 -- 172.21.15.132:0/3949780325 reap_dead start 2023-05-10T04:20:44.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614b7fe700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6138005200 0x7f613800dc20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f614400c210 tx=0x7f6138005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428ce55dd61a7063 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:44.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144001df0 con 0x7f6138005200 2023-05-10T04:20:44.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614400cd50 con 0x7f6138005200 2023-05-10T04:20:44.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f614a7fc700 1 -- 172.21.15.132:0/3949780325 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6144003c40 con 0x7f6138005200 2023-05-10T04:20:44.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f61519ff700 1 -- 172.21.15.132:0/3949780325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6138005200 msgr2=0x7f613800dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:44.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.990+0000 7f61519ff700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6138005200 0x7f613800dc20 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f614400c210 tx=0x7f6138005880 comp rx=0 tx=0).stop 2023-05-10T04:20:44.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.991+0000 7f61519ff700 1 -- 172.21.15.132:0/3949780325 shutdown_connections 2023-05-10T04:20:44.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.991+0000 7f61519ff700 1 --2- 172.21.15.132:0/3949780325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6138005200 0x7f613800dc20 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:44.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.991+0000 7f61519ff700 1 -- 172.21.15.132:0/3949780325 >> 172.21.15.132:0/3949780325 conn(0x7f614c0cf720 msgr2=0x7f614c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:44.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.991+0000 7f61519ff700 1 -- 172.21.15.132:0/3949780325 shutdown_connections 2023-05-10T04:20:44.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.991+0000 7f61519ff700 1 -- 172.21.15.132:0/3949780325 wait complete. 2023-05-10T04:20:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.992+0000 7f61519ff700 1 Processor -- start 2023-05-10T04:20:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.992+0000 7f61519ff700 1 -- start start 2023-05-10T04:20:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.993+0000 7f61519ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138005200 0x7f614c0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.993+0000 7f61519ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c150b00 0x7f614c0c7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.993+0000 7f61519ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614c0c83f0 0x7f614c0b2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.993+0000 7f61519ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0c5ad0 con 0x7f614c150b00 2023-05-10T04:20:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.993+0000 7f61519ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0c3030 con 0x7f614c0c83f0 2023-05-10T04:20:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.993+0000 7f61519ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614c0b4330 con 0x7f6138005200 2023-05-10T04:20:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c150b00 0x7f614c0c7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c150b00 0x7f614c0c7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38720/0 (socket says 172.21.15.132:38720) 2023-05-10T04:20:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 -- 172.21.15.132:0/2155996681 learned_addr learned my addr 172.21.15.132:0/2155996681 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f614affd700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138005200 0x7f614c0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f614b7fe700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614c0c83f0 0x7f614c0b2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 -- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138005200 msgr2=0x7f614c0c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138005200 0x7f614c0c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 -- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614c0c83f0 msgr2=0x7f614c0b2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614c0c83f0 0x7f614c0b2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 -- 172.21.15.132:0/2155996681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c071600 con 0x7f614c150b00 2023-05-10T04:20:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f614b7fe700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614c0c83f0 0x7f614c0b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6143fff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c150b00 0x7f614c0c7eb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f61340119a0 tx=0x7f6134011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.994+0000 7f6148ff9700 1 -- 172.21.15.132:0/2155996681 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134011ee0 con 0x7f614c150b00 2023-05-10T04:20:45.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.995+0000 7f6148ff9700 1 -- 172.21.15.132:0/2155996681 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6134005c30 con 0x7f614c150b00 2023-05-10T04:20:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.995+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f614c0cc670 con 0x7f614c150b00 2023-05-10T04:20:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.995+0000 7f6148ff9700 1 -- 172.21.15.132:0/2155996681 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613400f6d0 con 0x7f614c150b00 2023-05-10T04:20:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.995+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f614c15d350 con 0x7f614c150b00 2023-05-10T04:20:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.996+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f614c074430 con 0x7f614c150b00 2023-05-10T04:20:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.997+0000 7f6148ff9700 1 -- 172.21.15.132:0/2155996681 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f613400f830 con 0x7f614c150b00 2023-05-10T04:20:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.997+0000 7f6148ff9700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f612c06ace0 0x7f612c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.997+0000 7f6148ff9700 1 -- 172.21.15.132:0/2155996681 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f6134089b80 con 0x7f614c150b00 2023-05-10T04:20:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.998+0000 7f614affd700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f612c06ace0 0x7f612c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:44.998+0000 7f614affd700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f612c06ace0 0x7f612c06d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f613c000c00 tx=0x7f613c000ed0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.002+0000 7f6148ff9700 1 -- 172.21.15.132:0/2155996681 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6134058630 con 0x7f614c150b00 2023-05-10T04:20:45.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.195+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f614c071b50 con 0x7f614c150b00 2023-05-10T04:20:45.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.782+0000 7f6148ff9700 1 -- 172.21.15.132:0/2155996681 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f61340210d0 con 0x7f614c150b00 2023-05-10T04:20:45.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.785+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f612c06ace0 msgr2=0x7f612c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:45.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.785+0000 7f61519ff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f612c06ace0 0x7f612c06d190 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f613c000c00 tx=0x7f613c000ed0 comp rx=0 tx=0).stop 2023-05-10T04:20:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.785+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c150b00 msgr2=0x7f614c0c7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.785+0000 7f61519ff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c150b00 0x7f614c0c7eb0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f61340119a0 tx=0x7f6134011d60 comp rx=0 tx=0).stop 2023-05-10T04:20:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.786+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 shutdown_connections 2023-05-10T04:20:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.786+0000 7f61519ff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f612c06ace0 0x7f612c06d190 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.786+0000 7f61519ff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f614c0c83f0 0x7f614c0b2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.786+0000 7f61519ff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6138005200 0x7f614c0c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:45.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.786+0000 7f61519ff700 1 --2- 172.21.15.132:0/2155996681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f614c150b00 0x7f614c0c7eb0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.786+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 >> 172.21.15.132:0/2155996681 conn(0x7f614c0cf720 msgr2=0x7f614c15aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.786+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 shutdown_connections 2023-05-10T04:20:45.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:45.786+0000 7f61519ff700 1 -- 172.21.15.132:0/2155996681 wait complete. 2023-05-10T04:20:45.791 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data_ec' removed 2023-05-10T04:20:45.813 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-10T04:20:45.814 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-10T04:20:45.814 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-10T04:20:45.815 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:20:45.815 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-10T04:20:45.815 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-10T04:20:45.816 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-10T04:20:45.816 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:20:45.816 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-10T04:20:45.817 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-10T04:20:45.817 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-10T04:20:45.817 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:20:45.817 INFO:tasks.ceph.mds.d:Restarting daemon 2023-05-10T04:20:45.817 INFO:tasks.ceph.mds.d:Stopping old one... 2023-05-10T04:20:45.818 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-05-10T04:20:45.818 INFO:teuthology.orchestra.run:waiting for 300 2023-05-10T04:20:45.829 INFO:tasks.ceph.mds.a:Stopped 2023-05-10T04:20:45.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-10T04:20:45.830 INFO:tasks.ceph.mds.c:Stopped 2023-05-10T04:20:45.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-10T04:20:45.833 INFO:tasks.ceph.mds.b:Stopped 2023-05-10T04:20:45.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-10T04:20:45.834 INFO:tasks.ceph.mds.d:Stopped 2023-05-10T04:20:45.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-05-10T04:20:45.875 INFO:tasks.ceph.mds.a:Started 2023-05-10T04:20:45.876 DEBUG:teuthology.parallel:result is None 2023-05-10T04:20:45.878 INFO:tasks.ceph.mds.b:Started 2023-05-10T04:20:45.878 DEBUG:teuthology.parallel:result is None 2023-05-10T04:20:45.879 INFO:tasks.ceph.mds.c:Started 2023-05-10T04:20:45.880 DEBUG:teuthology.parallel:result is None 2023-05-10T04:20:45.881 INFO:tasks.ceph.mds.d:Started 2023-05-10T04:20:45.881 DEBUG:teuthology.parallel:result is None 2023-05-10T04:20:45.882 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-10T04:20:46.015 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-05-10T04:20:46.023 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-05-10T04:20:46.034 INFO:tasks.ceph.mds.b.smithi154.stdout:starting mds.b at 2023-05-10T04:20:46.035 INFO:tasks.ceph.mds.d.smithi154.stdout:starting mds.d at 2023-05-10T04:20:46.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.100+0000 7f6b1cfff700 1 Processor -- start 2023-05-10T04:20:46.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.100+0000 7f6b1cfff700 1 -- start start 2023-05-10T04:20:46.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1cfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b180ccf00 0x7f6b18071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:46.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1cfff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6b1815d690 0x7f6b180cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:46.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1cfff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b180cd810 con 0x7f6b1806eb70 2023-05-10T04:20:46.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1cfff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1806a470 con 0x7f6b180ccf00 2023-05-10T04:20:46.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1cfff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b18071a30 con 0x7f6b1815d690 2023-05-10T04:20:46.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1659c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b180ccf00 0x7f6b18071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:46.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1659c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b180ccf00 0x7f6b18071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38766/0 (socket says 172.21.15.132:38766) 2023-05-10T04:20:46.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1659c700 1 -- 172.21.15.132:0/3302329724 learned_addr learned my addr 172.21.15.132:0/3302329724 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:46.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b16d9d700 1 --1- 172.21.15.132:0/3302329724 >> v1:172.21.15.132:6789/0 conn(0x7f6b1806eb70 0x7f6b1806a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53098/0 (socket says 172.21.15.132:53098) 2023-05-10T04:20:46.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b15d9b700 1 --2- 172.21.15.132:0/3302329724 >> v2:172.21.15.154:3300/0 conn(0x7f6b1815d690 0x7f6b180cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:46.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1659c700 1 -- 172.21.15.132:0/3302329724 >> v2:172.21.15.154:3300/0 conn(0x7f6b1815d690 msgr2=0x7f6b180cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:46.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1659c700 1 --2- 172.21.15.132:0/3302329724 >> v2:172.21.15.154:3300/0 conn(0x7f6b1815d690 0x7f6b180cd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:46.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.102+0000 7f6b1659c700 1 -- 172.21.15.132:0/3302329724 >> v1:172.21.15.132:6789/0 conn(0x7f6b1806eb70 legacy=0x7f6b1806a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.103+0000 7f6b1659c700 1 -- 172.21.15.132:0/3302329724 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b18071d10 con 0x7f6b180ccf00 2023-05-10T04:20:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.103+0000 7f6b1659c700 1 --2- 172.21.15.132:0/3302329724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b180ccf00 0x7f6b18071450 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6b18071250 tx=0x7f6b08009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54d480974377d00 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.103+0000 7f6b1559a700 1 -- 172.21.15.132:0/3302329724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08011830 con 0x7f6b180ccf00 2023-05-10T04:20:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.103+0000 7f6b1559a700 1 -- 172.21.15.132:0/3302329724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b08011990 con 0x7f6b180ccf00 2023-05-10T04:20:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.103+0000 7f6b1559a700 1 -- 172.21.15.132:0/3302329724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08011d20 con 0x7f6b180ccf00 2023-05-10T04:20:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.103+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3302329724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b180ccf00 msgr2=0x7f6b18071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:46.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.103+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3302329724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b180ccf00 0x7f6b18071450 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6b18071250 tx=0x7f6b08009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.104+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3302329724 shutdown_connections 2023-05-10T04:20:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.104+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3302329724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b180ccf00 0x7f6b18071450 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.104+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3302329724 >> v2:172.21.15.154:3300/0 conn(0x7f6b1815d690 0x7f6b180cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.104+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3302329724 >> 172.21.15.132:0/3302329724 conn(0x7f6b180cf330 msgr2=0x7f6b180cf730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.104+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3302329724 shutdown_connections 2023-05-10T04:20:46.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.104+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3302329724 wait complete. 2023-05-10T04:20:46.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.105+0000 7f6b1cfff700 1 Processor -- start 2023-05-10T04:20:46.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.105+0000 7f6b1cfff700 1 -- start start 2023-05-10T04:20:46.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.106+0000 7f6b1cfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1806eb70 0x7f6b180c4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:46.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.106+0000 7f6b1cfff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b180ccf00 0x7f6b1814c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:46.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.106+0000 7f6b1cfff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1815d690 0x7f6b1814cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:46.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.106+0000 7f6b1cfff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180c5a70 con 0x7f6b1806eb70 2023-05-10T04:20:46.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.106+0000 7f6b1cfff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1814d140 con 0x7f6b1815d690 2023-05-10T04:20:46.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.106+0000 7f6b1cfff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b180c2da0 con 0x7f6b180ccf00 2023-05-10T04:20:46.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.106+0000 7f6b1659c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1806eb70 0x7f6b180c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:46.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b1659c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1806eb70 0x7f6b180c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38778/0 (socket says 172.21.15.132:38778) 2023-05-10T04:20:46.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b1659c700 1 -- 172.21.15.132:0/3902908426 learned_addr learned my addr 172.21.15.132:0/3902908426 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:46.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b15d9b700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b180ccf00 0x7f6b1814c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b16d9d700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1815d690 0x7f6b1814cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b1659c700 1 -- 172.21.15.132:0/3902908426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b180ccf00 msgr2=0x7f6b1814c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b1659c700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b180ccf00 0x7f6b1814c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b1659c700 1 -- 172.21.15.132:0/3902908426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1815d690 msgr2=0x7f6b1814cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b1659c700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1815d690 0x7f6b1814cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b1659c700 1 -- 172.21.15.132:0/3902908426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b08009550 con 0x7f6b1806eb70 2023-05-10T04:20:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b1659c700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1806eb70 0x7f6b180c4630 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6b08000c00 tx=0x7f6b08004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b06ffd700 1 -- 172.21.15.132:0/3902908426 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b08004380 con 0x7f6b1806eb70 2023-05-10T04:20:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.107+0000 7f6b06ffd700 1 -- 172.21.15.132:0/3902908426 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0801f070 con 0x7f6b1806eb70 2023-05-10T04:20:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.108+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b180722d0 con 0x7f6b1806eb70 2023-05-10T04:20:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.108+0000 7f6b06ffd700 1 -- 172.21.15.132:0/3902908426 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b080036a0 con 0x7f6b1806eb70 2023-05-10T04:20:46.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.108+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b18071ff0 con 0x7f6b1806eb70 2023-05-10T04:20:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.109+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1815db00 con 0x7f6b1806eb70 2023-05-10T04:20:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.109+0000 7f6b06ffd700 1 -- 172.21.15.132:0/3902908426 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6b08021030 con 0x7f6b1806eb70 2023-05-10T04:20:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.110+0000 7f6b06ffd700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6af806ace0 0x7f6af806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.110+0000 7f6b06ffd700 1 -- 172.21.15.132:0/3902908426 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5616+0+0 (secure 0 0 0) 0x7f6b0808a6f0 con 0x7f6b1806eb70 2023-05-10T04:20:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.111+0000 7f6b15d9b700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6af806ace0 0x7f6af806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:46.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.111+0000 7f6b15d9b700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6af806ace0 0x7f6af806d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b180b4040 tx=0x7f6b0c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:46.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.114+0000 7f6b06ffd700 1 -- 172.21.15.132:0/3902908426 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6b080558f0 con 0x7f6b1806eb70 2023-05-10T04:20:46.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:46.334+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f6b18074430 con 0x7f6b1806eb70 2023-05-10T04:20:47.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.076+0000 7f6b06ffd700 1 -- 172.21.15.132:0/3902908426 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v37) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6b08058f10 con 0x7f6b1806eb70 2023-05-10T04:20:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6af806ace0 msgr2=0x7f6af806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6af806ace0 0x7f6af806d190 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6b180b4040 tx=0x7f6b0c009210 comp rx=0 tx=0).stop 2023-05-10T04:20:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1806eb70 msgr2=0x7f6b180c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1806eb70 0x7f6b180c4630 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6b08000c00 tx=0x7f6b08004750 comp rx=0 tx=0).stop 2023-05-10T04:20:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 shutdown_connections 2023-05-10T04:20:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6af806ace0 0x7f6af806d190 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6b1815d690 0x7f6b1814cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1806eb70 0x7f6b180c4630 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 --2- 172.21.15.132:0/3902908426 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6b180ccf00 0x7f6b1814c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.079+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 >> 172.21.15.132:0/3902908426 conn(0x7f6b180cf330 msgr2=0x7f6b180ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.080+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 shutdown_connections 2023-05-10T04:20:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.080+0000 7f6b1cfff700 1 -- 172.21.15.132:0/3902908426 wait complete. 2023-05-10T04:20:47.083 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-05-10T04:20:47.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-10T04:20:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.280+0000 7f6312bff700 1 Processor -- start 2023-05-10T04:20:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.280+0000 7f6312bff700 1 -- start start 2023-05-10T04:20:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f6312bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f630c0b87a0 0x7f630c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f6312bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f630c1601e0 0x7f630c160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f6312bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c0d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f6312bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c0d02d0 con 0x7f630c0b87a0 2023-05-10T04:20:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f6312bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c0d0cb0 con 0x7f630c1601e0 2023-05-10T04:20:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f6312bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0b2730 con 0x7f630c160b70 2023-05-10T04:20:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f631099b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f630c0b87a0 0x7f630c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f631099b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f630c0b87a0 0x7f630c0cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38788/0 (socket says 172.21.15.132:38788) 2023-05-10T04:20:47.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.281+0000 7f631099b700 1 -- 172.21.15.132:0/1040697605 learned_addr learned my addr 172.21.15.132:0/1040697605 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:47.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f631119c700 1 --2- 172.21.15.132:0/1040697605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c0d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f631099b700 1 -- 172.21.15.132:0/1040697605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 msgr2=0x7f630c0d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:47.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f630bfff700 1 --2- 172.21.15.132:0/1040697605 >> v2:172.21.15.154:3300/0 conn(0x7f630c1601e0 0x7f630c160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f631099b700 1 --2- 172.21.15.132:0/1040697605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c0d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f631099b700 1 -- 172.21.15.132:0/1040697605 >> v2:172.21.15.154:3300/0 conn(0x7f630c1601e0 msgr2=0x7f630c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:47.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f631099b700 1 --2- 172.21.15.132:0/1040697605 >> v2:172.21.15.154:3300/0 conn(0x7f630c1601e0 0x7f630c160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f631099b700 1 -- 172.21.15.132:0/1040697605 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0cdc60 con 0x7f630c0b87a0 2023-05-10T04:20:47.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f631119c700 1 --2- 172.21.15.132:0/1040697605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c0d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:47.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f630bfff700 1 --2- 172.21.15.132:0/1040697605 >> v2:172.21.15.154:3300/0 conn(0x7f630c1601e0 0x7f630c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:47.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f631099b700 1 --2- 172.21.15.132:0/1040697605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c0b87a0 0x7f630c0cfbf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f630c0b8f60 tx=0x7f6300009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a1845c956d439a server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f630b7fe700 1 -- 172.21.15.132:0/1040697605 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630000b870 con 0x7f630c0b87a0 2023-05-10T04:20:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f630b7fe700 1 -- 172.21.15.132:0/1040697605 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630000b9d0 con 0x7f630c0b87a0 2023-05-10T04:20:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.282+0000 7f630b7fe700 1 -- 172.21.15.132:0/1040697605 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630000bd60 con 0x7f630c0b87a0 2023-05-10T04:20:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 -- 172.21.15.132:0/1040697605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c0b87a0 msgr2=0x7f630c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 --2- 172.21.15.132:0/1040697605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c0b87a0 0x7f630c0cfbf0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f630c0b8f60 tx=0x7f6300009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 -- 172.21.15.132:0/1040697605 shutdown_connections 2023-05-10T04:20:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 --2- 172.21.15.132:0/1040697605 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c0d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 --2- 172.21.15.132:0/1040697605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c0b87a0 0x7f630c0cfbf0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 --2- 172.21.15.132:0/1040697605 >> v2:172.21.15.154:3300/0 conn(0x7f630c1601e0 0x7f630c160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 -- 172.21.15.132:0/1040697605 >> 172.21.15.132:0/1040697605 conn(0x7f630c071b10 msgr2=0x7f630c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 -- 172.21.15.132:0/1040697605 shutdown_connections 2023-05-10T04:20:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.283+0000 7f6312bff700 1 -- 172.21.15.132:0/1040697605 wait complete. 2023-05-10T04:20:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.285+0000 7f6312bff700 1 Processor -- start 2023-05-10T04:20:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.285+0000 7f6312bff700 1 -- start start 2023-05-10T04:20:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f6312bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c0b87a0 0x7f630c151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f6312bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c1601e0 0x7f630c0c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f6312bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f6312bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c151a90 con 0x7f630c1601e0 2023-05-10T04:20:47.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f6312bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c155570 con 0x7f630c0b87a0 2023-05-10T04:20:47.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f6312bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0c7c00 con 0x7f630c160b70 2023-05-10T04:20:47.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f630bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c1601e0 0x7f630c0c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f630bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c1601e0 0x7f630c0c73d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38794/0 (socket says 172.21.15.132:38794) 2023-05-10T04:20:47.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f630bfff700 1 -- 172.21.15.132:0/1288474073 learned_addr learned my addr 172.21.15.132:0/1288474073 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:47.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f631119c700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f631099b700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c0b87a0 0x7f630c151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f630bfff700 1 -- 172.21.15.132:0/1288474073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 msgr2=0x7f630c15e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f630bfff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c15e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f630bfff700 1 -- 172.21.15.132:0/1288474073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c0b87a0 msgr2=0x7f630c151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f630bfff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c0b87a0 0x7f630c151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.286+0000 7f630bfff700 1 -- 172.21.15.132:0/1288474073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6300009550 con 0x7f630c1601e0 2023-05-10T04:20:47.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.287+0000 7f630bfff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c1601e0 0x7f630c0c73d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f62f800c740 tx=0x7f62f800ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:47.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.287+0000 7f63097fa700 1 -- 172.21.15.132:0/1288474073 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8011800 con 0x7f630c1601e0 2023-05-10T04:20:47.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.287+0000 7f63097fa700 1 -- 172.21.15.132:0/1288474073 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f8011960 con 0x7f630c1601e0 2023-05-10T04:20:47.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.287+0000 7f63097fa700 1 -- 172.21.15.132:0/1288474073 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8011cd0 con 0x7f630c1601e0 2023-05-10T04:20:47.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.287+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c0cd6a0 con 0x7f630c1601e0 2023-05-10T04:20:47.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.287+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c160fd0 con 0x7f630c1601e0 2023-05-10T04:20:47.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.288+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c0cd980 con 0x7f630c1601e0 2023-05-10T04:20:47.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.289+0000 7f63097fa700 1 -- 172.21.15.132:0/1288474073 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f62f8021350 con 0x7f630c1601e0 2023-05-10T04:20:47.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.291+0000 7f63097fa700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f62f006ace0 0x7f62f006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.291+0000 7f63097fa700 1 -- 172.21.15.132:0/1288474073 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f62f80890b0 con 0x7f630c1601e0 2023-05-10T04:20:47.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.291+0000 7f631099b700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f62f006ace0 0x7f62f006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.291+0000 7f631099b700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f62f006ace0 0x7f62f006d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6300014040 tx=0x7f6300008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:47.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.295+0000 7f63097fa700 1 -- 172.21.15.132:0/1288474073 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f62f8057df0 con 0x7f630c1601e0 2023-05-10T04:20:47.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.567+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f630c074430 con 0x7f630c1601e0 2023-05-10T04:20:47.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.568+0000 7f63097fa700 1 -- 172.21.15.132:0/1288474073 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f62f8057980 con 0x7f630c1601e0 2023-05-10T04:20:47.570 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:47.570 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-05-10T04:20:47.570 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-05-10T04:20:47.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.570 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-05-10T04:20:47.571 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD9GltkGboSIxAANVeTng29GZoenorLpF+wqQ==", 2023-05-10T04:20:47.571 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.571 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-05-10T04:20:47.571 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-05-10T04:20:47.571 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-05-10T04:20:47.571 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.572 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.572 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.572 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.572 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-05-10T04:20:47.572 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD9GltkVsyxOBAAkNxpFzXux3SD5Bws/NNb5w==", 2023-05-10T04:20:47.572 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.572 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-05-10T04:20:47.572 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-05-10T04:20:47.573 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-05-10T04:20:47.573 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.573 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.573 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-05-10T04:20:47.573 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD9GltklZXRLRAAUJtXhsJeUM4XOK9H39H+og==", 2023-05-10T04:20:47.574 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.574 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-05-10T04:20:47.574 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-05-10T04:20:47.574 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-05-10T04:20:47.574 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.574 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.575 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-05-10T04:20:47.575 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD+GltkZMUKCBAAOEya1nJz+dwadqggjDY7Gg==", 2023-05-10T04:20:47.575 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.575 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-05-10T04:20:47.575 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-05-10T04:20:47.575 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-05-10T04:20:47.575 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.575 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.576 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-05-10T04:20:47.576 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQABG1tknZz1OhAAt6+Ek3tWpayOz1TWbRkfeQ==", 2023-05-10T04:20:47.576 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.576 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-05-10T04:20:47.576 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-05-10T04:20:47.576 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.577 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.577 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-05-10T04:20:47.577 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAFG1tkstvnBRAANJhhErtvfkz0knSYKq8F5A==", 2023-05-10T04:20:47.577 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.577 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-05-10T04:20:47.578 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-05-10T04:20:47.578 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.578 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.579 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-05-10T04:20:47.579 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAIG1tkSHQ6DhAAkQPXaIUKNp51/WPkB1okaQ==", 2023-05-10T04:20:47.579 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.579 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-05-10T04:20:47.579 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-05-10T04:20:47.579 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.579 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.580 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-05-10T04:20:47.580 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQALG1tkQaUGExAAYCWM+m8D469dHlWK1lMzKw==", 2023-05-10T04:20:47.580 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.580 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-05-10T04:20:47.580 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-05-10T04:20:47.580 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.581 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.581 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-05-10T04:20:47.581 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQARG1tkwox7JhAAKHtst55ILgIysBcYKl6HZA==", 2023-05-10T04:20:47.581 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.581 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-05-10T04:20:47.581 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-05-10T04:20:47.582 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.582 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.582 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-05-10T04:20:47.582 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAUG1tkpOWkLRAADvd4Asp5yKv2z5byqWvbEA==", 2023-05-10T04:20:47.582 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.583 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-05-10T04:20:47.583 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-05-10T04:20:47.583 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.583 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.583 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-05-10T04:20:47.583 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAXG1tkYzJmMRAA/wUbtwozLornUKLWCM1xZw==", 2023-05-10T04:20:47.584 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.584 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-05-10T04:20:47.584 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-05-10T04:20:47.584 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.584 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.585 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-05-10T04:20:47.585 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAaG1tkgo8oNBAArOHZpegQMdZN/UTsniCCSQ==", 2023-05-10T04:20:47.585 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.585 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-05-10T04:20:47.585 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-05-10T04:20:47.585 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.585 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.586 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-05-10T04:20:47.586 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD+Gltk3wdTERAAbpH7ragpXf4eKgvv2UW2Ww==", 2023-05-10T04:20:47.586 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.586 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-05-10T04:20:47.586 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-05-10T04:20:47.586 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-05-10T04:20:47.586 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-05-10T04:20:47.587 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.587 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-05-10T04:20:47.587 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD+Gltkck1jHxAAcTQ6TzQtGEgAwd2wv1pDbA==", 2023-05-10T04:20:47.587 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.587 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-05-10T04:20:47.588 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-05-10T04:20:47.588 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-05-10T04:20:47.588 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-05-10T04:20:47.588 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.588 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-05-10T04:20:47.588 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD+Gltk2adJGBAANWDUzaxLqQmP28q3FfRBHg==", 2023-05-10T04:20:47.589 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.589 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-05-10T04:20:47.589 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-05-10T04:20:47.589 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-05-10T04:20:47.589 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-05-10T04:20:47.589 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.590 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-05-10T04:20:47.590 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD+GltkZK3TJhAATsv/qK5kipmpNiWbE9295Q==", 2023-05-10T04:20:47.590 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.590 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-05-10T04:20:47.590 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-05-10T04:20:47.590 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-05-10T04:20:47.590 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-05-10T04:20:47.591 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.591 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-05-10T04:20:47.591 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD8Gltk5Wa4KRAAC8JrC3EdOfYV0FRtYgxxlA==", 2023-05-10T04:20:47.591 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.591 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-05-10T04:20:47.591 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-05-10T04:20:47.592 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-05-10T04:20:47.592 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.592 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.592 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mds", 2023-05-10T04:20:47.592 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAiG1tkf4eeJBAAV33oPeeo/naihycq316Ccg==", 2023-05-10T04:20:47.593 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.593 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mds" 2023-05-10T04:20:47.593 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.593 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mgr", 2023-05-10T04:20:47.593 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAiG1tk4ZmeJBAA/8Xkzw8vYBDMqR5IojRMkw==", 2023-05-10T04:20:47.593 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.594 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-10T04:20:47.594 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.594 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-osd", 2023-05-10T04:20:47.594 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAiG1tk46ueJBAAPwvFm4mPgCxccd7I3bkywA==", 2023-05-10T04:20:47.594 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.594 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-osd" 2023-05-10T04:20:47.595 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.595 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd", 2023-05-10T04:20:47.595 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAiG1tkkbeeJBAAIdOR3U3pgOxmW82B/x4m+w==", 2023-05-10T04:20:47.595 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.595 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-10T04:20:47.596 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.596 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-10T04:20:47.596 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAiG1tkl8CeJBAAjp38rChnfdXljmAFWa5djg==", 2023-05-10T04:20:47.596 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.596 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-10T04:20:47.596 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.597 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rgw", 2023-05-10T04:20:47.597 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQAiG1tktcmeJBAALWWxLUQHfSU4TyOjSdEV2g==", 2023-05-10T04:20:47.597 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.597 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-10T04:20:47.597 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-05-10T04:20:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD9GltkDe/NGxAAs5VopmFAmxF00MWTqk+CMQ==", 2023-05-10T04:20:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-05-10T04:20:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-05-10T04:20:47.598 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.599 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:47.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:47.599 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-05-10T04:20:47.599 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQD9GltkFddFExAAEvVVUufCAFZxGNn4r3Hbng==", 2023-05-10T04:20:47.599 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-05-10T04:20:47.599 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-05-10T04:20:47.599 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-05-10T04:20:47.600 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-05-10T04:20:47.600 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.600 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:47.600 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-05-10T04:20:47.600 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-05-10T04:20:47.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f62f006ace0 msgr2=0x7f62f006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f62f006ace0 0x7f62f006d190 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6300014040 tx=0x7f6300008030 comp rx=0 tx=0).stop 2023-05-10T04:20:47.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c1601e0 msgr2=0x7f630c0c73d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c1601e0 0x7f630c0c73d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f62f800c740 tx=0x7f62f800ca50 comp rx=0 tx=0).stop 2023-05-10T04:20:47.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 shutdown_connections 2023-05-10T04:20:47.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f62f006ace0 0x7f62f006d190 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f630c160b70 0x7f630c15e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f630c0b87a0 0x7f630c151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 --2- 172.21.15.132:0/1288474073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c1601e0 0x7f630c0c73d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 >> 172.21.15.132:0/1288474073 conn(0x7f630c071b10 msgr2=0x7f630c0b2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:47.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 shutdown_connections 2023-05-10T04:20:47.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.570+0000 7f6312bff700 1 -- 172.21.15.132:0/1288474073 wait complete. 2023-05-10T04:20:47.603 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-10T04:20:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.788+0000 7f6f9e7ff700 1 Processor -- start 2023-05-10T04:20:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.788+0000 7f6f9e7ff700 1 -- start start 2023-05-10T04:20:47.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.790+0000 7f6f9e7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f980adf70 0x7f6f980cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.790+0000 7f6f9e7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f6f9815cf10 0x7f6f9806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.790+0000 7f6f9e7ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f980cc9e0 con 0x7f6f980cd760 2023-05-10T04:20:47.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.790+0000 7f6f9e7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f9815de20 con 0x7f6f9815cf10 2023-05-10T04:20:47.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.790+0000 7f6f9e7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f9815d860 con 0x7f6f980adf70 2023-05-10T04:20:47.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.791+0000 7f6f977fe700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f980adf70 0x7f6f980cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.791+0000 7f6f97fff700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7f6f980cd760 0x7f6f980cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:53034/0 (socket says 172.21.15.132:53034) 2023-05-10T04:20:47.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.791+0000 7f6f97fff700 1 -- 172.21.15.132:0/2508220350 learned_addr learned my addr 172.21.15.132:0/2508220350 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:47.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.791+0000 7f6f9cd9c700 1 --2- 172.21.15.132:0/2508220350 >> v2:172.21.15.154:3300/0 conn(0x7f6f9815cf10 0x7f6f9806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.791+0000 7f6f977fe700 1 -- 172.21.15.132:0/2508220350 >> v2:172.21.15.154:3300/0 conn(0x7f6f9815cf10 msgr2=0x7f6f9806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.791+0000 7f6f977fe700 1 --2- 172.21.15.132:0/2508220350 >> v2:172.21.15.154:3300/0 conn(0x7f6f9815cf10 0x7f6f9806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.791+0000 7f6f977fe700 1 -- 172.21.15.132:0/2508220350 >> v1:172.21.15.154:6789/0 conn(0x7f6f980cd760 legacy=0x7f6f980cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.791+0000 7f6f977fe700 1 -- 172.21.15.132:0/2508220350 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f9815db40 con 0x7f6f980adf70 2023-05-10T04:20:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.792+0000 7f6f977fe700 1 --2- 172.21.15.132:0/2508220350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f980adf70 0x7f6f980cce70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009820 tx=0x7f6f8c009b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bd3a10a369705dc server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.792+0000 7f6f96ffd700 1 -- 172.21.15.132:0/2508220350 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c005e30 con 0x7f6f980adf70 2023-05-10T04:20:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.792+0000 7f6f96ffd700 1 -- 172.21.15.132:0/2508220350 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c006030 con 0x7f6f980adf70 2023-05-10T04:20:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.792+0000 7f6f96ffd700 1 -- 172.21.15.132:0/2508220350 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c0063c0 con 0x7f6f980adf70 2023-05-10T04:20:47.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.793+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/2508220350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f980adf70 msgr2=0x7f6f980cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.793+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/2508220350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f980adf70 0x7f6f980cce70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c009820 tx=0x7f6f8c009b30 comp rx=0 tx=0).stop 2023-05-10T04:20:47.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.793+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/2508220350 shutdown_connections 2023-05-10T04:20:47.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.793+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/2508220350 >> v2:172.21.15.154:3300/0 conn(0x7f6f9815cf10 0x7f6f9806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.793+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/2508220350 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f980adf70 0x7f6f980cce70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.793+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/2508220350 >> 172.21.15.132:0/2508220350 conn(0x7f6f980cf720 msgr2=0x7f6f980cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:47.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.793+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/2508220350 shutdown_connections 2023-05-10T04:20:47.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.793+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/2508220350 wait complete. 2023-05-10T04:20:47.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.795+0000 7f6f9e7ff700 1 Processor -- start 2023-05-10T04:20:47.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.795+0000 7f6f9e7ff700 1 -- start start 2023-05-10T04:20:47.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f9e7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980adf70 0x7f6f980ae570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f9e7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f980cd760 0x7f6f980b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f9e7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9815cf10 0x7f6f981f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f9e7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f981507f0 con 0x7f6f980adf70 2023-05-10T04:20:47.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f9e7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f981f3530 con 0x7f6f980cd760 2023-05-10T04:20:47.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f9e7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980b1250 con 0x7f6f9815cf10 2023-05-10T04:20:47.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f97fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980adf70 0x7f6f980ae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f97fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980adf70 0x7f6f980ae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38804/0 (socket says 172.21.15.132:38804) 2023-05-10T04:20:47.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f97fff700 1 -- 172.21.15.132:0/3549890188 learned_addr learned my addr 172.21.15.132:0/3549890188 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:47.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f977fe700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f980cd760 0x7f6f980b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.796+0000 7f6f9cd9c700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9815cf10 0x7f6f981f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f97fff700 1 -- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9815cf10 msgr2=0x7f6f981f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f97fff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9815cf10 0x7f6f981f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f97fff700 1 -- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f980cd760 msgr2=0x7f6f980b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:47.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f97fff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f980cd760 0x7f6f980b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:47.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f97fff700 1 -- 172.21.15.132:0/3549890188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c009430 con 0x7f6f980adf70 2023-05-10T04:20:47.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f9cd9c700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9815cf10 0x7f6f981f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:47.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f97fff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980adf70 0x7f6f980ae570 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c520 tx=0x7f6f8800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:47.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f94ff9700 1 -- 172.21.15.132:0/3549890188 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88005d70 con 0x7f6f980adf70 2023-05-10T04:20:47.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f94ff9700 1 -- 172.21.15.132:0/3549890188 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f880070d0 con 0x7f6f980adf70 2023-05-10T04:20:47.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f98071600 con 0x7f6f980adf70 2023-05-10T04:20:47.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f94ff9700 1 -- 172.21.15.132:0/3549890188 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f88007440 con 0x7f6f980adf70 2023-05-10T04:20:47.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.797+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f980cc670 con 0x7f6f980adf70 2023-05-10T04:20:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.798+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f980cd3b0 con 0x7f6f980adf70 2023-05-10T04:20:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.799+0000 7f6f94ff9700 1 -- 172.21.15.132:0/3549890188 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f880075a0 con 0x7f6f980adf70 2023-05-10T04:20:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.800+0000 7f6f94ff9700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f8406ace0 0x7f6f8406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.800+0000 7f6f94ff9700 1 -- 172.21.15.132:0/3549890188 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f6f88088680 con 0x7f6f980adf70 2023-05-10T04:20:47.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.800+0000 7f6f977fe700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f8406ace0 0x7f6f8406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:47.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.801+0000 7f6f977fe700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f8406ace0 0x7f6f8406d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:47.804+0000 7f6f94ff9700 1 -- 172.21.15.132:0/3549890188 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f6f88053950 con 0x7f6f980adf70 2023-05-10T04:20:48.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.073+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f6f980aeb50 con 0x7f6f980adf70 2023-05-10T04:20:48.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.079+0000 7f6f94ff9700 1 -- 172.21.15.132:0/3549890188 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f6f88056f70 con 0x7f6f980adf70 2023-05-10T04:20:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f8406ace0 msgr2=0x7f6f8406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f8406ace0 0x7f6f8406d190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c000c00 tx=0x7f6f8c01c040 comp rx=0 tx=0).stop 2023-05-10T04:20:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980adf70 msgr2=0x7f6f980ae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980adf70 0x7f6f980ae570 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6f8800c520 tx=0x7f6f8800c830 comp rx=0 tx=0).stop 2023-05-10T04:20:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 shutdown_connections 2023-05-10T04:20:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f6f8406ace0 0x7f6f8406d190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f6f9815cf10 0x7f6f981f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f980adf70 0x7f6f980ae570 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 --2- 172.21.15.132:0/3549890188 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f6f980cd760 0x7f6f980b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 >> 172.21.15.132:0/3549890188 conn(0x7f6f980cf720 msgr2=0x7f6f9806a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 shutdown_connections 2023-05-10T04:20:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.081+0000 7f6f9e7ff700 1 -- 172.21.15.132:0/3549890188 wait complete. 2023-05-10T04:20:48.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-10T04:20:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.284+0000 7f9ccc1ff700 1 Processor -- start 2023-05-10T04:20:48.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.284+0000 7f9ccc1ff700 1 -- start start 2023-05-10T04:20:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.285+0000 7f9ccc1ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cc40ca210 0x7f9cc40b1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.285+0000 7f9ccc1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc406a5f0 con 0x7f9cc40cd790 2023-05-10T04:20:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.285+0000 7f9ccc1ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cc406a840 con 0x7f9cc40b1b80 2023-05-10T04:20:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.285+0000 7f9ccc1ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cc40ca6b0 con 0x7f9cc40ca210 2023-05-10T04:20:48.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.285+0000 7f9cc979a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cc40ca210 0x7f9cc40b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.285+0000 7f9cc979a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cc40ca210 0x7f9cc40b1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38806/0 (socket says 172.21.15.132:38806) 2023-05-10T04:20:48.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.285+0000 7f9cc979a700 1 -- 172.21.15.132:0/1203100484 learned_addr learned my addr 172.21.15.132:0/1203100484 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.286+0000 7f9cc979a700 1 -- 172.21.15.132:0/1203100484 >> v1:172.21.15.154:6789/0 conn(0x7f9cc40b1b80 legacy=0x7f9cc406b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.286+0000 7f9cc979a700 1 -- 172.21.15.132:0/1203100484 >> v1:172.21.15.132:6789/0 conn(0x7f9cc40cd790 legacy=0x7f9cc40cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.286+0000 7f9cc979a700 1 -- 172.21.15.132:0/1203100484 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc406ab20 con 0x7f9cc40ca210 2023-05-10T04:20:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.286+0000 7f9cc979a700 1 --2- 172.21.15.132:0/1203100484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40ca210 0x7f9cc40b1640 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009920 tx=0x7f9cb4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73fb03d8f988e6f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:48.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.286+0000 7f9cc8f99700 1 -- 172.21.15.132:0/1203100484 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb400ba20 con 0x7f9cc40ca210 2023-05-10T04:20:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.286+0000 7f9cc8f99700 1 -- 172.21.15.132:0/1203100484 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb400bb80 con 0x7f9cc40ca210 2023-05-10T04:20:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.286+0000 7f9cc8f99700 1 -- 172.21.15.132:0/1203100484 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4009e70 con 0x7f9cc40ca210 2023-05-10T04:20:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.287+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/1203100484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40ca210 msgr2=0x7f9cc40b1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.287+0000 7f9ccc1ff700 1 --2- 172.21.15.132:0/1203100484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40ca210 0x7f9cc40b1640 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009920 tx=0x7f9cb4009c30 comp rx=0 tx=0).stop 2023-05-10T04:20:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.287+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/1203100484 shutdown_connections 2023-05-10T04:20:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.287+0000 7f9ccc1ff700 1 --2- 172.21.15.132:0/1203100484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40ca210 0x7f9cc40b1640 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.287+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/1203100484 >> 172.21.15.132:0/1203100484 conn(0x7f9cc406e980 msgr2=0x7f9cc40cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.287+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/1203100484 shutdown_connections 2023-05-10T04:20:48.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.287+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/1203100484 wait complete. 2023-05-10T04:20:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.288+0000 7f9ccc1ff700 1 Processor -- start 2023-05-10T04:20:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.288+0000 7f9ccc1ff700 1 -- start start 2023-05-10T04:20:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.289+0000 7f9ccc1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40b1b80 0x7f9cc415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.289+0000 7f9ccc1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc40ca210 0x7f9cc40b29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.289+0000 7f9ccc1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc40cd790 0x7f9cc40b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.289+0000 7f9ccc1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc40c9730 con 0x7f9cc40b1b80 2023-05-10T04:20:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.289+0000 7f9ccc1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc4147220 con 0x7f9cc40ca210 2023-05-10T04:20:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.289+0000 7f9ccc1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc415b2b0 con 0x7f9cc40cd790 2023-05-10T04:20:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40b1b80 0x7f9cc415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40b1b80 0x7f9cc415ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38814/0 (socket says 172.21.15.132:38814) 2023-05-10T04:20:48.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 -- 172.21.15.132:0/2721604622 learned_addr learned my addr 172.21.15.132:0/2721604622 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc979a700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc40ca210 0x7f9cc40b29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cca79c700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc40cd790 0x7f9cc40b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 -- 172.21.15.132:0/2721604622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc40cd790 msgr2=0x7f9cc40b44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc40cd790 0x7f9cc40b44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 -- 172.21.15.132:0/2721604622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc40ca210 msgr2=0x7f9cc40b29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc40ca210 0x7f9cc40b29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 -- 172.21.15.132:0/2721604622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb4009550 con 0x7f9cc40b1b80 2023-05-10T04:20:48.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.290+0000 7f9cc9f9b700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40b1b80 0x7f9cc415ad70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000c4e0 tx=0x7f9cc000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:48.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.291+0000 7f9cba7fc700 1 -- 172.21.15.132:0/2721604622 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00052d0 con 0x7f9cc40b1b80 2023-05-10T04:20:48.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.291+0000 7f9cba7fc700 1 -- 172.21.15.132:0/2721604622 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc0005430 con 0x7f9cc40b1b80 2023-05-10T04:20:48.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.291+0000 7f9cba7fc700 1 -- 172.21.15.132:0/2721604622 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc00038c0 con 0x7f9cc40b1b80 2023-05-10T04:20:48.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.291+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc406b0e0 con 0x7f9cc40b1b80 2023-05-10T04:20:48.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.291+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc406ae00 con 0x7f9cc40b1b80 2023-05-10T04:20:48.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.292+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc40b2000 con 0x7f9cc40b1b80 2023-05-10T04:20:48.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.293+0000 7f9cba7fc700 1 -- 172.21.15.132:0/2721604622 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9cc0003a20 con 0x7f9cc40b1b80 2023-05-10T04:20:48.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.293+0000 7f9cba7fc700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f9ca806ace0 0x7f9ca806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.294+0000 7f9cba7fc700 1 -- 172.21.15.132:0/2721604622 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f9cc00886a0 con 0x7f9cc40b1b80 2023-05-10T04:20:48.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.294+0000 7f9cc979a700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f9ca806ace0 0x7f9ca806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.294+0000 7f9cc979a700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f9ca806ace0 0x7f9ca806d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009870 tx=0x7f9cb4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:48.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.298+0000 7f9cba7fc700 1 -- 172.21.15.132:0/2721604622 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f9cc00538c0 con 0x7f9cc40b1b80 2023-05-10T04:20:48.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.576+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f9cc406c510 con 0x7f9cc40b1b80 2023-05-10T04:20:48.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.580+0000 7f9cba7fc700 1 -- 172.21.15.132:0/2721604622 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f9cc0056ee0 con 0x7f9cc40b1b80 2023-05-10T04:20:48.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f9ca806ace0 msgr2=0x7f9ca806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f9ca806ace0 0x7f9ca806d190 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f9cb4009870 tx=0x7f9cb4008030 comp rx=0 tx=0).stop 2023-05-10T04:20:48.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40b1b80 msgr2=0x7f9cc415ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40b1b80 0x7f9cc415ad70 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9cc000c4e0 tx=0x7f9cc000c7f0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 shutdown_connections 2023-05-10T04:20:48.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f9ca806ace0 0x7f9ca806d190 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f9cc40cd790 0x7f9cc40b44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cc40b1b80 0x7f9cc415ad70 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 --2- 172.21.15.132:0/2721604622 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f9cc40ca210 0x7f9cc40b29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 >> 172.21.15.132:0/2721604622 conn(0x7f9cc406e980 msgr2=0x7f9cc40cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:48.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 shutdown_connections 2023-05-10T04:20:48.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.583+0000 7f9ccc1ff700 1 -- 172.21.15.132:0/2721604622 wait complete. 2023-05-10T04:20:48.603 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-10T04:20:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.784+0000 7efd8f1ff700 1 Processor -- start 2023-05-10T04:20:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.785+0000 7efd8f1ff700 1 -- start start 2023-05-10T04:20:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd8f1ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7efd8815a5a0 0x7efd8806a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd8f1ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efd8806a920 0x7efd88070af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd8f1ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd880cb280 con 0x7efd88071030 2023-05-10T04:20:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd8f1ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8806adc0 con 0x7efd8806a920 2023-05-10T04:20:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd8f1ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd8815a970 con 0x7efd8815a5a0 2023-05-10T04:20:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd87fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efd8806a920 0x7efd88070af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd87fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efd8806a920 0x7efd88070af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38818/0 (socket says 172.21.15.132:38818) 2023-05-10T04:20:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd8d79c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7efd88071030 0x7efd8815dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53108/0 (socket says 172.21.15.132:53108) 2023-05-10T04:20:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd87fff700 1 -- 172.21.15.132:0/3087604422 learned_addr learned my addr 172.21.15.132:0/3087604422 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd8cf9b700 1 --2- 172.21.15.132:0/3087604422 >> v2:172.21.15.154:3300/0 conn(0x7efd8815a5a0 0x7efd8806a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd87fff700 1 -- 172.21.15.132:0/3087604422 >> v2:172.21.15.154:3300/0 conn(0x7efd8815a5a0 msgr2=0x7efd8806a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:48.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd87fff700 1 --2- 172.21.15.132:0/3087604422 >> v2:172.21.15.154:3300/0 conn(0x7efd8815a5a0 0x7efd8806a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd87fff700 1 -- 172.21.15.132:0/3087604422 >> v1:172.21.15.132:6789/0 conn(0x7efd88071030 legacy=0x7efd8815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd87fff700 1 -- 172.21.15.132:0/3087604422 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd88071470 con 0x7efd8806a920 2023-05-10T04:20:48.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.786+0000 7efd877fe700 1 -- 172.21.15.132:0/3087604422 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322496562 0 0) 0x7efd80001490 con 0x7efd88071030 2023-05-10T04:20:48.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd87fff700 1 --2- 172.21.15.132:0/3087604422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd88070af0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efd88067990 tx=0x7efd74009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=348d90d9a20be493 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd877fe700 1 -- 172.21.15.132:0/3087604422 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd74005e30 con 0x7efd8806a920 2023-05-10T04:20:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd877fe700 1 -- 172.21.15.132:0/3087604422 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd74004030 con 0x7efd8806a920 2023-05-10T04:20:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd877fe700 1 -- 172.21.15.132:0/3087604422 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd740043e0 con 0x7efd8806a920 2023-05-10T04:20:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd8f1ff700 1 -- 172.21.15.132:0/3087604422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 msgr2=0x7efd88070af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/3087604422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd88070af0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7efd88067990 tx=0x7efd74009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd8f1ff700 1 -- 172.21.15.132:0/3087604422 shutdown_connections 2023-05-10T04:20:48.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/3087604422 >> v2:172.21.15.154:3300/0 conn(0x7efd8815a5a0 0x7efd8806a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.787+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/3087604422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd88070af0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.788+0000 7efd8f1ff700 1 -- 172.21.15.132:0/3087604422 >> 172.21.15.132:0/3087604422 conn(0x7efd880cf720 msgr2=0x7efd880cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.788+0000 7efd8f1ff700 1 -- 172.21.15.132:0/3087604422 shutdown_connections 2023-05-10T04:20:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.788+0000 7efd8f1ff700 1 -- 172.21.15.132:0/3087604422 wait complete. 2023-05-10T04:20:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.789+0000 7efd8f1ff700 1 Processor -- start 2023-05-10T04:20:48.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.790+0000 7efd8f1ff700 1 -- start start 2023-05-10T04:20:48.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.790+0000 7efd8f1ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd8815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.790+0000 7efd8f1ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd88071030 0x7efd880c74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8f1ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8815a5a0 0x7efd880c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8f1ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c6440 con 0x7efd8806a920 2023-05-10T04:20:48.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8f1ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c6720 con 0x7efd8815a5a0 2023-05-10T04:20:48.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8f1ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd880c6a00 con 0x7efd88071030 2023-05-10T04:20:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8cf9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd8815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8cf9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd8815cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38830/0 (socket says 172.21.15.132:38830) 2023-05-10T04:20:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8cf9b700 1 -- 172.21.15.132:0/1864873991 learned_addr learned my addr 172.21.15.132:0/1864873991 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd87fff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd88071030 0x7efd880c74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8d79c700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8815a5a0 0x7efd880c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8cf9b700 1 -- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd88071030 msgr2=0x7efd880c74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8cf9b700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd88071030 0x7efd880c74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8cf9b700 1 -- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8815a5a0 msgr2=0x7efd880c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8cf9b700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8815a5a0 0x7efd880c5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8cf9b700 1 -- 172.21.15.132:0/1864873991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd74009500 con 0x7efd8806a920 2023-05-10T04:20:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.791+0000 7efd8d79c700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8815a5a0 0x7efd880c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.792+0000 7efd8cf9b700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd8815cdf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00d800 tx=0x7efd7c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.792+0000 7efd857fa700 1 -- 172.21.15.132:0/1864873991 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c0125f0 con 0x7efd8806a920 2023-05-10T04:20:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.792+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd880719e0 con 0x7efd8806a920 2023-05-10T04:20:48.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.792+0000 7efd857fa700 1 -- 172.21.15.132:0/1864873991 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd7c012750 con 0x7efd8806a920 2023-05-10T04:20:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.792+0000 7efd857fa700 1 -- 172.21.15.132:0/1864873991 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd7c012b00 con 0x7efd8806a920 2023-05-10T04:20:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.792+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd88071700 con 0x7efd8806a920 2023-05-10T04:20:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.793+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd8806c6c0 con 0x7efd8806a920 2023-05-10T04:20:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.794+0000 7efd857fa700 1 -- 172.21.15.132:0/1864873991 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd7c012c60 con 0x7efd8806a920 2023-05-10T04:20:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.795+0000 7efd857fa700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efd6c06ace0 0x7efd6c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.795+0000 7efd857fa700 1 -- 172.21.15.132:0/1864873991 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7efd7c0895e0 con 0x7efd8806a920 2023-05-10T04:20:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.795+0000 7efd87fff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efd6c06ace0 0x7efd6c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.796+0000 7efd87fff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efd6c06ace0 0x7efd6c06d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efd74000c00 tx=0x7efd74008070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:48.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:48.799+0000 7efd857fa700 1 -- 172.21.15.132:0/1864873991 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7efd7c054890 con 0x7efd8806a920 2023-05-10T04:20:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.072+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7efd880ad8c0 con 0x7efd8806a920 2023-05-10T04:20:49.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.076+0000 7efd857fa700 1 -- 172.21.15.132:0/1864873991 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7efd7c057eb0 con 0x7efd8806a920 2023-05-10T04:20:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efd6c06ace0 msgr2=0x7efd6c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efd6c06ace0 0x7efd6c06d190 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efd74000c00 tx=0x7efd74008070 comp rx=0 tx=0).stop 2023-05-10T04:20:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 msgr2=0x7efd8815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd8815cdf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00d800 tx=0x7efd7c00db10 comp rx=0 tx=0).stop 2023-05-10T04:20:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 shutdown_connections 2023-05-10T04:20:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7efd6c06ace0 0x7efd6c06d190 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7efd8815a5a0 0x7efd880c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd8806a920 0x7efd8815cdf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 --2- 172.21.15.132:0/1864873991 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7efd88071030 0x7efd880c74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 >> 172.21.15.132:0/1864873991 conn(0x7efd880cf720 msgr2=0x7efd88158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 shutdown_connections 2023-05-10T04:20:49.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.079+0000 7efd8f1ff700 1 -- 172.21.15.132:0/1864873991 wait complete. 2023-05-10T04:20:49.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-10T04:20:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.280+0000 7fd9b8dff700 1 Processor -- start 2023-05-10T04:20:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.280+0000 7fd9b8dff700 1 -- start start 2023-05-10T04:20:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.281+0000 7fd9b8dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9b40b87a0 0x7fd9b40cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.281+0000 7fd9b8dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b41601e0 0x7fd9b4160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.281+0000 7fd9b8dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fd9b4160b70 0x7fd9b40d2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.281+0000 7fd9b8dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b40d02d0 con 0x7fd9b40b87a0 2023-05-10T04:20:49.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.281+0000 7fd9b8dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9b40d0cb0 con 0x7fd9b4160b70 2023-05-10T04:20:49.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.281+0000 7fd9b8dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40b2730 con 0x7fd9b41601e0 2023-05-10T04:20:49.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9b40b87a0 0x7fd9b40cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd9b40b87a0 0x7fd9b40cfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38832/0 (socket says 172.21.15.132:38832) 2023-05-10T04:20:49.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 -- 172.21.15.132:0/1486599339 learned_addr learned my addr 172.21.15.132:0/1486599339 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:49.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b1d9b700 1 --2- 172.21.15.132:0/1486599339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b41601e0 0x7fd9b4160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b2d9d700 1 --2- 172.21.15.132:0/1486599339 >> v2:172.21.15.154:3300/0 conn(0x7fd9b4160b70 0x7fd9b40d2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 -- 172.21.15.132:0/1486599339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b41601e0 msgr2=0x7fd9b4160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 --2- 172.21.15.132:0/1486599339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b41601e0 0x7fd9b4160630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 -- 172.21.15.132:0/1486599339 >> v2:172.21.15.154:3300/0 conn(0x7fd9b4160b70 msgr2=0x7fd9b40d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 --2- 172.21.15.132:0/1486599339 >> v2:172.21.15.154:3300/0 conn(0x7fd9b4160b70 0x7fd9b40d2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 -- 172.21.15.132:0/1486599339 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9b4160ff0 con 0x7fd9b40b87a0 2023-05-10T04:20:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b259c700 1 --2- 172.21.15.132:0/1486599339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b40b87a0 0x7fd9b40cfbf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd9b408be30 tx=0x7fd9a4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a651c3f9eb0b04b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.282+0000 7fd9b159a700 1 -- 172.21.15.132:0/1486599339 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400b870 con 0x7fd9b40b87a0 2023-05-10T04:20:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b159a700 1 -- 172.21.15.132:0/1486599339 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9a400b9d0 con 0x7fd9b40b87a0 2023-05-10T04:20:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b159a700 1 -- 172.21.15.132:0/1486599339 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a400bd60 con 0x7fd9b40b87a0 2023-05-10T04:20:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1486599339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b40b87a0 msgr2=0x7fd9b40cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1486599339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b40b87a0 0x7fd9b40cfbf0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fd9b408be30 tx=0x7fd9a4009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1486599339 shutdown_connections 2023-05-10T04:20:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1486599339 >> v2:172.21.15.154:3300/0 conn(0x7fd9b4160b70 0x7fd9b40d2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1486599339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b40b87a0 0x7fd9b40cfbf0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1486599339 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b41601e0 0x7fd9b4160630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1486599339 >> 172.21.15.132:0/1486599339 conn(0x7fd9b4071b10 msgr2=0x7fd9b4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1486599339 shutdown_connections 2023-05-10T04:20:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.283+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1486599339 wait complete. 2023-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.285+0000 7fd9b8dff700 1 Processor -- start 2023-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.285+0000 7fd9b8dff700 1 -- start start 2023-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b8dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b40b87a0 0x7fd9b40c6030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b8dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b41601e0 0x7fd9b415ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b8dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b4160b70 0x7fd9b415d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b8dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b41e89c0 con 0x7fd9b4160b70 2023-05-10T04:20:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b8dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b41e86e0 con 0x7fd9b41601e0 2023-05-10T04:20:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b8dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b40c70c0 con 0x7fd9b40b87a0 2023-05-10T04:20:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b2d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b4160b70 0x7fd9b415d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b2d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b4160b70 0x7fd9b415d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38836/0 (socket says 172.21.15.132:38836) 2023-05-10T04:20:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b2d9d700 1 -- 172.21.15.132:0/1593415288 learned_addr learned my addr 172.21.15.132:0/1593415288 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b259c700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b40b87a0 0x7fd9b40c6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.286+0000 7fd9b1d9b700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b41601e0 0x7fd9b415ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9b2d9d700 1 -- 172.21.15.132:0/1593415288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b40b87a0 msgr2=0x7fd9b40c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9b2d9d700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b40b87a0 0x7fd9b40c6030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9b2d9d700 1 -- 172.21.15.132:0/1593415288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b41601e0 msgr2=0x7fd9b415ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9b2d9d700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b41601e0 0x7fd9b415ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9b2d9d700 1 -- 172.21.15.132:0/1593415288 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9a4009550 con 0x7fd9b4160b70 2023-05-10T04:20:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9b2d9d700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b4160b70 0x7fd9b415d200 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac007e40 tx=0x7fd9ac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9a2ffd700 1 -- 172.21.15.132:0/1593415288 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac00eea0 con 0x7fd9b4160b70 2023-05-10T04:20:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9a2ffd700 1 -- 172.21.15.132:0/1593415288 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9ac014420 con 0x7fd9b4160b70 2023-05-10T04:20:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9a2ffd700 1 -- 172.21.15.132:0/1593415288 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9ac0147b0 con 0x7fd9b4160b70 2023-05-10T04:20:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b40cd6a0 con 0x7fd9b4160b70 2023-05-10T04:20:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.287+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b40cdc60 con 0x7fd9b4160b70 2023-05-10T04:20:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.288+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b40cd980 con 0x7fd9b4160b70 2023-05-10T04:20:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.289+0000 7fd9a2ffd700 1 -- 172.21.15.132:0/1593415288 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd9ac014910 con 0x7fd9b4160b70 2023-05-10T04:20:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.290+0000 7fd9a2ffd700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd99406ace0 0x7fd99406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.290+0000 7fd9a2ffd700 1 -- 172.21.15.132:0/1593415288 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fd9ac089b10 con 0x7fd9b4160b70 2023-05-10T04:20:49.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.290+0000 7fd9b259c700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd99406ace0 0x7fd99406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.291+0000 7fd9b259c700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd99406ace0 0x7fd99406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4014040 tx=0x7fd9a4008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.294+0000 7fd9a2ffd700 1 -- 172.21.15.132:0/1593415288 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fd9ac054d40 con 0x7fd9b4160b70 2023-05-10T04:20:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.572+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fd9b4074430 con 0x7fd9b4160b70 2023-05-10T04:20:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.576+0000 7fd9a2ffd700 1 -- 172.21.15.132:0/1593415288 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd9ac058360 con 0x7fd9b4160b70 2023-05-10T04:20:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd99406ace0 msgr2=0x7fd99406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd99406ace0 0x7fd99406d190 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd9a4014040 tx=0x7fd9a4008030 comp rx=0 tx=0).stop 2023-05-10T04:20:49.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b4160b70 msgr2=0x7fd9b415d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b4160b70 0x7fd9b415d200 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac007e40 tx=0x7fd9ac00e3c0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 shutdown_connections 2023-05-10T04:20:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fd99406ace0 0x7fd99406d190 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9b4160b70 0x7fd9b415d200 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fd9b40b87a0 0x7fd9b40c6030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 --2- 172.21.15.132:0/1593415288 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fd9b41601e0 0x7fd9b415ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.578+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 >> 172.21.15.132:0/1593415288 conn(0x7fd9b4071b10 msgr2=0x7fd9b40b7cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.579+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 shutdown_connections 2023-05-10T04:20:49.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.579+0000 7fd9b8dff700 1 -- 172.21.15.132:0/1593415288 wait complete. 2023-05-10T04:20:49.599 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-10T04:20:49.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.780+0000 7f1f4adff700 1 Processor -- start 2023-05-10T04:20:49.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.780+0000 7f1f4adff700 1 -- start start 2023-05-10T04:20:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.781+0000 7f1f4adff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f440cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f4adff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440cdc60 con 0x7f1f441601e0 2023-05-10T04:20:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f4adff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f440cd6a0 con 0x7f1f44160d40 2023-05-10T04:20:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f4adff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f440d02d0 con 0x7f1f440b87a0 2023-05-10T04:20:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f43fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1f441601e0 0x7f1f44160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53114/0 (socket says 172.21.15.132:53114) 2023-05-10T04:20:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f43fff700 1 -- 172.21.15.132:0/1458378166 learned_addr learned my addr 172.21.15.132:0/1458378166 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:49.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f48b9b700 1 --2- 172.21.15.132:0/1458378166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f440cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f437fe700 1 -- 172.21.15.132:0/1458378166 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442475575 0 0) 0x7f1f440cdc60 con 0x7f1f441601e0 2023-05-10T04:20:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f437fe700 1 -- 172.21.15.132:0/1458378166 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f340035b0 con 0x7f1f441601e0 2023-05-10T04:20:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f437fe700 1 -- 172.21.15.132:0/1458378166 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 697406833 0 0) 0x7f1f440cd6a0 con 0x7f1f44160d40 2023-05-10T04:20:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f437fe700 1 -- 172.21.15.132:0/1458378166 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f440cdc60 con 0x7f1f44160d40 2023-05-10T04:20:49.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f48b9b700 1 -- 172.21.15.132:0/1458378166 >> v1:172.21.15.154:6789/0 conn(0x7f1f44160d40 legacy=0x7f1f440d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f48b9b700 1 -- 172.21.15.132:0/1458378166 >> v1:172.21.15.132:6789/0 conn(0x7f1f441601e0 legacy=0x7f1f44160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.782+0000 7f1f48b9b700 1 -- 172.21.15.132:0/1458378166 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f440cd980 con 0x7f1f440b87a0 2023-05-10T04:20:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.783+0000 7f1f48b9b700 1 --2- 172.21.15.132:0/1458378166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f440cfbf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009870 tx=0x7f1f38009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=769e414e452bce1c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.783+0000 7f1f437fe700 1 -- 172.21.15.132:0/1458378166 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38011830 con 0x7f1f440b87a0 2023-05-10T04:20:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.783+0000 7f1f437fe700 1 -- 172.21.15.132:0/1458378166 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f38011990 con 0x7f1f440b87a0 2023-05-10T04:20:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.783+0000 7f1f437fe700 1 -- 172.21.15.132:0/1458378166 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f38011d20 con 0x7f1f440b87a0 2023-05-10T04:20:49.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.784+0000 7f1f4adff700 1 -- 172.21.15.132:0/1458378166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 msgr2=0x7f1f440cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.784+0000 7f1f4adff700 1 --2- 172.21.15.132:0/1458378166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f440cfbf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009870 tx=0x7f1f38009b80 comp rx=0 tx=0).stop 2023-05-10T04:20:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.784+0000 7f1f4adff700 1 -- 172.21.15.132:0/1458378166 shutdown_connections 2023-05-10T04:20:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.784+0000 7f1f4adff700 1 --2- 172.21.15.132:0/1458378166 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f440cfbf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.784+0000 7f1f4adff700 1 -- 172.21.15.132:0/1458378166 >> 172.21.15.132:0/1458378166 conn(0x7f1f44071b10 msgr2=0x7f1f44071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.784+0000 7f1f4adff700 1 -- 172.21.15.132:0/1458378166 shutdown_connections 2023-05-10T04:20:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.784+0000 7f1f4adff700 1 -- 172.21.15.132:0/1458378166 wait complete. 2023-05-10T04:20:49.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.786+0000 7f1f4adff700 1 Processor -- start 2023-05-10T04:20:49.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.786+0000 7f1f4adff700 1 -- start start 2023-05-10T04:20:49.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4adff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f441541a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4adff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f441601e0 0x7f1f440c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4adff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f44160d40 0x7f1f44159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4adff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4415da90 con 0x7f1f44160d40 2023-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4adff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4415ce80 con 0x7f1f441601e0 2023-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4adff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f4415d160 con 0x7f1f440b87a0 2023-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4939c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f44160d40 0x7f1f44159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4939c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f44160d40 0x7f1f44159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38848/0 (socket says 172.21.15.132:38848) 2023-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4939c700 1 -- 172.21.15.132:0/589212747 learned_addr learned my addr 172.21.15.132:0/589212747 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f48b9b700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f441541a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f43fff700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f441601e0 0x7f1f440c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4939c700 1 -- 172.21.15.132:0/589212747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 msgr2=0x7f1f441541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4939c700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f441541a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4939c700 1 -- 172.21.15.132:0/589212747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f441601e0 msgr2=0x7f1f440c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4939c700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f441601e0 0x7f1f440c88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.787+0000 7f1f4939c700 1 -- 172.21.15.132:0/589212747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f380094a0 con 0x7f1f44160d40 2023-05-10T04:20:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.788+0000 7f1f4939c700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f44160d40 0x7f1f44159830 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00cbc0 tx=0x7f1f3c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:49.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.788+0000 7f1f417fa700 1 -- 172.21.15.132:0/589212747 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c003c00 con 0x7f1f44160d40 2023-05-10T04:20:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.788+0000 7f1f417fa700 1 -- 172.21.15.132:0/589212747 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f3c003d60 con 0x7f1f44160d40 2023-05-10T04:20:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.788+0000 7f1f417fa700 1 -- 172.21.15.132:0/589212747 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c00abb0 con 0x7f1f44160d40 2023-05-10T04:20:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.788+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f440d19a0 con 0x7f1f44160d40 2023-05-10T04:20:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.788+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f440d1810 con 0x7f1f44160d40 2023-05-10T04:20:49.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.789+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f440d1b30 con 0x7f1f44160d40 2023-05-10T04:20:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.790+0000 7f1f417fa700 1 -- 172.21.15.132:0/589212747 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1f3c00ad10 con 0x7f1f44160d40 2023-05-10T04:20:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.791+0000 7f1f417fa700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1f2806ace0 0x7f1f2806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.791+0000 7f1f417fa700 1 -- 172.21.15.132:0/589212747 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1f3c0893e0 con 0x7f1f44160d40 2023-05-10T04:20:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.791+0000 7f1f48b9b700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1f2806ace0 0x7f1f2806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.792+0000 7f1f48b9b700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1f2806ace0 0x7f1f2806d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f380097c0 tx=0x7f1f3801c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:49.795+0000 7f1f417fa700 1 -- 172.21.15.132:0/589212747 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1f3c054690 con 0x7f1f44160d40 2023-05-10T04:20:50.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.072+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f1f441e6810 con 0x7f1f44160d40 2023-05-10T04:20:50.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.076+0000 7f1f417fa700 1 -- 172.21.15.132:0/589212747 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f1f3c057cb0 con 0x7f1f44160d40 2023-05-10T04:20:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1f2806ace0 msgr2=0x7f1f2806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1f2806ace0 0x7f1f2806d190 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1f380097c0 tx=0x7f1f3801c040 comp rx=0 tx=0).stop 2023-05-10T04:20:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f44160d40 msgr2=0x7f1f44159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f44160d40 0x7f1f44159830 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00cbc0 tx=0x7f1f3c00cf80 comp rx=0 tx=0).stop 2023-05-10T04:20:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 shutdown_connections 2023-05-10T04:20:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1f2806ace0 0x7f1f2806d190 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1f44160d40 0x7f1f44159830 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1f440b87a0 0x7f1f441541a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 --2- 172.21.15.132:0/589212747 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1f441601e0 0x7f1f440c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 >> 172.21.15.132:0/589212747 conn(0x7f1f44071b10 msgr2=0x7f1f440b6a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 shutdown_connections 2023-05-10T04:20:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.079+0000 7f1f4adff700 1 -- 172.21.15.132:0/589212747 wait complete. 2023-05-10T04:20:50.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-10T04:20:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.280+0000 7fe028dff700 1 Processor -- start 2023-05-10T04:20:50.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.280+0000 7fe028dff700 1 -- start start 2023-05-10T04:20:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe028dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0240adf70 0x7fe0240cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe028dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe02415cf10 0x7fe02406c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe028dff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0240cc9e0 con 0x7fe0240cd760 2023-05-10T04:20:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe028dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe02415de20 con 0x7fe0240adf70 2023-05-10T04:20:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe028dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe02415d860 con 0x7fe02415cf10 2023-05-10T04:20:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe01bfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0240adf70 0x7fe0240cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe02259c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe0240cd760 0x7fe0240cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53130/0 (socket says 172.21.15.132:53130) 2023-05-10T04:20:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe02259c700 1 -- 172.21.15.132:0/3479458207 learned_addr learned my addr 172.21.15.132:0/3479458207 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.281+0000 7fe01bfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0240adf70 0x7fe0240cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38856/0 (socket says 172.21.15.132:38856) 2023-05-10T04:20:50.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe022d9d700 1 --2- 172.21.15.132:0/3479458207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe02415cf10 0x7fe02406c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe01bfff700 1 -- 172.21.15.132:0/3479458207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe02415cf10 msgr2=0x7fe02406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe01bfff700 1 --2- 172.21.15.132:0/3479458207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe02415cf10 0x7fe02406c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe01bfff700 1 -- 172.21.15.132:0/3479458207 >> v1:172.21.15.132:6789/0 conn(0x7fe0240cd760 legacy=0x7fe0240cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe01bfff700 1 -- 172.21.15.132:0/3479458207 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe02415db40 con 0x7fe0240adf70 2023-05-10T04:20:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe021d9b700 1 -- 172.21.15.132:0/3479458207 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491478879 0 0) 0x7fe0240cc9e0 con 0x7fe0240cd760 2023-05-10T04:20:50.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe01bfff700 1 --2- 172.21.15.132:0/3479458207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0240adf70 0x7fe0240cce70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009820 tx=0x7fe00c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce8f76611f363a0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe021d9b700 1 -- 172.21.15.132:0/3479458207 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c005e30 con 0x7fe0240adf70 2023-05-10T04:20:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe021d9b700 1 -- 172.21.15.132:0/3479458207 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00c006030 con 0x7fe0240adf70 2023-05-10T04:20:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.282+0000 7fe021d9b700 1 -- 172.21.15.132:0/3479458207 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0063e0 con 0x7fe0240adf70 2023-05-10T04:20:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.283+0000 7fe028dff700 1 -- 172.21.15.132:0/3479458207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0240adf70 msgr2=0x7fe0240cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.283+0000 7fe028dff700 1 --2- 172.21.15.132:0/3479458207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0240adf70 0x7fe0240cce70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009820 tx=0x7fe00c009b30 comp rx=0 tx=0).stop 2023-05-10T04:20:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.283+0000 7fe028dff700 1 -- 172.21.15.132:0/3479458207 shutdown_connections 2023-05-10T04:20:50.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.283+0000 7fe028dff700 1 --2- 172.21.15.132:0/3479458207 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe02415cf10 0x7fe02406c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.283+0000 7fe028dff700 1 --2- 172.21.15.132:0/3479458207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0240adf70 0x7fe0240cce70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.283+0000 7fe028dff700 1 -- 172.21.15.132:0/3479458207 >> 172.21.15.132:0/3479458207 conn(0x7fe0240cf720 msgr2=0x7fe0240cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.283+0000 7fe028dff700 1 -- 172.21.15.132:0/3479458207 shutdown_connections 2023-05-10T04:20:50.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.283+0000 7fe028dff700 1 -- 172.21.15.132:0/3479458207 wait complete. 2023-05-10T04:20:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.285+0000 7fe028dff700 1 Processor -- start 2023-05-10T04:20:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.285+0000 7fe028dff700 1 -- start start 2023-05-10T04:20:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe028dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0240adf70 0x7fe0240b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe028dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0240cd760 0x7fe0240c7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe028dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02415cf10 0x7fe024142c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe028dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0241f0190 con 0x7fe02415cf10 2023-05-10T04:20:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe028dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240c6b20 con 0x7fe0240adf70 2023-05-10T04:20:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe028dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0240c6e00 con 0x7fe0240cd760 2023-05-10T04:20:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe022d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02415cf10 0x7fe024142c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe022d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02415cf10 0x7fe024142c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38870/0 (socket says 172.21.15.132:38870) 2023-05-10T04:20:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe022d9d700 1 -- 172.21.15.132:0/2738364552 learned_addr learned my addr 172.21.15.132:0/2738364552 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe01bfff700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0240cd760 0x7fe0240c7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe022d9d700 1 -- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0240cd760 msgr2=0x7fe0240c7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe02259c700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0240adf70 0x7fe0240b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe022d9d700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0240cd760 0x7fe0240c7bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe022d9d700 1 -- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0240adf70 msgr2=0x7fe0240b0b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe022d9d700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0240adf70 0x7fe0240b0b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe022d9d700 1 -- 172.21.15.132:0/2738364552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c009430 con 0x7fe02415cf10 2023-05-10T04:20:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe01bfff700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0240cd760 0x7fe0240c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:50.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.286+0000 7fe02259c700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0240adf70 0x7fe0240b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:20:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.287+0000 7fe022d9d700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02415cf10 0x7fe024142c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe01c007e40 tx=0x7fe01c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.287+0000 7fe01affd700 1 -- 172.21.15.132:0/2738364552 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c00eea0 con 0x7fe02415cf10 2023-05-10T04:20:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.287+0000 7fe01affd700 1 -- 172.21.15.132:0/2738364552 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01c014420 con 0x7fe02415cf10 2023-05-10T04:20:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.287+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe024071600 con 0x7fe02415cf10 2023-05-10T04:20:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.287+0000 7fe01affd700 1 -- 172.21.15.132:0/2738364552 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0147b0 con 0x7fe02415cf10 2023-05-10T04:20:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.287+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0240cc670 con 0x7fe02415cf10 2023-05-10T04:20:50.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.288+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0240cd3b0 con 0x7fe02415cf10 2023-05-10T04:20:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.289+0000 7fe01affd700 1 -- 172.21.15.132:0/2738364552 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe01c014910 con 0x7fe02415cf10 2023-05-10T04:20:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.290+0000 7fe01affd700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe00406ace0 0x7fe00406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.290+0000 7fe01affd700 1 -- 172.21.15.132:0/2738364552 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe01c089ab0 con 0x7fe02415cf10 2023-05-10T04:20:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.291+0000 7fe02259c700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe00406ace0 0x7fe00406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.291+0000 7fe02259c700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe00406ace0 0x7fe00406d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe014000f60 tx=0x7fe014009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:50.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.295+0000 7fe01affd700 1 -- 172.21.15.132:0/2738364552 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe01c054d70 con 0x7fe02415cf10 2023-05-10T04:20:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.568+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fe0240cbd20 con 0x7fe02415cf10 2023-05-10T04:20:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.572+0000 7fe01affd700 1 -- 172.21.15.132:0/2738364552 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe01c058390 con 0x7fe02415cf10 2023-05-10T04:20:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe00406ace0 msgr2=0x7fe00406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe00406ace0 0x7fe00406d190 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe014000f60 tx=0x7fe014009040 comp rx=0 tx=0).stop 2023-05-10T04:20:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02415cf10 msgr2=0x7fe024142c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02415cf10 0x7fe024142c60 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fe01c007e40 tx=0x7fe01c00e3c0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 shutdown_connections 2023-05-10T04:20:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe00406ace0 0x7fe00406d190 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe02415cf10 0x7fe024142c60 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe0240adf70 0x7fe0240b0b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 --2- 172.21.15.132:0/2738364552 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe0240cd760 0x7fe0240c7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 >> 172.21.15.132:0/2738364552 conn(0x7fe0240cf720 msgr2=0x7fe0240cb130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 shutdown_connections 2023-05-10T04:20:50.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.575+0000 7fe028dff700 1 -- 172.21.15.132:0/2738364552 wait complete. 2023-05-10T04:20:50.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:50.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.773+0000 7f2852bff700 1 Processor -- start 2023-05-10T04:20:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.774+0000 7f2852bff700 1 -- start start 2023-05-10T04:20:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f2852bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c0ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f2852bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c06a5f0 con 0x7f284c0cdb60 2023-05-10T04:20:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f2852bff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c06a840 con 0x7f284c0b1d50 2023-05-10T04:20:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f2852bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c06ab20 con 0x7f284c0cd790 2023-05-10T04:20:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f284bfff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f284c0cdb60 0x7f284c0b1640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53136/0 (socket says 172.21.15.132:53136) 2023-05-10T04:20:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f284bfff700 1 -- 172.21.15.132:0/3716585178 learned_addr learned my addr 172.21.15.132:0/3716585178 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f285099b700 1 --2- 172.21.15.132:0/3716585178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c0ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f284b7fe700 1 -- 172.21.15.132:0/3716585178 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239112780 0 0) 0x7f284c06a5f0 con 0x7f284c0cdb60 2023-05-10T04:20:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f284b7fe700 1 -- 172.21.15.132:0/3716585178 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f283c0035b0 con 0x7f284c0cdb60 2023-05-10T04:20:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.775+0000 7f284b7fe700 1 -- 172.21.15.132:0/3716585178 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634009171 0 0) 0x7f284c06a840 con 0x7f284c0b1d50 2023-05-10T04:20:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.776+0000 7f284b7fe700 1 -- 172.21.15.132:0/3716585178 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284c06a5f0 con 0x7f284c0b1d50 2023-05-10T04:20:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.776+0000 7f285099b700 1 -- 172.21.15.132:0/3716585178 >> v1:172.21.15.154:6789/0 conn(0x7f284c0b1d50 legacy=0x7f284c06b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.776+0000 7f285099b700 1 -- 172.21.15.132:0/3716585178 >> v1:172.21.15.132:6789/0 conn(0x7f284c0cdb60 legacy=0x7f284c0b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.776+0000 7f285099b700 1 -- 172.21.15.132:0/3716585178 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c06ae00 con 0x7f284c0cd790 2023-05-10T04:20:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.776+0000 7f285099b700 1 --2- 172.21.15.132:0/3716585178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c0ca210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2840009870 tx=0x7f2840009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7effb4958f8be25 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.776+0000 7f284b7fe700 1 -- 172.21.15.132:0/3716585178 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011830 con 0x7f284c0cd790 2023-05-10T04:20:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.776+0000 7f284b7fe700 1 -- 172.21.15.132:0/3716585178 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2840011990 con 0x7f284c0cd790 2023-05-10T04:20:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.776+0000 7f284b7fe700 1 -- 172.21.15.132:0/3716585178 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011d00 con 0x7f284c0cd790 2023-05-10T04:20:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.777+0000 7f2852bff700 1 -- 172.21.15.132:0/3716585178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 msgr2=0x7f284c0ca210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.777+0000 7f2852bff700 1 --2- 172.21.15.132:0/3716585178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c0ca210 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2840009870 tx=0x7f2840009b80 comp rx=0 tx=0).stop 2023-05-10T04:20:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.777+0000 7f2852bff700 1 -- 172.21.15.132:0/3716585178 shutdown_connections 2023-05-10T04:20:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.777+0000 7f2852bff700 1 --2- 172.21.15.132:0/3716585178 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c0ca210 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.777+0000 7f2852bff700 1 -- 172.21.15.132:0/3716585178 >> 172.21.15.132:0/3716585178 conn(0x7f284c06e980 msgr2=0x7f284c0cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.777+0000 7f2852bff700 1 -- 172.21.15.132:0/3716585178 shutdown_connections 2023-05-10T04:20:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.777+0000 7f2852bff700 1 -- 172.21.15.132:0/3716585178 wait complete. 2023-05-10T04:20:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.779+0000 7f2852bff700 1 Processor -- start 2023-05-10T04:20:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.779+0000 7f2852bff700 1 -- start start 2023-05-10T04:20:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.779+0000 7f2852bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0b1d50 0x7f284c15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.779+0000 7f2852bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c15f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f2852bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c0cdb60 0x7f284c146850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f2852bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c15fd40 con 0x7f284c0b1d50 2023-05-10T04:20:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f2852bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c1477f0 con 0x7f284c0cdb60 2023-05-10T04:20:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f2852bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0ac210 con 0x7f284c0cd790 2023-05-10T04:20:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0b1d50 0x7f284c15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0b1d50 0x7f284c15f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38872/0 (socket says 172.21.15.132:38872) 2023-05-10T04:20:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 -- 172.21.15.132:0/3636702965 learned_addr learned my addr 172.21.15.132:0/3636702965 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285119c700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c0cdb60 0x7f284c146850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f284bfff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c15f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 -- 172.21.15.132:0/3636702965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 msgr2=0x7f284c15f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c15f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 -- 172.21.15.132:0/3636702965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c0cdb60 msgr2=0x7f284c146850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c0cdb60 0x7f284c146850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 -- 172.21.15.132:0/3636702965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28400094a0 con 0x7f284c0b1d50 2023-05-10T04:20:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.780+0000 7f285099b700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0b1d50 0x7f284c15f2c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f28400090b0 tx=0x7f2840004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.781+0000 7f28497fa700 1 -- 172.21.15.132:0/3636702965 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400045d0 con 0x7f284c0b1d50 2023-05-10T04:20:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.781+0000 7f28497fa700 1 -- 172.21.15.132:0/3636702965 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284001e070 con 0x7f284c0b1d50 2023-05-10T04:20:50.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.781+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c0cdfd0 con 0x7f284c0b1d50 2023-05-10T04:20:50.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.781+0000 7f28497fa700 1 -- 172.21.15.132:0/3636702965 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400038e0 con 0x7f284c0b1d50 2023-05-10T04:20:50.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.781+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c06b0e0 con 0x7f284c0b1d50 2023-05-10T04:20:50.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.782+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c15ca20 con 0x7f284c0b1d50 2023-05-10T04:20:50.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.783+0000 7f28497fa700 1 -- 172.21.15.132:0/3636702965 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2840003a40 con 0x7f284c0b1d50 2023-05-10T04:20:50.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.784+0000 7f28497fa700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f283006ace0 0x7f283006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:50.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.784+0000 7f28497fa700 1 -- 172.21.15.132:0/3636702965 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f284008a250 con 0x7f284c0b1d50 2023-05-10T04:20:50.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.784+0000 7f284bfff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f283006ace0 0x7f283006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:50.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.785+0000 7f284bfff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f283006ace0 0x7f283006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2838000f60 tx=0x7f2838009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:50.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.788+0000 7f28497fa700 1 -- 172.21.15.132:0/3636702965 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2840055500 con 0x7f284c0b1d50 2023-05-10T04:20:50.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.985+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f284c06c510 con 0x7f284c0b1d50 2023-05-10T04:20:50.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.986+0000 7f28497fa700 1 -- 172.21.15.132:0/3636702965 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+14906 (secure 0 0 0) 0x7f2840058b20 con 0x7f284c0b1d50 2023-05-10T04:20:50.989 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:50.990 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":37,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:20:47.073453+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:50.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f283006ace0 msgr2=0x7f283006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f283006ace0 0x7f283006d190 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2838000f60 tx=0x7f2838009040 comp rx=0 tx=0).stop 2023-05-10T04:20:50.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0b1d50 msgr2=0x7f284c15f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:50.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0b1d50 0x7f284c15f2c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f28400090b0 tx=0x7f2840004750 comp rx=0 tx=0).stop 2023-05-10T04:20:50.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 shutdown_connections 2023-05-10T04:20:50.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f283006ace0 0x7f283006d190 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f284c0cdb60 0x7f284c146850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f284c0b1d50 0x7f284c15f2c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 --2- 172.21.15.132:0/3636702965 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f284c0cd790 0x7f284c15f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 >> 172.21.15.132:0/3636702965 conn(0x7f284c06e980 msgr2=0x7f284c157b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 shutdown_connections 2023-05-10T04:20:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:50.989+0000 7f2852bff700 1 -- 172.21.15.132:0/3636702965 wait complete. 2023-05-10T04:20:51.010 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-10T04:18:55.368075+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-10T04:19:02.680042+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 4.980000019073486, 'score_stable': 4.980000019073486, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 4.380000114440918, 'raw_score_stable': 4.380000114440918, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-10T04:20:51.011 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-10T04:20:51.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.193+0000 7f27497ff700 1 Processor -- start 2023-05-10T04:20:51.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.194+0000 7f27497ff700 1 -- start start 2023-05-10T04:20:51.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.195+0000 7f27497ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f27440cfbf0 0x7f27441608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.195+0000 7f27497ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27440d0020 con 0x7f27440d1100 2023-05-10T04:20:51.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.195+0000 7f27497ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27440cdc60 con 0x7f27440b87a0 2023-05-10T04:20:51.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.195+0000 7f27497ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27440d02d0 con 0x7f27440cfbf0 2023-05-10T04:20:51.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.195+0000 7f27437fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f27440d1100 0x7f27440d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53144/0 (socket says 172.21.15.132:53144) 2023-05-10T04:20:51.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.195+0000 7f27437fe700 1 -- 172.21.15.132:0/3809749417 learned_addr learned my addr 172.21.15.132:0/3809749417 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:51.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.195+0000 7f273bfff700 1 --2- 172.21.15.132:0/3809749417 >> v2:172.21.15.154:3300/0 conn(0x7f27440cfbf0 0x7f27441608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.195+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 813344859 0 0) 0x7f27440d0020 con 0x7f27440d1100 2023-05-10T04:20:51.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27300035b0 con 0x7f27440d1100 2023-05-10T04:20:51.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225237399 0 0) 0x7f27440cdc60 con 0x7f27440b87a0 2023-05-10T04:20:51.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27440d0020 con 0x7f27440b87a0 2023-05-10T04:20:51.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1198527529 0 0) 0x7f27300035b0 con 0x7f27440d1100 2023-05-10T04:20:51.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 >> v2:172.21.15.154:3300/0 conn(0x7f27440cfbf0 msgr2=0x7f27441608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:51.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 --2- 172.21.15.132:0/3809749417 >> v2:172.21.15.154:3300/0 conn(0x7f27440cfbf0 0x7f27441608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 >> v1:172.21.15.154:6789/0 conn(0x7f27440b87a0 legacy=0x7f27441601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27440cd6a0 con 0x7f27440d1100 2023-05-10T04:20:51.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f273c0019f0 con 0x7f27440d1100 2023-05-10T04:20:51.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f273bfff700 1 --2- 172.21.15.132:0/3809749417 >> v2:172.21.15.154:3300/0 conn(0x7f27440cfbf0 0x7f27441608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:51.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 >> v1:172.21.15.132:6789/0 conn(0x7f27440d1100 legacy=0x7f27440d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730003b90 0x7f2730003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f2730004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2730005200 0x7f273000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27440d02d0 con 0x7f2730004850 2023-05-10T04:20:51.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273000c060 con 0x7f2730005200 2023-05-10T04:20:51.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273000c220 con 0x7f2730003b90 2023-05-10T04:20:51.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f273bfff700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f2730004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f27437fe700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2730005200 0x7f273000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.196+0000 7f2742ffd700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730003b90 0x7f2730003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f273bfff700 1 -- 172.21.15.132:0/3809749417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730003b90 msgr2=0x7f2730003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:51.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f273bfff700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2730003b90 0x7f2730003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f273bfff700 1 -- 172.21.15.132:0/3809749417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2730005200 msgr2=0x7f273000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:51.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f273bfff700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2730005200 0x7f273000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f273bfff700 1 -- 172.21.15.132:0/3809749417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300035b0 con 0x7f2730004850 2023-05-10T04:20:51.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f27437fe700 1 -- 172.21.15.132:0/3809749417 reap_dead start 2023-05-10T04:20:51.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f273bfff700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f2730004cc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f272c009d30 tx=0x7f2730005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6ad11f41e3a7939 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:51.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c009e80 con 0x7f2730004850 2023-05-10T04:20:51.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c00e9a0 con 0x7f2730004850 2023-05-10T04:20:51.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.197+0000 7f27427fc700 1 -- 172.21.15.132:0/3809749417 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c00ed10 con 0x7f2730004850 2023-05-10T04:20:51.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.198+0000 7f27497ff700 1 -- 172.21.15.132:0/3809749417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 msgr2=0x7f2730004cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.198+0000 7f27497ff700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f2730004cc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f272c009d30 tx=0x7f2730005880 comp rx=0 tx=0).stop 2023-05-10T04:20:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.198+0000 7f27497ff700 1 -- 172.21.15.132:0/3809749417 shutdown_connections 2023-05-10T04:20:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.198+0000 7f27497ff700 1 --2- 172.21.15.132:0/3809749417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f2730004cc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.198+0000 7f27497ff700 1 -- 172.21.15.132:0/3809749417 >> 172.21.15.132:0/3809749417 conn(0x7f2744071b10 msgr2=0x7f2744071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.198+0000 7f27497ff700 1 -- 172.21.15.132:0/3809749417 shutdown_connections 2023-05-10T04:20:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.198+0000 7f27497ff700 1 -- 172.21.15.132:0/3809749417 wait complete. 2023-05-10T04:20:51.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.200+0000 7f27497ff700 1 Processor -- start 2023-05-10T04:20:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.200+0000 7f27497ff700 1 -- start start 2023-05-10T04:20:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f27497ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f274415ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f27497ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274415e6a0 0x7f274415a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f27497ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f274415a7d0 0x7f27441f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f27497ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274415e170 con 0x7f2730004850 2023-05-10T04:20:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f27497ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274415eb10 con 0x7f274415e6a0 2023-05-10T04:20:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f27497ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274415d4f0 con 0x7f274415a7d0 2023-05-10T04:20:51.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f274415ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f274415ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38896/0 (socket says 172.21.15.132:38896) 2023-05-10T04:20:51.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 -- 172.21.15.132:0/3724822045 learned_addr learned my addr 172.21.15.132:0/3724822045 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:51.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f273bfff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274415e6a0 0x7f274415a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f27437fe700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f274415a7d0 0x7f27441f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 -- 172.21.15.132:0/3724822045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f274415a7d0 msgr2=0x7f27441f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f274415a7d0 0x7f27441f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 -- 172.21.15.132:0/3724822045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274415e6a0 msgr2=0x7f274415a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274415e6a0 0x7f274415a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 -- 172.21.15.132:0/3724822045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27441601e0 con 0x7f2730004850 2023-05-10T04:20:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.201+0000 7f2742ffd700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f274415ce10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f273400f7e0 tx=0x7f273400faf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.202+0000 7f273b7fe700 1 -- 172.21.15.132:0/3724822045 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340052e0 con 0x7f2730004850 2023-05-10T04:20:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.202+0000 7f273b7fe700 1 -- 172.21.15.132:0/3724822045 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2734005440 con 0x7f2730004850 2023-05-10T04:20:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.202+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27440cd980 con 0x7f2730004850 2023-05-10T04:20:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.202+0000 7f273b7fe700 1 -- 172.21.15.132:0/3724822045 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27340038c0 con 0x7f2730004850 2023-05-10T04:20:51.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.202+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2744160370 con 0x7f2730004850 2023-05-10T04:20:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.203+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27440b52f0 con 0x7f2730004850 2023-05-10T04:20:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.204+0000 7f273b7fe700 1 -- 172.21.15.132:0/3724822045 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2734003a20 con 0x7f2730004850 2023-05-10T04:20:51.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.204+0000 7f273b7fe700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f272406ace0 0x7f272406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.205+0000 7f273b7fe700 1 -- 172.21.15.132:0/3724822045 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f2734088ff0 con 0x7f2730004850 2023-05-10T04:20:51.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.205+0000 7f273bfff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f272406ace0 0x7f272406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.205+0000 7f273bfff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f272406ace0 0x7f272406d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f272c0090b0 tx=0x7f272c01e040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:51.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.209+0000 7f273b7fe700 1 -- 172.21.15.132:0/3724822045 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f27340bb2d0 con 0x7f2730004850 2023-05-10T04:20:51.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.403+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27440b47d0 con 0x7f2730004850 2023-05-10T04:20:51.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.403+0000 7f273b7fe700 1 -- 172.21.15.132:0/3724822045 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27340542e0 con 0x7f2730004850 2023-05-10T04:20:51.407 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-05-10T04:20:51.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.405+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f272406ace0 msgr2=0x7f272406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.405+0000 7f27497ff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f272406ace0 0x7f272406d190 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f272c0090b0 tx=0x7f272c01e040 comp rx=0 tx=0).stop 2023-05-10T04:20:51.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 msgr2=0x7f274415ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f274415ce10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f273400f7e0 tx=0x7f273400faf0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 shutdown_connections 2023-05-10T04:20:51.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f272406ace0 0x7f272406d190 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f274415a7d0 0x7f27441f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2730004850 0x7f274415ce10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 --2- 172.21.15.132:0/3724822045 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f274415e6a0 0x7f274415a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 >> 172.21.15.132:0/3724822045 conn(0x7f2744071b10 msgr2=0x7f274415b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:51.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 shutdown_connections 2023-05-10T04:20:51.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.406+0000 7f27497ff700 1 -- 172.21.15.132:0/3724822045 wait complete. 2023-05-10T04:20:51.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-10T04:20:51.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.608+0000 7f1a5c9ff700 1 Processor -- start 2023-05-10T04:20:51.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.608+0000 7f1a5c9ff700 1 -- start start 2023-05-10T04:20:51.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.609+0000 7f1a5c9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a580b87a0 0x7f1a580cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.609+0000 7f1a5c9ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a581601e0 0x7f1a58160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.609+0000 7f1a5c9ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a58160ff0 con 0x7f1a58160b70 2023-05-10T04:20:51.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.609+0000 7f1a5c9ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a580d02d0 con 0x7f1a581601e0 2023-05-10T04:20:51.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.609+0000 7f1a5c9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a580d0cb0 con 0x7f1a580b87a0 2023-05-10T04:20:51.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a55d9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a581601e0 0x7f1a58160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a55d9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a581601e0 0x7f1a58160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38912/0 (socket says 172.21.15.132:38912) 2023-05-10T04:20:51.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a55d9b700 1 -- 172.21.15.132:0/1224707924 learned_addr learned my addr 172.21.15.132:0/1224707924 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:51.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a5659c700 1 --2- 172.21.15.132:0/1224707924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a580b87a0 0x7f1a580cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a55d9b700 1 -- 172.21.15.132:0/1224707924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a580b87a0 msgr2=0x7f1a580cfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:51.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a55d9b700 1 --2- 172.21.15.132:0/1224707924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a580b87a0 0x7f1a580cfbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a55d9b700 1 -- 172.21.15.132:0/1224707924 >> v1:172.21.15.154:6789/0 conn(0x7f1a58160b70 legacy=0x7f1a580d2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a55d9b700 1 -- 172.21.15.132:0/1224707924 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a580cdc60 con 0x7f1a581601e0 2023-05-10T04:20:51.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.610+0000 7f1a55d9b700 1 --2- 172.21.15.132:0/1224707924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a581601e0 0x7f1a58160630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0098f0 tx=0x7f1a4c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aa0ffd375758761 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:51.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5559a700 1 -- 172.21.15.132:0/1224707924 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c011830 con 0x7f1a581601e0 2023-05-10T04:20:51.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5559a700 1 -- 172.21.15.132:0/1224707924 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c011990 con 0x7f1a581601e0 2023-05-10T04:20:51.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5559a700 1 -- 172.21.15.132:0/1224707924 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c011d20 con 0x7f1a581601e0 2023-05-10T04:20:51.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/1224707924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a581601e0 msgr2=0x7f1a58160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/1224707924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a581601e0 0x7f1a58160630 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0098f0 tx=0x7f1a4c009c00 comp rx=0 tx=0).stop 2023-05-10T04:20:51.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/1224707924 shutdown_connections 2023-05-10T04:20:51.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/1224707924 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a580b87a0 0x7f1a580cfbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/1224707924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a581601e0 0x7f1a58160630 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/1224707924 >> 172.21.15.132:0/1224707924 conn(0x7f1a58071b10 msgr2=0x7f1a58071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:51.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/1224707924 shutdown_connections 2023-05-10T04:20:51.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.611+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/1224707924 wait complete. 2023-05-10T04:20:51.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.613+0000 7f1a5c9ff700 1 Processor -- start 2023-05-10T04:20:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.613+0000 7f1a5c9ff700 1 -- start start 2023-05-10T04:20:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5c9ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a580b87a0 0x7f1a581f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5c9ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a581601e0 0x7f1a581543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5c9ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a58160b70 0x7f1a5815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5c9ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5815d110 con 0x7f1a580b87a0 2023-05-10T04:20:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5c9ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5815d3f0 con 0x7f1a581601e0 2023-05-10T04:20:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5c9ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5815d6d0 con 0x7f1a58160b70 2023-05-10T04:20:51.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5659c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a580b87a0 0x7f1a581f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5659c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a580b87a0 0x7f1a581f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38922/0 (socket says 172.21.15.132:38922) 2023-05-10T04:20:51.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a5659c700 1 -- 172.21.15.132:0/3620573859 learned_addr learned my addr 172.21.15.132:0/3620573859 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:51.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a55d9b700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a581601e0 0x7f1a581543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.614+0000 7f1a56d9d700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a58160b70 0x7f1a5815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a5659c700 1 -- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a58160b70 msgr2=0x7f1a5815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a5659c700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a58160b70 0x7f1a5815e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a5659c700 1 -- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a581601e0 msgr2=0x7f1a581543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a5659c700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a581601e0 0x7f1a581543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a5659c700 1 -- 172.21.15.132:0/3620573859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c009550 con 0x7f1a580b87a0 2023-05-10T04:20:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a55d9b700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a581601e0 0x7f1a581543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a5659c700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a580b87a0 0x7f1a581f31a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e9b0 tx=0x7f1a4800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a46ffd700 1 -- 172.21.15.132:0/3620573859 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48009710 con 0x7f1a580b87a0 2023-05-10T04:20:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a46ffd700 1 -- 172.21.15.132:0/3620573859 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4800c850 con 0x7f1a580b87a0 2023-05-10T04:20:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a46ffd700 1 -- 172.21.15.132:0/3620573859 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4800cbc0 con 0x7f1a580b87a0 2023-05-10T04:20:51.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a580cd980 con 0x7f1a580b87a0 2023-05-10T04:20:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.615+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a580cd6a0 con 0x7f1a580b87a0 2023-05-10T04:20:51.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.616+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a580d2110 con 0x7f1a580b87a0 2023-05-10T04:20:51.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.617+0000 7f1a46ffd700 1 -- 172.21.15.132:0/3620573859 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a4800cd20 con 0x7f1a580b87a0 2023-05-10T04:20:51.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.618+0000 7f1a46ffd700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a3806ace0 0x7f1a3806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:51.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.618+0000 7f1a46ffd700 1 -- 172.21.15.132:0/3620573859 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f1a48089420 con 0x7f1a580b87a0 2023-05-10T04:20:51.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.618+0000 7f1a55d9b700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a3806ace0 0x7f1a3806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:51.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.619+0000 7f1a55d9b700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a3806ace0 0x7f1a3806d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009c40 tx=0x7f1a4c008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:51.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.622+0000 7f1a46ffd700 1 -- 172.21.15.132:0/3620573859 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1a480580d0 con 0x7f1a580b87a0 2023-05-10T04:20:51.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.819+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a58074430 con 0x7f1a580b87a0 2023-05-10T04:20:51.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.820+0000 7f1a46ffd700 1 -- 172.21.15.132:0/3620573859 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v37) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1a48057c60 con 0x7f1a580b87a0 2023-05-10T04:20:51.823 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 8 2023-05-10T04:20:51.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a3806ace0 msgr2=0x7f1a3806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a3806ace0 0x7f1a3806d190 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009c40 tx=0x7f1a4c008030 comp rx=0 tx=0).stop 2023-05-10T04:20:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a580b87a0 msgr2=0x7f1a581f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a580b87a0 0x7f1a581f31a0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800e9b0 tx=0x7f1a4800ed70 comp rx=0 tx=0).stop 2023-05-10T04:20:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 shutdown_connections 2023-05-10T04:20:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1a3806ace0 0x7f1a3806d190 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1a58160b70 0x7f1a5815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a580b87a0 0x7f1a581f31a0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 --2- 172.21.15.132:0/3620573859 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1a581601e0 0x7f1a581543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:51.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 >> 172.21.15.132:0/3620573859 conn(0x7f1a58071b10 msgr2=0x7f1a580b6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:51.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.822+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 shutdown_connections 2023-05-10T04:20:51.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:51.823+0000 7f1a5c9ff700 1 -- 172.21.15.132:0/3620573859 wait complete. 2023-05-10T04:20:51.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-10T04:20:52.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.024+0000 7f5433fff700 1 Processor -- start 2023-05-10T04:20:52.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.024+0000 7f5433fff700 1 -- start start 2023-05-10T04:20:52.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.025+0000 7f5433fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f542c0b87a0 0x7f542c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.025+0000 7f5433fff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c0cdc60 con 0x7f542c160d40 2023-05-10T04:20:52.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.025+0000 7f5433fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f542c0cd6a0 con 0x7f542c1601e0 2023-05-10T04:20:52.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.025+0000 7f5433fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f542c0d02d0 con 0x7f542c0b87a0 2023-05-10T04:20:52.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.025+0000 7f5431d9b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f542c0b87a0 0x7f542c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.025+0000 7f543259c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f542c160d40 0x7f542c0d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53150/0 (socket says 172.21.15.132:53150) 2023-05-10T04:20:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.025+0000 7f543259c700 1 -- 172.21.15.132:0/2558862277 learned_addr learned my addr 172.21.15.132:0/2558862277 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.026+0000 7f5431d9b700 1 -- 172.21.15.132:0/2558862277 >> v1:172.21.15.154:6789/0 conn(0x7f542c1601e0 legacy=0x7f542c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.026+0000 7f5431d9b700 1 -- 172.21.15.132:0/2558862277 >> v1:172.21.15.132:6789/0 conn(0x7f542c160d40 legacy=0x7f542c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.026+0000 7f5431d9b700 1 -- 172.21.15.132:0/2558862277 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f542c0cd980 con 0x7f542c0b87a0 2023-05-10T04:20:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.026+0000 7f5431d9b700 1 --2- 172.21.15.132:0/2558862277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0b87a0 0x7f542c0cfbf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5428009840 tx=0x7f5428009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76758d9ae573018f server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.026+0000 7f5430d99700 1 -- 172.21.15.132:0/2558862277 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428011830 con 0x7f542c0b87a0 2023-05-10T04:20:52.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.026+0000 7f5430d99700 1 -- 172.21.15.132:0/2558862277 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5428011990 con 0x7f542c0b87a0 2023-05-10T04:20:52.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.026+0000 7f5430d99700 1 -- 172.21.15.132:0/2558862277 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428011d20 con 0x7f542c0b87a0 2023-05-10T04:20:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.027+0000 7f5433fff700 1 -- 172.21.15.132:0/2558862277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0b87a0 msgr2=0x7f542c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.027+0000 7f5433fff700 1 --2- 172.21.15.132:0/2558862277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0b87a0 0x7f542c0cfbf0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f5428009840 tx=0x7f5428009b50 comp rx=0 tx=0).stop 2023-05-10T04:20:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.027+0000 7f5433fff700 1 -- 172.21.15.132:0/2558862277 shutdown_connections 2023-05-10T04:20:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.027+0000 7f5433fff700 1 --2- 172.21.15.132:0/2558862277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c0b87a0 0x7f542c0cfbf0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.027+0000 7f5433fff700 1 -- 172.21.15.132:0/2558862277 >> 172.21.15.132:0/2558862277 conn(0x7f542c071b10 msgr2=0x7f542c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.027+0000 7f5433fff700 1 -- 172.21.15.132:0/2558862277 shutdown_connections 2023-05-10T04:20:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.027+0000 7f5433fff700 1 -- 172.21.15.132:0/2558862277 wait complete. 2023-05-10T04:20:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.028+0000 7f5433fff700 1 Processor -- start 2023-05-10T04:20:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.028+0000 7f5433fff700 1 -- start start 2023-05-10T04:20:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.029+0000 7f5433fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f542c0b87a0 0x7f542c15d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.029+0000 7f5433fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c1601e0 0x7f542c15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.029+0000 7f5433fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f542c160d40 0x7f542c0c69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.029+0000 7f5433fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c15df80 con 0x7f542c1601e0 2023-05-10T04:20:52.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.029+0000 7f5433fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f542c15e260 con 0x7f542c0b87a0 2023-05-10T04:20:52.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.029+0000 7f5433fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f542c15e540 con 0x7f542c160d40 2023-05-10T04:20:52.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c1601e0 0x7f542c15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c1601e0 0x7f542c15f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38936/0 (socket says 172.21.15.132:38936) 2023-05-10T04:20:52.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 -- 172.21.15.132:0/4291714717 learned_addr learned my addr 172.21.15.132:0/4291714717 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543259c700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f542c160d40 0x7f542c0c69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f5431d9b700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f542c0b87a0 0x7f542c15d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 -- 172.21.15.132:0/4291714717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f542c160d40 msgr2=0x7f542c0c69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f542c160d40 0x7f542c0c69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 -- 172.21.15.132:0/4291714717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f542c0b87a0 msgr2=0x7f542c15d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f542c0b87a0 0x7f542c15d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 -- 172.21.15.132:0/4291714717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280094a0 con 0x7f542c1601e0 2023-05-10T04:20:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f543159a700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c1601e0 0x7f542c15f020 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f541c00c4e0 tx=0x7f541c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f54227fc700 1 -- 172.21.15.132:0/4291714717 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0052d0 con 0x7f542c1601e0 2023-05-10T04:20:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f54227fc700 1 -- 172.21.15.132:0/4291714717 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541c005430 con 0x7f542c1601e0 2023-05-10T04:20:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f54227fc700 1 -- 172.21.15.132:0/4291714717 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541c0038c0 con 0x7f542c1601e0 2023-05-10T04:20:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.030+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f542c0d19a0 con 0x7f542c1601e0 2023-05-10T04:20:52.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.031+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f542c0d1810 con 0x7f542c1601e0 2023-05-10T04:20:52.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.032+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f542c0d1b30 con 0x7f542c1601e0 2023-05-10T04:20:52.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.033+0000 7f54227fc700 1 -- 172.21.15.132:0/4291714717 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f541c003a20 con 0x7f542c1601e0 2023-05-10T04:20:52.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.034+0000 7f54227fc700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f541006ace0 0x7f541006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.034+0000 7f54227fc700 1 -- 172.21.15.132:0/4291714717 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7f541c088750 con 0x7f542c1601e0 2023-05-10T04:20:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.034+0000 7f5431d9b700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f541006ace0 0x7f541006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.034+0000 7f5431d9b700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f541006ace0 0x7f541006d190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f54280090b0 tx=0x7f5428008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:52.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.038+0000 7f54227fc700 1 -- 172.21.15.132:0/4291714717 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f541c053a10 con 0x7f542c1601e0 2023-05-10T04:20:52.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.237+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f542c0b52f0 con 0x7f542c1601e0 2023-05-10T04:20:52.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.238+0000 7f54227fc700 1 -- 172.21.15.132:0/4291714717 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+126 (secure 0 0 0) 0x7f541c057030 con 0x7f542c1601e0 2023-05-10T04:20:52.241 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:52.242 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-05-10T04:20:52.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:52.242 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-05-10T04:20:52.242 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-05-10T04:20:52.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:20:52.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-05-10T04:20:52.242 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 2, 2023-05-10T04:20:52.243 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": "rbd" 2023-05-10T04:20:52.243 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:20:52.243 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-05-10T04:20:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f541006ace0 msgr2=0x7f541006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f541006ace0 0x7f541006d190 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f54280090b0 tx=0x7f5428008030 comp rx=0 tx=0).stop 2023-05-10T04:20:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c1601e0 msgr2=0x7f542c15f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c1601e0 0x7f542c15f020 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f541c00c4e0 tx=0x7f541c00c8a0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 shutdown_connections 2023-05-10T04:20:52.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f541006ace0 0x7f541006d190 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f542c160d40 0x7f542c0c69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f542c0b87a0 0x7f542c15d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 --2- 172.21.15.132:0/4291714717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f542c1601e0 0x7f542c15f020 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 >> 172.21.15.132:0/4291714717 conn(0x7f542c071b10 msgr2=0x7f542c0b7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:52.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 shutdown_connections 2023-05-10T04:20:52.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.240+0000 7f5433fff700 1 -- 172.21.15.132:0/4291714717 wait complete. 2023-05-10T04:20:52.260 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-10T04:20:52.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-10T04:20:52.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.444+0000 7fe5f79ff700 1 Processor -- start 2023-05-10T04:20:52.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.444+0000 7fe5f79ff700 1 -- start start 2023-05-10T04:20:52.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f79ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5f015c590 0x7fe5f0160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f79ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5f00cf010 0x7fe5f00cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f79ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f00cfd80 0x7fe5f00d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f79ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00cd520 con 0x7fe5f00cf010 2023-05-10T04:20:52.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f79ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f00d2640 con 0x7fe5f015c590 2023-05-10T04:20:52.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f79ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f01610d0 con 0x7fe5f00cfd80 2023-05-10T04:20:52.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f4f9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5f00cf010 0x7fe5f00cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f579b700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe5f015c590 0x7fe5f0160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f4f9a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe5f00cf010 0x7fe5f00cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38940/0 (socket says 172.21.15.132:38940) 2023-05-10T04:20:52.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f4f9a700 1 -- 172.21.15.132:0/442195724 learned_addr learned my addr 172.21.15.132:0/442195724 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:52.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f5f9c700 1 --2- 172.21.15.132:0/442195724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f00cfd80 0x7fe5f00d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f4f9a700 1 -- 172.21.15.132:0/442195724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f00cfd80 msgr2=0x7fe5f00d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:52.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f4f9a700 1 --2- 172.21.15.132:0/442195724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f00cfd80 0x7fe5f00d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f4f9a700 1 -- 172.21.15.132:0/442195724 >> v2:172.21.15.154:3300/0 conn(0x7fe5f015c590 msgr2=0x7fe5f0160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:52.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f4f9a700 1 --2- 172.21.15.132:0/442195724 >> v2:172.21.15.154:3300/0 conn(0x7fe5f015c590 0x7fe5f0160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.446+0000 7fe5f4f9a700 1 -- 172.21.15.132:0/442195724 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00d01e0 con 0x7fe5f00cf010 2023-05-10T04:20:52.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.447+0000 7fe5f4f9a700 1 --2- 172.21.15.132:0/442195724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00cf840 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00d0a50 tx=0x7fe5e0009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2261c7c6797ef972 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:52.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.448+0000 7fe5e7fff700 1 -- 172.21.15.132:0/442195724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0011830 con 0x7fe5f00cf010 2023-05-10T04:20:52.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.448+0000 7fe5e7fff700 1 -- 172.21.15.132:0/442195724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e0011990 con 0x7fe5f00cf010 2023-05-10T04:20:52.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.448+0000 7fe5e7fff700 1 -- 172.21.15.132:0/442195724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e0011d20 con 0x7fe5f00cf010 2023-05-10T04:20:52.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 -- 172.21.15.132:0/442195724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 msgr2=0x7fe5f00cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/442195724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00cf840 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe5f00d0a50 tx=0x7fe5e0009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 -- 172.21.15.132:0/442195724 shutdown_connections 2023-05-10T04:20:52.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/442195724 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f00cfd80 0x7fe5f00d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/442195724 >> v2:172.21.15.154:3300/0 conn(0x7fe5f015c590 0x7fe5f0160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/442195724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00cf840 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 -- 172.21.15.132:0/442195724 >> 172.21.15.132:0/442195724 conn(0x7fe5f0071b10 msgr2=0x7fe5f0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:52.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 -- 172.21.15.132:0/442195724 shutdown_connections 2023-05-10T04:20:52.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.449+0000 7fe5f79ff700 1 -- 172.21.15.132:0/442195724 wait complete. 2023-05-10T04:20:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.451+0000 7fe5f79ff700 1 Processor -- start 2023-05-10T04:20:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.451+0000 7fe5f79ff700 1 -- start start 2023-05-10T04:20:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f79ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00b8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f79ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f00cfd80 0x7fe5f015acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f79ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f015c590 0x7fe5f01e9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f79ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00b7570 con 0x7fe5f00cf010 2023-05-10T04:20:52.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f79ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00b7850 con 0x7fe5f00cfd80 2023-05-10T04:20:52.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f79ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00b7b30 con 0x7fe5f015c590 2023-05-10T04:20:52.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f579b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00b8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f579b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00b8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:38948/0 (socket says 172.21.15.132:38948) 2023-05-10T04:20:52.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f579b700 1 -- 172.21.15.132:0/3759558107 learned_addr learned my addr 172.21.15.132:0/3759558107 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:52.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f4f9a700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f00cfd80 0x7fe5f015acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f5f9c700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f015c590 0x7fe5f01e9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f579b700 1 -- 172.21.15.132:0/3759558107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f015c590 msgr2=0x7fe5f01e9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f579b700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f015c590 0x7fe5f01e9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f579b700 1 -- 172.21.15.132:0/3759558107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f00cfd80 msgr2=0x7fe5f015acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:52.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f579b700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f00cfd80 0x7fe5f015acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:52.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.452+0000 7fe5f579b700 1 -- 172.21.15.132:0/3759558107 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e0009550 con 0x7fe5f00cf010 2023-05-10T04:20:52.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.453+0000 7fe5f579b700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00b8610 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e870 tx=0x7fe5ec00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:52.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.453+0000 7fe5e5ffb700 1 -- 172.21.15.132:0/3759558107 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec009590 con 0x7fe5f00cf010 2023-05-10T04:20:52.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.453+0000 7fe5e5ffb700 1 -- 172.21.15.132:0/3759558107 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec013680 con 0x7fe5f00cf010 2023-05-10T04:20:52.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.453+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f00cf560 con 0x7fe5f00cf010 2023-05-10T04:20:52.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.453+0000 7fe5e5ffb700 1 -- 172.21.15.132:0/3759558107 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec0139f0 con 0x7fe5f00cf010 2023-05-10T04:20:52.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.453+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f00b23c0 con 0x7fe5f00cf010 2023-05-10T04:20:52.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.454+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f00cd770 con 0x7fe5f00cf010 2023-05-10T04:20:52.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.455+0000 7fe5e5ffb700 1 -- 172.21.15.132:0/3759558107 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5ec013b50 con 0x7fe5f00cf010 2023-05-10T04:20:52.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.456+0000 7fe5e5ffb700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe5d406ace0 0x7fe5d406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:52.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.456+0000 7fe5e5ffb700 1 -- 172.21.15.132:0/3759558107 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5530+0+0 (secure 0 0 0) 0x7fe5ec089080 con 0x7fe5f00cf010 2023-05-10T04:20:52.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.456+0000 7fe5f4f9a700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe5d406ace0 0x7fe5d406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:52.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.457+0000 7fe5f4f9a700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe5d406ace0 0x7fe5d406d190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009c10 tx=0x7fe5e0008030 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:52.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.460+0000 7fe5e5ffb700 1 -- 172.21.15.132:0/3759558107 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe5ec057dd0 con 0x7fe5f00cf010 2023-05-10T04:20:52.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:52.655+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe5f00cd240 con 0x7fe5f00cf010 2023-05-10T04:20:53.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.452+0000 7fe5e5ffb700 1 -- 172.21.15.132:0/3759558107 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe5ec0210b0 con 0x7fe5f00cf010 2023-05-10T04:20:53.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.460+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe5d406ace0 msgr2=0x7fe5d406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:53.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.460+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe5d406ace0 0x7fe5d406d190 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009c10 tx=0x7fe5e0008030 comp rx=0 tx=0).stop 2023-05-10T04:20:53.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.460+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 msgr2=0x7fe5f00b8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:53.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.460+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00b8610 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00e870 tx=0x7fe5ec00eb80 comp rx=0 tx=0).stop 2023-05-10T04:20:53.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.461+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 shutdown_connections 2023-05-10T04:20:53.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.461+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe5d406ace0 0x7fe5d406d190 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:53.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.461+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe5f015c590 0x7fe5f01e9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:53.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.461+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5f00cf010 0x7fe5f00b8610 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:53.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.461+0000 7fe5f79ff700 1 --2- 172.21.15.132:0/3759558107 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe5f00cfd80 0x7fe5f015acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:53.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.461+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 >> 172.21.15.132:0/3759558107 conn(0x7fe5f0071b10 msgr2=0x7fe5f00b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:53.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.461+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 shutdown_connections 2023-05-10T04:20:53.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.461+0000 7fe5f79ff700 1 -- 172.21.15.132:0/3759558107 wait complete. 2023-05-10T04:20:53.465 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-05-10T04:20:53.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-10T04:20:53.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.675+0000 7f2f6fbff700 1 Processor -- start 2023-05-10T04:20:53.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.675+0000 7f2f6fbff700 1 -- start start 2023-05-10T04:20:53.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.676+0000 7f2f6fbff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f680cee00 0x7f2f680b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:53.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.676+0000 7f2f6fbff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f680b04b0 con 0x7f2f680b69a0 2023-05-10T04:20:53.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.676+0000 7f2f6fbff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f680b01f0 con 0x7f2f680ce990 2023-05-10T04:20:53.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6fbff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f680b0700 con 0x7f2f680cee00 2023-05-10T04:20:53.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6d99b700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2f680b69a0 0x7f2f680af3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35868/0 (socket says 172.21.15.132:35868) 2023-05-10T04:20:53.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6d99b700 1 -- 172.21.15.132:0/3020338727 learned_addr learned my addr 172.21.15.132:0/3020338727 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:53.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6e19c700 1 --2- 172.21.15.132:0/3020338727 >> v2:172.21.15.132:3300/0 conn(0x7f2f680cee00 0x7f2f680b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6c999700 1 -- 172.21.15.132:0/3020338727 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2499876242 0 0) 0x7f2f680b04b0 con 0x7f2f680b69a0 2023-05-10T04:20:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6c999700 1 -- 172.21.15.132:0/3020338727 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f540035b0 con 0x7f2f680b69a0 2023-05-10T04:20:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6c999700 1 -- 172.21.15.132:0/3020338727 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735485622 0 0) 0x7f2f680b01f0 con 0x7f2f680ce990 2023-05-10T04:20:53.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6c999700 1 -- 172.21.15.132:0/3020338727 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f680b04b0 con 0x7f2f680ce990 2023-05-10T04:20:53.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6e19c700 1 -- 172.21.15.132:0/3020338727 >> v1:172.21.15.154:6789/0 conn(0x7f2f680ce990 legacy=0x7f2f680b17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:53.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6e19c700 1 -- 172.21.15.132:0/3020338727 >> v1:172.21.15.132:6789/0 conn(0x7f2f680b69a0 legacy=0x7f2f680af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:53.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.677+0000 7f2f6e19c700 1 -- 172.21.15.132:0/3020338727 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f680b09e0 con 0x7f2f680cee00 2023-05-10T04:20:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6e19c700 1 --2- 172.21.15.132:0/3020338727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f680b1eb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009d90 tx=0x7f2f6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b954283ea2eeaa81 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6c999700 1 -- 172.21.15.132:0/3020338727 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6000e070 con 0x7f2f680cee00 2023-05-10T04:20:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6c999700 1 -- 172.21.15.132:0/3020338727 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6000bb20 con 0x7f2f680cee00 2023-05-10T04:20:53.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6c999700 1 -- 172.21.15.132:0/3020338727 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60012430 con 0x7f2f680cee00 2023-05-10T04:20:53.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3020338727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 msgr2=0x7f2f680b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:53.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6fbff700 1 --2- 172.21.15.132:0/3020338727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f680b1eb0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009d90 tx=0x7f2f6000b330 comp rx=0 tx=0).stop 2023-05-10T04:20:53.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3020338727 shutdown_connections 2023-05-10T04:20:53.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6fbff700 1 --2- 172.21.15.132:0/3020338727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f680b1eb0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:53.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.678+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3020338727 >> 172.21.15.132:0/3020338727 conn(0x7f2f6809a090 msgr2=0x7f2f680d0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:53.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.679+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3020338727 shutdown_connections 2023-05-10T04:20:53.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.679+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3020338727 wait complete. 2023-05-10T04:20:53.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.680+0000 7f2f6fbff700 1 Processor -- start 2023-05-10T04:20:53.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.680+0000 7f2f6fbff700 1 -- start start 2023-05-10T04:20:53.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.681+0000 7f2f6fbff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f680b69a0 0x7f2f6814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:53.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.681+0000 7f2f6fbff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f680ce990 0x7f2f6815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:53.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.681+0000 7f2f6fbff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f6815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:53.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.681+0000 7f2f6fbff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680ce310 con 0x7f2f680cee00 2023-05-10T04:20:53.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.681+0000 7f2f6fbff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f68150860 con 0x7f2f680ce990 2023-05-10T04:20:53.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.681+0000 7f2f6fbff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f680cb470 con 0x7f2f680b69a0 2023-05-10T04:20:53.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.681+0000 7f2f6e19c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f6815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:53.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6e19c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f6815d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42552/0 (socket says 172.21.15.132:42552) 2023-05-10T04:20:53.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6e19c700 1 -- 172.21.15.132:0/3476543404 learned_addr learned my addr 172.21.15.132:0/3476543404 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:53.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6d19a700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f680ce990 0x7f2f6815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:53.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6d99b700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f680b69a0 0x7f2f6814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:53.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6e19c700 1 -- 172.21.15.132:0/3476543404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f680b69a0 msgr2=0x7f2f6814fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:53.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6e19c700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f680b69a0 0x7f2f6814fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:53.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6e19c700 1 -- 172.21.15.132:0/3476543404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f680ce990 msgr2=0x7f2f6815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:53.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6e19c700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f680ce990 0x7f2f6815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:53.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6e19c700 1 -- 172.21.15.132:0/3476543404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60009a70 con 0x7f2f680cee00 2023-05-10T04:20:53.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f6e19c700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f6815d230 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2f68067910 tx=0x7f2f60004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:53.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.682+0000 7f2f5e7fc700 1 -- 172.21.15.132:0/3476543404 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60012430 con 0x7f2f680cee00 2023-05-10T04:20:53.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.683+0000 7f2f5e7fc700 1 -- 172.21.15.132:0/3476543404 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f60020070 con 0x7f2f680cee00 2023-05-10T04:20:53.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.683+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f680b0fa0 con 0x7f2f680cee00 2023-05-10T04:20:53.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.683+0000 7f2f5e7fc700 1 -- 172.21.15.132:0/3476543404 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6001ba50 con 0x7f2f680cee00 2023-05-10T04:20:53.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.683+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f680b0cc0 con 0x7f2f680cee00 2023-05-10T04:20:53.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.684+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f680b1280 con 0x7f2f680cee00 2023-05-10T04:20:53.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.685+0000 7f2f5e7fc700 1 -- 172.21.15.132:0/3476543404 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2f6001bbb0 con 0x7f2f680cee00 2023-05-10T04:20:53.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.686+0000 7f2f5e7fc700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f4c06ace0 0x7f2f4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:53.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.686+0000 7f2f5e7fc700 1 -- 172.21.15.132:0/3476543404 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5900+0+0 (secure 0 0 0) 0x7f2f60022070 con 0x7f2f680cee00 2023-05-10T04:20:53.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.686+0000 7f2f6d99b700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f4c06ace0 0x7f2f4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:53.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.686+0000 7f2f6d99b700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f4c06ace0 0x7f2f4c06d190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2f64007fd0 tx=0x7f2f64007dc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:53.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.690+0000 7f2f5e7fc700 1 -- 172.21.15.132:0/3476543404 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f2f600564a0 con 0x7f2f680cee00 2023-05-10T04:20:53.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:53.889+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2f680d0260 con 0x7f2f680cee00 2023-05-10T04:20:54.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.456+0000 7f2f5e7fc700 1 -- 172.21.15.132:0/3476543404 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2f6001be60 con 0x7f2f680cee00 2023-05-10T04:20:54.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.461+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f4c06ace0 msgr2=0x7f2f4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.461+0000 7f2f6fbff700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f4c06ace0 0x7f2f4c06d190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2f64007fd0 tx=0x7f2f64007dc0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.461+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 msgr2=0x7f2f6815d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.461+0000 7f2f6fbff700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f6815d230 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f2f68067910 tx=0x7f2f60004ad0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.464+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 shutdown_connections 2023-05-10T04:20:54.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.464+0000 7f2f6fbff700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f2f4c06ace0 0x7f2f4c06d190 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.464+0000 7f2f6fbff700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f680cee00 0x7f2f6815d230 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.464+0000 7f2f6fbff700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f2f680b69a0 0x7f2f6814fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.464+0000 7f2f6fbff700 1 --2- 172.21.15.132:0/3476543404 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f2f680ce990 0x7f2f6815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.464+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 >> 172.21.15.132:0/3476543404 conn(0x7f2f6809a090 msgr2=0x7f2f680705c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:54.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.464+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 shutdown_connections 2023-05-10T04:20:54.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.465+0000 7f2f6fbff700 1 -- 172.21.15.132:0/3476543404 wait complete. 2023-05-10T04:20:54.475 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-05-10T04:20:54.497 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-10T04:20:54.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.680+0000 7ff2f51ff700 1 Processor -- start 2023-05-10T04:20:54.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.680+0000 7ff2f51ff700 1 -- start start 2023-05-10T04:20:54.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2f51ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f00cd520 0x7ff2f00cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2f51ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f015d660 con 0x7ff2f00cfe20 2023-05-10T04:20:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2f51ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2f015cd70 con 0x7ff2f015a140 2023-05-10T04:20:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2f51ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f00d02a0 con 0x7ff2f00cd520 2023-05-10T04:20:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2ef59e700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff2f00cfe20 0x7ff2f00b1b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35884/0 (socket says 172.21.15.132:35884) 2023-05-10T04:20:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2ef59e700 1 -- 172.21.15.132:0/473191375 learned_addr learned my addr 172.21.15.132:0/473191375 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2e7fff700 1 --2- 172.21.15.132:0/473191375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f00cd520 0x7ff2f00cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2ee59c700 1 -- 172.21.15.132:0/473191375 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094081632 0 0) 0x7ff2f015d660 con 0x7ff2f00cfe20 2023-05-10T04:20:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.682+0000 7ff2ee59c700 1 -- 172.21.15.132:0/473191375 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2dc0035b0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2ee59c700 1 -- 172.21.15.132:0/473191375 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162432381 0 0) 0x7ff2f015cd70 con 0x7ff2f015a140 2023-05-10T04:20:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2ee59c700 1 -- 172.21.15.132:0/473191375 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2f015d660 con 0x7ff2f015a140 2023-05-10T04:20:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2ee59c700 1 -- 172.21.15.132:0/473191375 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 853491142 0 0) 0x7ff2dc0035b0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2e7fff700 1 -- 172.21.15.132:0/473191375 >> v1:172.21.15.154:6789/0 conn(0x7ff2f015a140 legacy=0x7ff2f0160ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2e7fff700 1 -- 172.21.15.132:0/473191375 >> v1:172.21.15.132:6789/0 conn(0x7ff2f00cfe20 legacy=0x7ff2f00b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2e7fff700 1 -- 172.21.15.132:0/473191375 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f015d010 con 0x7ff2f00cd520 2023-05-10T04:20:54.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2e7fff700 1 --2- 172.21.15.132:0/473191375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f00cd520 0x7ff2f00cf8e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80098a0 tx=0x7ff2d8009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce5e317c5a9067a9 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:54.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2ee59c700 1 -- 172.21.15.132:0/473191375 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2e80019f0 con 0x7ff2f00cd520 2023-05-10T04:20:54.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2ee59c700 1 -- 172.21.15.132:0/473191375 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8004030 con 0x7ff2f00cd520 2023-05-10T04:20:54.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.683+0000 7ff2ee59c700 1 -- 172.21.15.132:0/473191375 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d80043a0 con 0x7ff2f00cd520 2023-05-10T04:20:54.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.684+0000 7ff2f51ff700 1 -- 172.21.15.132:0/473191375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f00cd520 msgr2=0x7ff2f00cf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.684+0000 7ff2f51ff700 1 --2- 172.21.15.132:0/473191375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f00cd520 0x7ff2f00cf8e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80098a0 tx=0x7ff2d8009bb0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.684+0000 7ff2f51ff700 1 -- 172.21.15.132:0/473191375 shutdown_connections 2023-05-10T04:20:54.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.684+0000 7ff2f51ff700 1 --2- 172.21.15.132:0/473191375 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f00cd520 0x7ff2f00cf8e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.684+0000 7ff2f51ff700 1 -- 172.21.15.132:0/473191375 >> 172.21.15.132:0/473191375 conn(0x7ff2f0071b10 msgr2=0x7ff2f0071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:54.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.684+0000 7ff2f51ff700 1 -- 172.21.15.132:0/473191375 shutdown_connections 2023-05-10T04:20:54.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.684+0000 7ff2f51ff700 1 -- 172.21.15.132:0/473191375 wait complete. 2023-05-10T04:20:54.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.686+0000 7ff2f51ff700 1 Processor -- start 2023-05-10T04:20:54.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.686+0000 7ff2f51ff700 1 -- start start 2023-05-10T04:20:54.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.686+0000 7ff2f51ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f00cd520 0x7ff2f0158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:54.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2f51ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2f00cfe20 0x7ff2f00d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:54.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2f51ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f015a140 0x7ff2f00d31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:54.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2f51ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f01f56c0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2f51ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f01f5910 con 0x7ff2f00cd520 2023-05-10T04:20:54.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2f51ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2f01f5bf0 con 0x7ff2f015a140 2023-05-10T04:20:54.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2f00cfe20 0x7ff2f00d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:54.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2f00cfe20 0x7ff2f00d2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42566/0 (socket says 172.21.15.132:42566) 2023-05-10T04:20:54.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 -- 172.21.15.132:0/3936667935 learned_addr learned my addr 172.21.15.132:0/3936667935 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:54.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2ef59e700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f015a140 0x7ff2f00d31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:54.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2eed9d700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f00cd520 0x7ff2f0158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:54.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 -- 172.21.15.132:0/3936667935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f015a140 msgr2=0x7ff2f00d31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f015a140 0x7ff2f00d31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 -- 172.21.15.132:0/3936667935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f00cd520 msgr2=0x7ff2f0158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f00cd520 0x7ff2f0158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 -- 172.21.15.132:0/3936667935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d80094a0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.687+0000 7ff2e7fff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2f00cfe20 0x7ff2f00d2c60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80090b0 tx=0x7ff2d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:54.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.688+0000 7ff2e77fe700 1 -- 172.21.15.132:0/3936667935 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011630 con 0x7ff2f00cfe20 2023-05-10T04:20:54.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.688+0000 7ff2e77fe700 1 -- 172.21.15.132:0/3936667935 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d8011790 con 0x7ff2f00cfe20 2023-05-10T04:20:54.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.688+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2f015daf0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.688+0000 7ff2e77fe700 1 -- 172.21.15.132:0/3936667935 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d8011b40 con 0x7ff2f00cfe20 2023-05-10T04:20:54.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.688+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2f015d2f0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.689+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2f00cdb00 con 0x7ff2f00cfe20 2023-05-10T04:20:54.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.690+0000 7ff2e77fe700 1 -- 172.21.15.132:0/3936667935 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff2d8011ca0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.691+0000 7ff2e77fe700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff2d006ace0 0x7ff2d006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:54.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.691+0000 7ff2e77fe700 1 -- 172.21.15.132:0/3936667935 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6282+0+0 (secure 0 0 0) 0x7ff2d808afc0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.691+0000 7ff2eed9d700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff2d006ace0 0x7ff2d006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:54.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.692+0000 7ff2eed9d700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff2d006ace0 0x7ff2d006d190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0007fd0 tx=0x7ff2e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:54.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.695+0000 7ff2e77fe700 1 -- 172.21.15.132:0/3936667935 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff2d8056100 con 0x7ff2f00cfe20 2023-05-10T04:20:54.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.934+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff2f00b51f0 con 0x7ff2f00cfe20 2023-05-10T04:20:54.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.940+0000 7ff2e77fe700 1 -- 172.21.15.132:0/3936667935 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff2d8059720 con 0x7ff2f00cfe20 2023-05-10T04:20:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.948+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff2d006ace0 msgr2=0x7ff2d006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.948+0000 7ff2f51ff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff2d006ace0 0x7ff2d006d190 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0007fd0 tx=0x7ff2e0009040 comp rx=0 tx=0).stop 2023-05-10T04:20:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.948+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2f00cfe20 msgr2=0x7ff2f00d2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:54.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.948+0000 7ff2f51ff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2f00cfe20 0x7ff2f00d2c60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7ff2d80090b0 tx=0x7ff2d80047c0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.953+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 shutdown_connections 2023-05-10T04:20:54.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.953+0000 7ff2f51ff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff2d006ace0 0x7ff2d006d190 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.953+0000 7ff2f51ff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff2f015a140 0x7ff2f00d31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.953+0000 7ff2f51ff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff2f00cd520 0x7ff2f0158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.953+0000 7ff2f51ff700 1 --2- 172.21.15.132:0/3936667935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2f00cfe20 0x7ff2f00d2c60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.953+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 >> 172.21.15.132:0/3936667935 conn(0x7ff2f0071b10 msgr2=0x7ff2f0159330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.962+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 shutdown_connections 2023-05-10T04:20:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:54.962+0000 7ff2f51ff700 1 -- 172.21.15.132:0/3936667935 wait complete. 2023-05-10T04:20:54.973 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 6 and data pool 7 2023-05-10T04:20:54.992 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.172+0000 7f3374fff700 1 Processor -- start 2023-05-10T04:20:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.172+0000 7f3374fff700 1 -- start start 2023-05-10T04:20:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.173+0000 7f3374fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33700cf010 0x7f3370160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.173+0000 7f3374fff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f33700cff50 0x7f33700d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.173+0000 7f3374fff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33700cd520 con 0x7f337015c590 2023-05-10T04:20:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.173+0000 7f3374fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33700d2640 con 0x7f33700cf010 2023-05-10T04:20:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.173+0000 7f3374fff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33701610d0 con 0x7f33700cff50 2023-05-10T04:20:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f3367fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33700cf010 0x7f3370160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f3367fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33700cf010 0x7f3370160b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42568/0 (socket says 172.21.15.132:42568) 2023-05-10T04:20:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f3367fff700 1 -- 172.21.15.132:0/459147023 learned_addr learned my addr 172.21.15.132:0/459147023 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f336ed9d700 1 --2- 172.21.15.132:0/459147023 >> v2:172.21.15.154:3300/0 conn(0x7f33700cff50 0x7f33700d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f3367fff700 1 -- 172.21.15.132:0/459147023 >> v2:172.21.15.154:3300/0 conn(0x7f33700cff50 msgr2=0x7f33700d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:55.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f3367fff700 1 --2- 172.21.15.132:0/459147023 >> v2:172.21.15.154:3300/0 conn(0x7f33700cff50 0x7f33700d2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f3367fff700 1 -- 172.21.15.132:0/459147023 >> v1:172.21.15.154:6789/0 conn(0x7f337015c590 legacy=0x7f33700cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f3367fff700 1 -- 172.21.15.132:0/459147023 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33700b23c0 con 0x7f33700cf010 2023-05-10T04:20:55.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.174+0000 7f3367fff700 1 --2- 172.21.15.132:0/459147023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33700cf010 0x7f3370160b90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f33700b20b0 tx=0x7f3358009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0bf96c7a18eff3 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:55.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f336dd9b700 1 -- 172.21.15.132:0/459147023 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335800b870 con 0x7f33700cf010 2023-05-10T04:20:55.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f336dd9b700 1 -- 172.21.15.132:0/459147023 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335800b9d0 con 0x7f33700cf010 2023-05-10T04:20:55.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f336dd9b700 1 -- 172.21.15.132:0/459147023 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335800bd60 con 0x7f33700cf010 2023-05-10T04:20:55.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f3374fff700 1 -- 172.21.15.132:0/459147023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33700cf010 msgr2=0x7f3370160b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f3374fff700 1 --2- 172.21.15.132:0/459147023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33700cf010 0x7f3370160b90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f33700b20b0 tx=0x7f3358009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f3374fff700 1 -- 172.21.15.132:0/459147023 shutdown_connections 2023-05-10T04:20:55.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f3374fff700 1 --2- 172.21.15.132:0/459147023 >> v2:172.21.15.154:3300/0 conn(0x7f33700cff50 0x7f33700d2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f3374fff700 1 --2- 172.21.15.132:0/459147023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33700cf010 0x7f3370160b90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f3374fff700 1 -- 172.21.15.132:0/459147023 >> 172.21.15.132:0/459147023 conn(0x7f3370071b10 msgr2=0x7f3370071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:55.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f3374fff700 1 -- 172.21.15.132:0/459147023 shutdown_connections 2023-05-10T04:20:55.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.175+0000 7f3374fff700 1 -- 172.21.15.132:0/459147023 wait complete. 2023-05-10T04:20:55.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.177+0000 7f3374fff700 1 Processor -- start 2023-05-10T04:20:55.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.177+0000 7f3374fff700 1 -- start start 2023-05-10T04:20:55.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f3374fff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33700cf010 0x7f33700cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f3374fff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33700cff50 0x7f33700b6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f3374fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337015c590 0x7f337014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f3374fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700c8750 con 0x7f337015c590 2023-05-10T04:20:55.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f3374fff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700c7b40 con 0x7f33700cff50 2023-05-10T04:20:55.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f3374fff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33700c7e20 con 0x7f33700cf010 2023-05-10T04:20:55.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f336ed9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337015c590 0x7f337014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f336ed9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337015c590 0x7f337014bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42584/0 (socket says 172.21.15.132:42584) 2023-05-10T04:20:55.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f336ed9d700 1 -- 172.21.15.132:0/2608820236 learned_addr learned my addr 172.21.15.132:0/2608820236 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:55.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f3367fff700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33700cff50 0x7f33700b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.178+0000 7f336e59c700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33700cf010 0x7f33700cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f336ed9d700 1 -- 172.21.15.132:0/2608820236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33700cf010 msgr2=0x7f33700cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f336ed9d700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33700cf010 0x7f33700cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f336ed9d700 1 -- 172.21.15.132:0/2608820236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33700cff50 msgr2=0x7f33700b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f336ed9d700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33700cff50 0x7f33700b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f336ed9d700 1 -- 172.21.15.132:0/2608820236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3358009550 con 0x7f337015c590 2023-05-10T04:20:55.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f336ed9d700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337015c590 0x7f337014bf40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3368007e40 tx=0x7f336800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:55.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f3366ffd700 1 -- 172.21.15.132:0/2608820236 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336800ed30 con 0x7f337015c590 2023-05-10T04:20:55.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f3366ffd700 1 -- 172.21.15.132:0/2608820236 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368014420 con 0x7f337015c590 2023-05-10T04:20:55.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f3366ffd700 1 -- 172.21.15.132:0/2608820236 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680147d0 con 0x7f337015c590 2023-05-10T04:20:55.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33700cd770 con 0x7f337015c590 2023-05-10T04:20:55.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.179+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33700cf560 con 0x7f337015c590 2023-05-10T04:20:55.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.180+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337015c960 con 0x7f337015c590 2023-05-10T04:20:55.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.181+0000 7f3366ffd700 1 -- 172.21.15.132:0/2608820236 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3368014930 con 0x7f337015c590 2023-05-10T04:20:55.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.182+0000 7f3366ffd700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f335006ace0 0x7f335006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.182+0000 7f3366ffd700 1 -- 172.21.15.132:0/2608820236 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3368089d20 con 0x7f337015c590 2023-05-10T04:20:55.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.182+0000 7f336e59c700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f335006ace0 0x7f335006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.183+0000 7f336e59c700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f335006ace0 0x7f335006d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3360007fd0 tx=0x7f3360009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:55.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.186+0000 7f3366ffd700 1 -- 172.21.15.132:0/2608820236 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3368054bf0 con 0x7f337015c590 2023-05-10T04:20:55.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.385+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33700c88f0 con 0x7f337015c590 2023-05-10T04:20:55.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.386+0000 7f3366ffd700 1 -- 172.21.15.132:0/2608820236 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18571 (secure 0 0 0) 0x7f3368058210 con 0x7f337015c590 2023-05-10T04:20:55.389 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:55.390 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":40,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:20:54.936305+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:20:52.693980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-10T04:20:53.927783+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.388+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f335006ace0 msgr2=0x7f335006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.388+0000 7f3374fff700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f335006ace0 0x7f335006d190 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3360007fd0 tx=0x7f3360009040 comp rx=0 tx=0).stop 2023-05-10T04:20:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.388+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337015c590 msgr2=0x7f337014bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.388+0000 7f3374fff700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337015c590 0x7f337014bf40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f3368007e40 tx=0x7f336800e3c0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.388+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 shutdown_connections 2023-05-10T04:20:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.389+0000 7f3374fff700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f335006ace0 0x7f335006d190 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.389+0000 7f3374fff700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f337015c590 0x7f337014bf40 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.389+0000 7f3374fff700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f33700cf010 0x7f33700cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.389+0000 7f3374fff700 1 --2- 172.21.15.132:0/2608820236 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f33700cff50 0x7f33700b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.389+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 >> 172.21.15.132:0/2608820236 conn(0x7f3370071b10 msgr2=0x7f337015a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.389+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 shutdown_connections 2023-05-10T04:20:55.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.389+0000 7f3374fff700 1 -- 172.21.15.132:0/2608820236 wait complete. 2023-05-10T04:20:55.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:55.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.590+0000 7f3c6ebff700 1 Processor -- start 2023-05-10T04:20:55.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.590+0000 7f3c6ebff700 1 -- start start 2023-05-10T04:20:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.591+0000 7f3c6ebff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d2110 0x7f3c68167550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.591+0000 7f3c6ebff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c68161000 con 0x7f3c680cfbf0 2023-05-10T04:20:55.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.591+0000 7f3c6ebff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c680d0020 con 0x7f3c680b87a0 2023-05-10T04:20:55.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.591+0000 7f3c6ebff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680d02d0 con 0x7f3c680d2110 2023-05-10T04:20:55.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c67fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3c680cfbf0 0x7f3c681608f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35886/0 (socket says 172.21.15.132:35886) 2023-05-10T04:20:55.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c67fff700 1 -- 172.21.15.132:0/2727287835 learned_addr learned my addr 172.21.15.132:0/2727287835 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c6d19c700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d2110 0x7f3c68167550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534507478 0 0) 0x7f3c68161000 con 0x7f3c680cfbf0 2023-05-10T04:20:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c580035b0 con 0x7f3c680cfbf0 2023-05-10T04:20:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1778000017 0 0) 0x7f3c580035b0 con 0x7f3c680cfbf0 2023-05-10T04:20:55.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d2110 msgr2=0x7f3c68167550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d2110 0x7f3c68167550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 >> v1:172.21.15.154:6789/0 conn(0x7f3c680b87a0 legacy=0x7f3c681601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c680cdc60 con 0x7f3c680cfbf0 2023-05-10T04:20:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7f3c54001670 con 0x7f3c680cfbf0 2023-05-10T04:20:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 >> v1:172.21.15.132:6789/0 conn(0x7f3c680cfbf0 legacy=0x7f3c681608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c58003a30 0x7f3c58003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c580043d0 0x7f3c58004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d2110 0x7f3c580050f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680d02d0 con 0x7f3c580043d0 2023-05-10T04:20:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5800ba10 con 0x7f3c58003a30 2023-05-10T04:20:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.592+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5800bba0 con 0x7f3c680d2110 2023-05-10T04:20:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c67fff700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c580043d0 0x7f3c58004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c6c99b700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c58003a30 0x7f3c58003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c6d19c700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d2110 0x7f3c580050f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c67fff700 1 -- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d2110 msgr2=0x7f3c580050f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c67fff700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d2110 0x7f3c580050f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c67fff700 1 -- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c58003a30 msgr2=0x7f3c58003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c67fff700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c58003a30 0x7f3c58003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c67fff700 1 -- 172.21.15.132:0/2727287835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c580035b0 con 0x7f3c580043d0 2023-05-10T04:20:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.593+0000 7f3c67fff700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c580043d0 0x7f3c58004890 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c240 tx=0x7f3c58005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f593e7afb003cb server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5400cd80 con 0x7f3c580043d0 2023-05-10T04:20:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54005960 con 0x7f3c580043d0 2023-05-10T04:20:55.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c677fe700 1 -- 172.21.15.132:0/2727287835 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54005d10 con 0x7f3c580043d0 2023-05-10T04:20:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c6ebff700 1 -- 172.21.15.132:0/2727287835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c580043d0 msgr2=0x7f3c58004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c6ebff700 1 --2- 172.21.15.132:0/2727287835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c580043d0 0x7f3c58004890 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c240 tx=0x7f3c58005880 comp rx=0 tx=0).stop 2023-05-10T04:20:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c6d19c700 1 -- 172.21.15.132:0/2727287835 reap_dead start 2023-05-10T04:20:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c6ebff700 1 -- 172.21.15.132:0/2727287835 shutdown_connections 2023-05-10T04:20:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c6ebff700 1 -- 172.21.15.132:0/2727287835 >> 172.21.15.132:0/2727287835 conn(0x7f3c68071b10 msgr2=0x7f3c68071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c6ebff700 1 -- 172.21.15.132:0/2727287835 shutdown_connections 2023-05-10T04:20:55.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.594+0000 7f3c6ebff700 1 -- 172.21.15.132:0/2727287835 wait complete. 2023-05-10T04:20:55.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.596+0000 7f3c6ebff700 1 Processor -- start 2023-05-10T04:20:55.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.596+0000 7f3c6ebff700 1 -- start start 2023-05-10T04:20:55.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c6ebff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c580043d0 0x7f3c681501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c6ebff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c68155d10 0x7f3c68156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c6ebff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d31a0 0x7f3c680d3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c6ebff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6815dc00 con 0x7f3c68155d10 2023-05-10T04:20:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c6ebff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680d3b50 con 0x7f3c580043d0 2023-05-10T04:20:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c6ebff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6815cce0 con 0x7f3c680d31a0 2023-05-10T04:20:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c67fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c68155d10 0x7f3c68156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c67fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c68155d10 0x7f3c68156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42602/0 (socket says 172.21.15.132:42602) 2023-05-10T04:20:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c67fff700 1 -- 172.21.15.132:0/3710242710 learned_addr learned my addr 172.21.15.132:0/3710242710 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c6c99b700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c580043d0 0x7f3c681501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.597+0000 7f3c6d19c700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d31a0 0x7f3c680d3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c67fff700 1 -- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d31a0 msgr2=0x7f3c680d3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c67fff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d31a0 0x7f3c680d3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c67fff700 1 -- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c580043d0 msgr2=0x7f3c681501f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c67fff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c580043d0 0x7f3c681501f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c67fff700 1 -- 172.21.15.132:0/3710242710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c680cd980 con 0x7f3c68155d10 2023-05-10T04:20:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c6d19c700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d31a0 0x7f3c680d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c67fff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c68155d10 0x7f3c68156180 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c830 tx=0x7f3c54001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c657fa700 1 -- 172.21.15.132:0/3710242710 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54001780 con 0x7f3c68155d10 2023-05-10T04:20:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c657fa700 1 -- 172.21.15.132:0/3710242710 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54000ed0 con 0x7f3c68155d10 2023-05-10T04:20:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c657fa700 1 -- 172.21.15.132:0/3710242710 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54004a90 con 0x7f3c68155d10 2023-05-10T04:20:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c680cd6a0 con 0x7f3c68155d10 2023-05-10T04:20:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.598+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c68165540 con 0x7f3c68155d10 2023-05-10T04:20:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.599+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c6815da60 con 0x7f3c68155d10 2023-05-10T04:20:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.600+0000 7f3c657fa700 1 -- 172.21.15.132:0/3710242710 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c54004bf0 con 0x7f3c68155d10 2023-05-10T04:20:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.601+0000 7f3c657fa700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3c4c06ace0 0x7f3c4c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.601+0000 7f3c657fa700 1 -- 172.21.15.132:0/3710242710 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f3c5408a120 con 0x7f3c68155d10 2023-05-10T04:20:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.601+0000 7f3c6c99b700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3c4c06ace0 0x7f3c4c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.602+0000 7f3c6c99b700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3c4c06ace0 0x7f3c4c06d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007fd0 tx=0x7f3c5c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.605+0000 7f3c657fa700 1 -- 172.21.15.132:0/3710242710 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f3c6815da60 con 0x7f3c68155d10 2023-05-10T04:20:55.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.800+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c6815da60 con 0x7f3c68155d10 2023-05-10T04:20:55.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.801+0000 7f3c657fa700 1 -- 172.21.15.132:0/3710242710 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+18571 (secure 0 0 0) 0x7f3c6815da60 con 0x7f3c68155d10 2023-05-10T04:20:55.804 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:55.805 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":40,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:20:54.936305+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:20:52.693980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-10T04:20:53.927783+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:55.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3c4c06ace0 msgr2=0x7f3c4c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3c4c06ace0 0x7f3c4c06d190 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c007fd0 tx=0x7f3c5c009040 comp rx=0 tx=0).stop 2023-05-10T04:20:55.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c68155d10 msgr2=0x7f3c68156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:55.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c68155d10 0x7f3c68156180 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c830 tx=0x7f3c54001980 comp rx=0 tx=0).stop 2023-05-10T04:20:55.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 shutdown_connections 2023-05-10T04:20:55.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f3c4c06ace0 0x7f3c4c06d190 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f3c680d31a0 0x7f3c680d3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f3c580043d0 0x7f3c681501f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 --2- 172.21.15.132:0/3710242710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c68155d10 0x7f3c68156180 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:55.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 >> 172.21.15.132:0/3710242710 conn(0x7f3c68071b10 msgr2=0x7f3c6815a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:55.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 shutdown_connections 2023-05-10T04:20:55.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:55.804+0000 7f3c6ebff700 1 -- 172.21.15.132:0/3710242710 wait complete. 2023-05-10T04:20:55.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-10T04:20:56.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.015+0000 7f73383ff700 1 Processor -- start 2023-05-10T04:20:56.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.016+0000 7f73383ff700 1 -- start start 2023-05-10T04:20:56.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f73383ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f73300adf70 0x7f73300cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:56.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f73383ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f733015cf10 0x7f733006c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:56.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f73383ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73300cc9e0 con 0x7f73300cd760 2023-05-10T04:20:56.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f73383ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733015de20 con 0x7f733015cf10 2023-05-10T04:20:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f73383ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733015d860 con 0x7f73300adf70 2023-05-10T04:20:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f733699c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f733015cf10 0x7f733006c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f733699c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f733015cf10 0x7f733006c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42610/0 (socket says 172.21.15.132:42610) 2023-05-10T04:20:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f733699c700 1 -- 172.21.15.132:0/1290552672 learned_addr learned my addr 172.21.15.132:0/1290552672 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.017+0000 7f733599a700 1 --2- 172.21.15.132:0/1290552672 >> v2:172.21.15.154:3300/0 conn(0x7f73300adf70 0x7f73300cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:56.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.018+0000 7f733699c700 1 -- 172.21.15.132:0/1290552672 >> v2:172.21.15.154:3300/0 conn(0x7f73300adf70 msgr2=0x7f73300cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:56.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.018+0000 7f733699c700 1 --2- 172.21.15.132:0/1290552672 >> v2:172.21.15.154:3300/0 conn(0x7f73300adf70 0x7f73300cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.018+0000 7f733699c700 1 -- 172.21.15.132:0/1290552672 >> v1:172.21.15.154:6789/0 conn(0x7f73300cd760 legacy=0x7f73300cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.018+0000 7f733699c700 1 -- 172.21.15.132:0/1290552672 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733015db40 con 0x7f733015cf10 2023-05-10T04:20:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.018+0000 7f733699c700 1 --2- 172.21.15.132:0/1290552672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f733015cf10 0x7f733006c6c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f73300ae4c0 tx=0x7f732800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a94e66640f21e95 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.018+0000 7f7335199700 1 -- 172.21.15.132:0/1290552672 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800e070 con 0x7f733015cf10 2023-05-10T04:20:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.018+0000 7f7335199700 1 -- 172.21.15.132:0/1290552672 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732800b9c0 con 0x7f733015cf10 2023-05-10T04:20:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.018+0000 7f7335199700 1 -- 172.21.15.132:0/1290552672 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732800bd70 con 0x7f733015cf10 2023-05-10T04:20:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.019+0000 7f73383ff700 1 -- 172.21.15.132:0/1290552672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f733015cf10 msgr2=0x7f733006c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.019+0000 7f73383ff700 1 --2- 172.21.15.132:0/1290552672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f733015cf10 0x7f733006c6c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f73300ae4c0 tx=0x7f732800b330 comp rx=0 tx=0).stop 2023-05-10T04:20:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.019+0000 7f73383ff700 1 -- 172.21.15.132:0/1290552672 shutdown_connections 2023-05-10T04:20:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.019+0000 7f73383ff700 1 --2- 172.21.15.132:0/1290552672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f733015cf10 0x7f733006c6c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.019+0000 7f73383ff700 1 --2- 172.21.15.132:0/1290552672 >> v2:172.21.15.154:3300/0 conn(0x7f73300adf70 0x7f73300cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.019+0000 7f73383ff700 1 -- 172.21.15.132:0/1290552672 >> 172.21.15.132:0/1290552672 conn(0x7f73300cf720 msgr2=0x7f73300cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.019+0000 7f73383ff700 1 -- 172.21.15.132:0/1290552672 shutdown_connections 2023-05-10T04:20:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.019+0000 7f73383ff700 1 -- 172.21.15.132:0/1290552672 wait complete. 2023-05-10T04:20:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.021+0000 7f73383ff700 1 Processor -- start 2023-05-10T04:20:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.021+0000 7f73383ff700 1 -- start start 2023-05-10T04:20:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f73383ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73300adf70 0x7f733015be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f73383ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73300cd760 0x7f73300b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f73383ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f733015cf10 0x7f73300afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f73383ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733015b9f0 con 0x7f73300adf70 2023-05-10T04:20:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f73383ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733015ade0 con 0x7f73300cd760 2023-05-10T04:20:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f73383ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733015b0c0 con 0x7f733015cf10 2023-05-10T04:20:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733619b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73300adf70 0x7f733015be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733619b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73300adf70 0x7f733015be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42614/0 (socket says 172.21.15.132:42614) 2023-05-10T04:20:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733619b700 1 -- 172.21.15.132:0/578542984 learned_addr learned my addr 172.21.15.132:0/578542984 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733599a700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73300cd760 0x7f73300b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733699c700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f733015cf10 0x7f73300afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733619b700 1 -- 172.21.15.132:0/578542984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f733015cf10 msgr2=0x7f73300afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733619b700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f733015cf10 0x7f73300afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733619b700 1 -- 172.21.15.132:0/578542984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73300cd760 msgr2=0x7f73300b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733619b700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73300cd760 0x7f73300b0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.022+0000 7f733619b700 1 -- 172.21.15.132:0/578542984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7328009b30 con 0x7f73300adf70 2023-05-10T04:20:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.023+0000 7f733619b700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73300adf70 0x7f733015be80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f732c00c4e0 tx=0x7f732c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.023+0000 7f7326ffd700 1 -- 172.21.15.132:0/578542984 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c0052d0 con 0x7f73300adf70 2023-05-10T04:20:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.023+0000 7f7326ffd700 1 -- 172.21.15.132:0/578542984 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732c005430 con 0x7f73300adf70 2023-05-10T04:20:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.023+0000 7f7326ffd700 1 -- 172.21.15.132:0/578542984 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732c0038c0 con 0x7f73300adf70 2023-05-10T04:20:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.023+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7330071600 con 0x7f73300adf70 2023-05-10T04:20:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.023+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73300cc670 con 0x7f73300adf70 2023-05-10T04:20:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.024+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73300cd3b0 con 0x7f73300adf70 2023-05-10T04:20:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.025+0000 7f7326ffd700 1 -- 172.21.15.132:0/578542984 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f732c003a20 con 0x7f73300adf70 2023-05-10T04:20:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.026+0000 7f7326ffd700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f731406ace0 0x7f731406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.026+0000 7f7326ffd700 1 -- 172.21.15.132:0/578542984 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f732c0889e0 con 0x7f73300adf70 2023-05-10T04:20:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.026+0000 7f733599a700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f731406ace0 0x7f731406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:56.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.027+0000 7f733599a700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f731406ace0 0x7f731406d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f73300b2ae0 tx=0x7f7320008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:56.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.030+0000 7f7326ffd700 1 -- 172.21.15.132:0/578542984 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f732c0538b0 con 0x7f73300adf70 2023-05-10T04:20:56.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.269+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7330071b50 con 0x7f73300adf70 2023-05-10T04:20:56.796 INFO:tasks.ceph.mds.c.smithi132.stderr:2023-05-10T04:20:56.794+0000 7f1b72df1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-10T04:20:56.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.951+0000 7f7326ffd700 1 -- 172.21.15.132:0/578542984 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f732c056ed0 con 0x7f73300adf70 2023-05-10T04:20:56.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f731406ace0 msgr2=0x7f731406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:56.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f731406ace0 0x7f731406d190 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f73300b2ae0 tx=0x7f7320008040 comp rx=0 tx=0).stop 2023-05-10T04:20:56.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73300adf70 msgr2=0x7f733015be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:56.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73300adf70 0x7f733015be80 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f732c00c4e0 tx=0x7f732c00c7f0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 shutdown_connections 2023-05-10T04:20:56.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f731406ace0 0x7f731406d190 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f733015cf10 0x7f73300afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73300adf70 0x7f733015be80 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 --2- 172.21.15.132:0/578542984 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f73300cd760 0x7f73300b0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:56.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 >> 172.21.15.132:0/578542984 conn(0x7f73300cf720 msgr2=0x7f73300c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:56.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 shutdown_connections 2023-05-10T04:20:56.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:56.954+0000 7f73383ff700 1 -- 172.21.15.132:0/578542984 wait complete. 2023-05-10T04:20:56.975 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-10T04:20:56.976 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-10T04:20:57.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.160+0000 7ff0ee7ff700 1 Processor -- start 2023-05-10T04:20:57.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.160+0000 7ff0ee7ff700 1 -- start start 2023-05-10T04:20:57.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0ee7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e80cd640 0x7ff0e80cfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0ee7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7ff0e80d00b0 0x7ff0e80d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0ee7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e815d480 con 0x7ff0e815a280 2023-05-10T04:20:57.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0ee7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e815d6e0 con 0x7ff0e80d00b0 2023-05-10T04:20:57.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0ee7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815d9c0 con 0x7ff0e80cd640 2023-05-10T04:20:57.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0e7fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff0e815a280 0x7ff0e815cd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35898/0 (socket says 172.21.15.132:35898) 2023-05-10T04:20:57.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0e7fff700 1 -- 172.21.15.132:0/3366787088 learned_addr learned my addr 172.21.15.132:0/3366787088 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:57.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0dffff700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e80cd640 0x7ff0e80cfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0ecd9c700 1 --2- 172.21.15.132:0/3366787088 >> v2:172.21.15.154:3300/0 conn(0x7ff0e80d00b0 0x7ff0e80d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2627456977 0 0) 0x7ff0e815d480 con 0x7ff0e815a280 2023-05-10T04:20:57.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.162+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d40035b0 con 0x7ff0e815a280 2023-05-10T04:20:57.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2387842919 0 0) 0x7ff0d40035b0 con 0x7ff0e815a280 2023-05-10T04:20:57.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e80cd640 msgr2=0x7ff0e80cfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:57.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e80cd640 0x7ff0e80cfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 >> v2:172.21.15.154:3300/0 conn(0x7ff0e80d00b0 msgr2=0x7ff0e80d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:57.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 --2- 172.21.15.132:0/3366787088 >> v2:172.21.15.154:3300/0 conn(0x7ff0e80d00b0 0x7ff0e80d0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e815dca0 con 0x7ff0e815a280 2023-05-10T04:20:57.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7ff0d8001670 con 0x7ff0e815a280 2023-05-10T04:20:57.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 >> v1:172.21.15.132:6789/0 conn(0x7ff0e815a280 legacy=0x7ff0e815cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:57.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d4003a00 0x7ff0d4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4004430 0x7ff0d40048f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e80cd640 0x7ff0d4005060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815d6e0 con 0x7ff0d4003a00 2023-05-10T04:20:57.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e815d9c0 con 0x7ff0d4004430 2023-05-10T04:20:57.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d400ba10 con 0x7ff0e80cd640 2023-05-10T04:20:57.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e7fff700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d4003a00 0x7ff0d4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0dffff700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4004430 0x7ff0d40048f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0ecd9c700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e80cd640 0x7ff0d4005060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e7fff700 1 -- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e80cd640 msgr2=0x7ff0d4005060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:57.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e7fff700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e80cd640 0x7ff0d4005060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e7fff700 1 -- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4004430 msgr2=0x7ff0d40048f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:57.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e7fff700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4004430 0x7ff0d40048f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.163+0000 7ff0e7fff700 1 -- 172.21.15.132:0/3366787088 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d40035b0 con 0x7ff0d4003a00 2023-05-10T04:20:57.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0e7fff700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d4003a00 0x7ff0d4003e10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800c350 tx=0x7ff0d4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30f699a2d7e787a4 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:57.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d800ce50 con 0x7ff0d4003a00 2023-05-10T04:20:57.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d8005960 con 0x7ff0d4003a00 2023-05-10T04:20:57.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0e77fe700 1 -- 172.21.15.132:0/3366787088 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d8005d10 con 0x7ff0d4003a00 2023-05-10T04:20:57.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/3366787088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d4003a00 msgr2=0x7ff0d4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:57.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0ee7ff700 1 --2- 172.21.15.132:0/3366787088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0d4003a00 0x7ff0d4003e10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff0d800c350 tx=0x7ff0d4005880 comp rx=0 tx=0).stop 2023-05-10T04:20:57.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0ecd9c700 1 -- 172.21.15.132:0/3366787088 reap_dead start 2023-05-10T04:20:57.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/3366787088 shutdown_connections 2023-05-10T04:20:57.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/3366787088 >> 172.21.15.132:0/3366787088 conn(0x7ff0e8066260 msgr2=0x7ff0e8071b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:57.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.164+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/3366787088 shutdown_connections 2023-05-10T04:20:57.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.165+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/3366787088 wait complete. 2023-05-10T04:20:57.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.166+0000 7ff0ee7ff700 1 Processor -- start 2023-05-10T04:20:57.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.166+0000 7ff0ee7ff700 1 -- start start 2023-05-10T04:20:57.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.167+0000 7ff0ee7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4003a00 0x7ff0e80b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.167+0000 7ff0ee7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e80b47c0 0x7ff0e80d14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.167+0000 7ff0ee7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e814b000 0x7ff0e814b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.167+0000 7ff0ee7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80ca4d0 con 0x7ff0e80b47c0 2023-05-10T04:20:57.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.167+0000 7ff0ee7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e814b9c0 con 0x7ff0d4003a00 2023-05-10T04:20:57.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.167+0000 7ff0ee7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e80b3860 con 0x7ff0e814b000 2023-05-10T04:20:57.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e80b47c0 0x7ff0e80d14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e80b47c0 0x7ff0e80d14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42640/0 (socket says 172.21.15.132:42640) 2023-05-10T04:20:57.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 -- 172.21.15.132:0/2268253525 learned_addr learned my addr 172.21.15.132:0/2268253525 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:57.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0e7fff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4003a00 0x7ff0e80b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0ecd9c700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e814b000 0x7ff0e814b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 -- 172.21.15.132:0/2268253525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e814b000 msgr2=0x7ff0e814b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:57.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e814b000 0x7ff0e814b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 -- 172.21.15.132:0/2268253525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4003a00 msgr2=0x7ff0e80b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:57.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4003a00 0x7ff0e80b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 -- 172.21.15.132:0/2268253525 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e80cf650 con 0x7ff0e80b47c0 2023-05-10T04:20:57.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.168+0000 7ff0dffff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e80b47c0 0x7ff0e80d14a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00119a0 tx=0x7ff0d0011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:57.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.169+0000 7ff0e57fa700 1 -- 172.21.15.132:0/2268253525 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000f780 con 0x7ff0e80b47c0 2023-05-10T04:20:57.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.169+0000 7ff0e57fa700 1 -- 172.21.15.132:0/2268253525 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d000f8e0 con 0x7ff0e80b47c0 2023-05-10T04:20:57.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.169+0000 7ff0e57fa700 1 -- 172.21.15.132:0/2268253525 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d000fc70 con 0x7ff0e80b47c0 2023-05-10T04:20:57.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.169+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e80cf370 con 0x7ff0e80b47c0 2023-05-10T04:20:57.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.169+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e815a650 con 0x7ff0e80b47c0 2023-05-10T04:20:57.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.170+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e80b8930 con 0x7ff0e80b47c0 2023-05-10T04:20:57.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.171+0000 7ff0e57fa700 1 -- 172.21.15.132:0/2268253525 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff0d0014440 con 0x7ff0e80b47c0 2023-05-10T04:20:57.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.172+0000 7ff0e57fa700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff0c806ace0 0x7ff0c806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:57.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.172+0000 7ff0e57fa700 1 -- 172.21.15.132:0/2268253525 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7ff0d0089a70 con 0x7ff0e80b47c0 2023-05-10T04:20:57.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.172+0000 7ff0e7fff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff0c806ace0 0x7ff0c806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:57.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.173+0000 7ff0e7fff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff0c806ace0 0x7ff0c806d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8008fd0 tx=0x7ff0d800a000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:57.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.176+0000 7ff0e57fa700 1 -- 172.21.15.132:0/2268253525 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7ff0d0058500 con 0x7ff0e80b47c0 2023-05-10T04:20:57.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.415+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff0e80b8650 con 0x7ff0e80b47c0 2023-05-10T04:20:57.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.955+0000 7ff0e57fa700 1 -- 172.21.15.132:0/2268253525 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0d00220c0 con 0x7ff0e80b47c0 2023-05-10T04:20:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff0c806ace0 msgr2=0x7ff0c806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff0c806ace0 0x7ff0c806d190 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8008fd0 tx=0x7ff0d800a000 comp rx=0 tx=0).stop 2023-05-10T04:20:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e80b47c0 msgr2=0x7ff0e80d14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e80b47c0 0x7ff0e80d14a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff0d00119a0 tx=0x7ff0d0011cb0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 shutdown_connections 2023-05-10T04:20:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7ff0c806ace0 0x7ff0c806d190 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7ff0e814b000 0x7ff0e814b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7ff0d4003a00 0x7ff0e80b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 --2- 172.21.15.132:0/2268253525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0e80b47c0 0x7ff0e80d14a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 >> 172.21.15.132:0/2268253525 conn(0x7ff0e8066260 msgr2=0x7ff0e8160c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 shutdown_connections 2023-05-10T04:20:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:57.958+0000 7ff0ee7ff700 1 -- 172.21.15.132:0/2268253525 wait complete. 2023-05-10T04:20:57.979 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-10T04:20:57.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:20:58.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.162+0000 7f49447ff700 1 Processor -- start 2023-05-10T04:20:58.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.162+0000 7f49447ff700 1 -- start start 2023-05-10T04:20:58.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f49447ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f493c0cd760 0x7f493c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f49447ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 0x7f493c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f49447ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f493c15cf10 0x7f493c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f49447ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c0cc9e0 con 0x7f493c0cd760 2023-05-10T04:20:58.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f49447ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f493c15de20 con 0x7f493c15cf10 2023-05-10T04:20:58.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f49447ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c0ce070 con 0x7f493c0adf70 2023-05-10T04:20:58.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f494259b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f493c0cd760 0x7f493c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f494259b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f493c0cd760 0x7f493c0cdb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42652/0 (socket says 172.21.15.132:42652) 2023-05-10T04:20:58.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.163+0000 7f494259b700 1 -- 172.21.15.132:0/3555727077 learned_addr learned my addr 172.21.15.132:0/3555727077 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:58.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f494259b700 1 -- 172.21.15.132:0/3555727077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 msgr2=0x7f493c0cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:58.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f494259b700 1 --2- 172.21.15.132:0/3555727077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 0x7f493c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f494259b700 1 -- 172.21.15.132:0/3555727077 >> v2:172.21.15.154:3300/0 conn(0x7f493c15cf10 msgr2=0x7f493c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:58.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f494259b700 1 --2- 172.21.15.132:0/3555727077 >> v2:172.21.15.154:3300/0 conn(0x7f493c15cf10 0x7f493c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f494259b700 1 -- 172.21.15.132:0/3555727077 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493c15d860 con 0x7f493c0cd760 2023-05-10T04:20:58.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f494259b700 1 --2- 172.21.15.132:0/3555727077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c0cd760 0x7f493c0cdb30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f493c0b49c0 tx=0x7f4938009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca05a1a94769e4b server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:58.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f4941599700 1 -- 172.21.15.132:0/3555727077 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800f8a0 con 0x7f493c0cd760 2023-05-10T04:20:58.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f4941599700 1 -- 172.21.15.132:0/3555727077 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493800fa00 con 0x7f493c0cd760 2023-05-10T04:20:58.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.164+0000 7f4941599700 1 -- 172.21.15.132:0/3555727077 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493800fd90 con 0x7f493c0cd760 2023-05-10T04:20:58.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 -- 172.21.15.132:0/3555727077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c0cd760 msgr2=0x7f493c0cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 --2- 172.21.15.132:0/3555727077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c0cd760 0x7f493c0cdb30 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f493c0b49c0 tx=0x7f4938009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 -- 172.21.15.132:0/3555727077 shutdown_connections 2023-05-10T04:20:58.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 --2- 172.21.15.132:0/3555727077 >> v2:172.21.15.154:3300/0 conn(0x7f493c15cf10 0x7f493c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 --2- 172.21.15.132:0/3555727077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c0cd760 0x7f493c0cdb30 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 --2- 172.21.15.132:0/3555727077 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 0x7f493c0cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 -- 172.21.15.132:0/3555727077 >> 172.21.15.132:0/3555727077 conn(0x7f493c0cf720 msgr2=0x7f493c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:58.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 -- 172.21.15.132:0/3555727077 shutdown_connections 2023-05-10T04:20:58.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.165+0000 7f49447ff700 1 -- 172.21.15.132:0/3555727077 wait complete. 2023-05-10T04:20:58.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.167+0000 7f49447ff700 1 Processor -- start 2023-05-10T04:20:58.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.167+0000 7f49447ff700 1 -- start start 2023-05-10T04:20:58.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f49447ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 0x7f493c1ec520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f49447ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c0cd760 0x7f493c0ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f49447ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c15cf10 0x7f493c0caee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f49447ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c1f6870 con 0x7f493c15cf10 2023-05-10T04:20:58.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f49447ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f493c1f5cd0 con 0x7f493c0cd760 2023-05-10T04:20:58.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f49447ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493c1f5f40 con 0x7f493c0adf70 2023-05-10T04:20:58.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4942d9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c15cf10 0x7f493c0caee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4942d9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c15cf10 0x7f493c0caee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42666/0 (socket says 172.21.15.132:42666) 2023-05-10T04:20:58.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4942d9c700 1 -- 172.21.15.132:0/735577960 learned_addr learned my addr 172.21.15.132:0/735577960 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:58.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f494259b700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 0x7f493c1ec520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4941d9a700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c0cd760 0x7f493c0ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4942d9c700 1 -- 172.21.15.132:0/735577960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 msgr2=0x7f493c1ec520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4942d9c700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 0x7f493c1ec520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4942d9c700 1 -- 172.21.15.132:0/735577960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c0cd760 msgr2=0x7f493c0ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4942d9c700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c0cd760 0x7f493c0ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.168+0000 7f4942d9c700 1 -- 172.21.15.132:0/735577960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4938009550 con 0x7f493c15cf10 2023-05-10T04:20:58.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.169+0000 7f4942d9c700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c15cf10 0x7f493c0caee0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f493400b9a0 tx=0x7f493400bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:58.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.169+0000 7f4932ffd700 1 -- 172.21.15.132:0/735577960 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400d850 con 0x7f493c15cf10 2023-05-10T04:20:58.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.169+0000 7f4932ffd700 1 -- 172.21.15.132:0/735577960 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f493400d9d0 con 0x7f493c15cf10 2023-05-10T04:20:58.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.169+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f493c0cc670 con 0x7f493c15cf10 2023-05-10T04:20:58.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.169+0000 7f4932ffd700 1 -- 172.21.15.132:0/735577960 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f493400dd80 con 0x7f493c15cf10 2023-05-10T04:20:58.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.169+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f493c15db40 con 0x7f493c15cf10 2023-05-10T04:20:58.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.170+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493c071600 con 0x7f493c15cf10 2023-05-10T04:20:58.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.171+0000 7f4932ffd700 1 -- 172.21.15.132:0/735577960 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f493400e420 con 0x7f493c15cf10 2023-05-10T04:20:58.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.173+0000 7f4932ffd700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f492006ace0 0x7f492006d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.173+0000 7f4932ffd700 1 -- 172.21.15.132:0/735577960 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f4934089760 con 0x7f493c15cf10 2023-05-10T04:20:58.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.173+0000 7f494259b700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f492006ace0 0x7f492006d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.173+0000 7f494259b700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f492006ace0 0x7f492006d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4938000c00 tx=0x7f493801b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:58.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.177+0000 7f4932ffd700 1 -- 172.21.15.132:0/735577960 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f49340546d0 con 0x7f493c15cf10 2023-05-10T04:20:58.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.414+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f493c1f69b0 con 0x7f493c15cf10 2023-05-10T04:20:58.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.415+0000 7f4932ffd700 1 -- 172.21.15.132:0/735577960 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4680 (secure 0 0 0) 0x7f4934057cf0 con 0x7f493c15cf10 2023-05-10T04:20:58.417 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:58.417 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3576545090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3576545090},{"type":"v1","addr":"172.21.15.154:6834","nonce":3576545090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5410,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1200014464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1200014464},{"type":"v1","addr":"172.21.15.154:6835","nonce":1200014464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/130175157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":130175157},{"type":"v1","addr":"172.21.15.132:6835","nonce":130175157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:20:54.936636+0000","modified":"2023-05-10T04:20:57.951378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5526":{"gid":5526,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6837/1800881311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1800881311},{"type":"v1","addr":"172.21.15.132:6837","nonce":1800881311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-10T04:20:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f492006ace0 msgr2=0x7f492006d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f492006ace0 0x7f492006d190 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4938000c00 tx=0x7f493801b040 comp rx=0 tx=0).stop 2023-05-10T04:20:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c15cf10 msgr2=0x7f493c0caee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c15cf10 0x7f493c0caee0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f493400b9a0 tx=0x7f493400bcb0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 shutdown_connections 2023-05-10T04:20:58.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f492006ace0 0x7f492006d190 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f493c15cf10 0x7f493c0caee0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f493c0adf70 0x7f493c1ec520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 --2- 172.21.15.132:0/735577960 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f493c0cd760 0x7f493c0ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 >> 172.21.15.132:0/735577960 conn(0x7f493c0cf720 msgr2=0x7f493c06af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 shutdown_connections 2023-05-10T04:20:58.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.417+0000 7f49447ff700 1 -- 172.21.15.132:0/735577960 wait complete. 2023-05-10T04:20:58.421 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 17 2023-05-10T04:20:58.436 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-10T04:20:58.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.616+0000 7f1ca19ff700 1 Processor -- start 2023-05-10T04:20:58.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.616+0000 7f1ca19ff700 1 -- start start 2023-05-10T04:20:58.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.617+0000 7f1ca19ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c9c0cd760 0x7f1c9c0cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.617+0000 7f1ca19ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c9c0adf70 0x7f1c9c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.617+0000 7f1ca19ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c15cf10 0x7f1c9c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.617+0000 7f1ca19ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c0cc9e0 con 0x7f1c9c0adf70 2023-05-10T04:20:58.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.617+0000 7f1ca19ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c15de20 con 0x7f1c9c0cd760 2023-05-10T04:20:58.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.617+0000 7f1ca19ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0ce070 con 0x7f1c9c15cf10 2023-05-10T04:20:58.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.617+0000 7f1c9a7fc700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c9c0adf70 0x7f1c9c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9affd700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c9c0cd760 0x7f1c9c0cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9a7fc700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c9c0adf70 0x7f1c9c0cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42678/0 (socket says 172.21.15.132:42678) 2023-05-10T04:20:58.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9a7fc700 1 -- 172.21.15.132:0/714917536 learned_addr learned my addr 172.21.15.132:0/714917536 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:58.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9b7fe700 1 --2- 172.21.15.132:0/714917536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c15cf10 0x7f1c9c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9a7fc700 1 -- 172.21.15.132:0/714917536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c15cf10 msgr2=0x7f1c9c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:58.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9a7fc700 1 --2- 172.21.15.132:0/714917536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c15cf10 0x7f1c9c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9a7fc700 1 -- 172.21.15.132:0/714917536 >> v2:172.21.15.154:3300/0 conn(0x7f1c9c0cd760 msgr2=0x7f1c9c0cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:58.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9a7fc700 1 --2- 172.21.15.132:0/714917536 >> v2:172.21.15.154:3300/0 conn(0x7f1c9c0cd760 0x7f1c9c0cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9a7fc700 1 -- 172.21.15.132:0/714917536 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c15d860 con 0x7f1c9c0adf70 2023-05-10T04:20:58.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c9a7fc700 1 --2- 172.21.15.132:0/714917536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c0adf70 0x7f1c9c0cce70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0cc230 tx=0x7f1c90009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d960e7cf6ca59ff2 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:58.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.618+0000 7f1c99ffb700 1 -- 172.21.15.132:0/714917536 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90005e30 con 0x7f1c9c0adf70 2023-05-10T04:20:58.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1c99ffb700 1 -- 172.21.15.132:0/714917536 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90004030 con 0x7f1c9c0adf70 2023-05-10T04:20:58.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1c99ffb700 1 -- 172.21.15.132:0/714917536 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c900043e0 con 0x7f1c9c0adf70 2023-05-10T04:20:58.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 -- 172.21.15.132:0/714917536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c0adf70 msgr2=0x7f1c9c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/714917536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c0adf70 0x7f1c9c0cce70 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c0cc230 tx=0x7f1c90009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 -- 172.21.15.132:0/714917536 shutdown_connections 2023-05-10T04:20:58.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/714917536 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c15cf10 0x7f1c9c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/714917536 >> v2:172.21.15.154:3300/0 conn(0x7f1c9c0cd760 0x7f1c9c0cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/714917536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c0adf70 0x7f1c9c0cce70 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 -- 172.21.15.132:0/714917536 >> 172.21.15.132:0/714917536 conn(0x7f1c9c0cf720 msgr2=0x7f1c9c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:58.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 -- 172.21.15.132:0/714917536 shutdown_connections 2023-05-10T04:20:58.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.619+0000 7f1ca19ff700 1 -- 172.21.15.132:0/714917536 wait complete. 2023-05-10T04:20:58.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.621+0000 7f1ca19ff700 1 Processor -- start 2023-05-10T04:20:58.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.621+0000 7f1ca19ff700 1 -- start start 2023-05-10T04:20:58.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1ca19ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c9c0adf70 0x7f1c9c146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1ca19ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c0cd760 0x7f1c9c0b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1ca19ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c15cf10 0x7f1c9c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1ca19ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0aeb70 con 0x7f1c9c15cf10 2023-05-10T04:20:58.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1ca19ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0b3e70 con 0x7f1c9c0adf70 2023-05-10T04:20:58.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1ca19ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c0b4150 con 0x7f1c9c0cd760 2023-05-10T04:20:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1c9b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c15cf10 0x7f1c9c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1c9b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c15cf10 0x7f1c9c150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42692/0 (socket says 172.21.15.132:42692) 2023-05-10T04:20:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1c9b7fe700 1 -- 172.21.15.132:0/1810161244 learned_addr learned my addr 172.21.15.132:0/1810161244 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1c9affd700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c9c0adf70 0x7f1c9c146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.622+0000 7f1c9a7fc700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c0cd760 0x7f1c9c0b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c9b7fe700 1 -- 172.21.15.132:0/1810161244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c0cd760 msgr2=0x7f1c9c0b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c9b7fe700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c0cd760 0x7f1c9c0b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c9b7fe700 1 -- 172.21.15.132:0/1810161244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c9c0adf70 msgr2=0x7f1c9c146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c9b7fe700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c9c0adf70 0x7f1c9c146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c9b7fe700 1 -- 172.21.15.132:0/1810161244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c90009500 con 0x7f1c9c15cf10 2023-05-10T04:20:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c9b7fe700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c15cf10 0x7f1c9c150be0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400efc0 tx=0x7f1c9400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c83fff700 1 -- 172.21.15.132:0/1810161244 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400cad0 con 0x7f1c9c15cf10 2023-05-10T04:20:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c83fff700 1 -- 172.21.15.132:0/1810161244 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9400f040 con 0x7f1c9c15cf10 2023-05-10T04:20:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1c83fff700 1 -- 172.21.15.132:0/1810161244 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9400ce70 con 0x7f1c9c15cf10 2023-05-10T04:20:58.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c0cc670 con 0x7f1c9c15cf10 2023-05-10T04:20:58.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.623+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c15db40 con 0x7f1c9c15cf10 2023-05-10T04:20:58.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.624+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c071600 con 0x7f1c9c15cf10 2023-05-10T04:20:58.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.625+0000 7f1c83fff700 1 -- 172.21.15.132:0/1810161244 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c94014480 con 0x7f1c9c15cf10 2023-05-10T04:20:58.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.626+0000 7f1c83fff700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c8806ace0 0x7f1c8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:58.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.626+0000 7f1c83fff700 1 -- 172.21.15.132:0/1810161244 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1c94089d10 con 0x7f1c9c15cf10 2023-05-10T04:20:58.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.626+0000 7f1c9affd700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c8806ace0 0x7f1c8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:58.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.627+0000 7f1c9affd700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c8806ace0 0x7f1c8806d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009be0 tx=0x7f1c8c009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:58.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.631+0000 7f1c83fff700 1 -- 172.21.15.132:0/1810161244 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1c9408f020 con 0x7f1c9c15cf10 2023-05-10T04:20:58.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.829+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c9c071b50 con 0x7f1c9c15cf10 2023-05-10T04:20:58.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.831+0000 7f1c83fff700 1 -- 172.21.15.132:0/1810161244 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+18558 (secure 0 0 0) 0x7f1c94058700 con 0x7f1c9c15cf10 2023-05-10T04:20:58.833 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:58.833 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":41,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","created":"2023-05-10T04:18:42.613833+0000","modified":"2023-05-10T04:20:55.939366+0000","last_up_change":"2023-05-10T04:18:58.182355+0000","last_in_change":"2023-05-10T04:18:46.350802+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-10T04:18:55.368075+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-10T04:19:02.680042+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-05-10T04:20:52.693980+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-05-10T04:20:53.927783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77016e07-b3f6-49ff-abc1-0a6f44e63eb8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6817","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6819","nonce":765017957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6821","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6823","nonce":765017957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6829","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6831","nonce":765017957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6825","nonce":765017957},{"type":"v1","addr":"172.21.15.132:6827","nonce":765017957}]},"public_addr":"172.21.15.132:6819/765017957","cluster_addr":"172.21.15.132:6823/765017957","heartbeat_back_addr":"172.21.15.132:6831/765017957","heartbeat_front_addr":"172.21.15.132:6827/765017957","state":["exists","up"]},{"osd":1,"uuid":"1eb053cc-9afa-423c-8726-b8eb036965e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6801","nonce":3174697195}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6803","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6805","nonce":3174697195}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6811","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6813","nonce":3174697195}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6807","nonce":3174697195},{"type":"v1","addr":"172.21.15.132:6809","nonce":3174697195}]},"public_addr":"172.21.15.132:6801/3174697195","cluster_addr":"172.21.15.132:6805/3174697195","heartbeat_back_addr":"172.21.15.132:6813/3174697195","heartbeat_front_addr":"172.21.15.132:6809/3174697195","state":["exists","up"]},{"osd":2,"uuid":"14fc4c3f-e543-4a69-b015-2b22a0cdc634","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6804","nonce":3798938145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6808","nonce":3798938145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6815","nonce":3798938145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3798938145},{"type":"v1","addr":"172.21.15.132:6812","nonce":3798938145}]},"public_addr":"172.21.15.132:6804/3798938145","cluster_addr":"172.21.15.132:6808/3798938145","heartbeat_back_addr":"172.21.15.132:6815/3798938145","heartbeat_front_addr":"172.21.15.132:6812/3798938145","state":["exists","up"]},{"osd":3,"uuid":"e99c67c3-b73f-4074-abe5-262beda6f65a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6818","nonce":2431298337}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6822","nonce":2431298337}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6830","nonce":2431298337}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":2431298337},{"type":"v1","addr":"172.21.15.132:6826","nonce":2431298337}]},"public_addr":"172.21.15.132:6818/2431298337","cluster_addr":"172.21.15.132:6822/2431298337","heartbeat_back_addr":"172.21.15.132:6830/2431298337","heartbeat_front_addr":"172.21.15.132:6826/2431298337","state":["exists","up"]},{"osd":4,"uuid":"1c72e791-f491-43f9-8faa-d19c443b5a33","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6824","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6825","nonce":3626185395}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6826","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6827","nonce":3626185395}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6830","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6831","nonce":3626185395}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6828","nonce":3626185395},{"type":"v1","addr":"172.21.15.154:6829","nonce":3626185395}]},"public_addr":"172.21.15.154:6825/3626185395","cluster_addr":"172.21.15.154:6827/3626185395","heartbeat_back_addr":"172.21.15.154:6831/3626185395","heartbeat_front_addr":"172.21.15.154:6829/3626185395","state":["exists","up"]},{"osd":5,"uuid":"02dca35a-889e-4ec2-865c-174c1bdec803","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6808","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6809","nonce":1978475521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6810","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6811","nonce":1978475521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6814","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6815","nonce":1978475521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6812","nonce":1978475521},{"type":"v1","addr":"172.21.15.154:6813","nonce":1978475521}]},"public_addr":"172.21.15.154:6809/1978475521","cluster_addr":"172.21.15.154:6811/1978475521","heartbeat_back_addr":"172.21.15.154:6815/1978475521","heartbeat_front_addr":"172.21.15.154:6813/1978475521","state":["exists","up"]},{"osd":6,"uuid":"71c6da84-17fc-46b1-be4d-719b9cb31953","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6800","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6801","nonce":2066983237}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6802","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6803","nonce":2066983237}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6806","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6807","nonce":2066983237}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6804","nonce":2066983237},{"type":"v1","addr":"172.21.15.154:6805","nonce":2066983237}]},"public_addr":"172.21.15.154:6801/2066983237","cluster_addr":"172.21.15.154:6803/2066983237","heartbeat_back_addr":"172.21.15.154:6807/2066983237","heartbeat_front_addr":"172.21.15.154:6805/2066983237","state":["exists","up"]},{"osd":7,"uuid":"68ddbaf8-ce9c-4be2-9688-8379ee1a99e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6816","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6817","nonce":745916634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6818","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6819","nonce":745916634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6822","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6823","nonce":745916634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6820","nonce":745916634},{"type":"v1","addr":"172.21.15.154:6821","nonce":745916634}]},"public_addr":"172.21.15.154:6817/745916634","cluster_addr":"172.21.15.154:6819/745916634","heartbeat_back_addr":"172.21.15.154:6823/745916634","heartbeat_front_addr":"172.21.15.154:6821/745916634","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:52.006056+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.634471+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.687218+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.981319+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.661099+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.675035+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.646032+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-10T04:18:51.664283+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-10T04:20:58.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c8806ace0 msgr2=0x7f1c8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c8806ace0 0x7f1c8806d190 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009be0 tx=0x7f1c8c009210 comp rx=0 tx=0).stop 2023-05-10T04:20:58.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c15cf10 msgr2=0x7f1c9c150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:58.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c15cf10 0x7f1c9c150be0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1c9400efc0 tx=0x7f1c9400c0c0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 shutdown_connections 2023-05-10T04:20:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c8806ace0 0x7f1c8806d190 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9c15cf10 0x7f1c9c150be0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c9c0adf70 0x7f1c9c146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 --2- 172.21.15.132:0/1810161244 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c9c0cd760 0x7f1c9c0b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 >> 172.21.15.132:0/1810161244 conn(0x7f1c9c0cf720 msgr2=0x7f1c9c06ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 shutdown_connections 2023-05-10T04:20:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:58.833+0000 7f1ca19ff700 1 -- 172.21.15.132:0/1810161244 wait complete. 2023-05-10T04:20:58.852 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-10T04:20:58.853 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T04:20:59.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.035+0000 7fe188bff700 1 Processor -- start 2023-05-10T04:20:59.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.035+0000 7fe188bff700 1 -- start start 2023-05-10T04:20:59.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe188bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18415c590 0x7fe184160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe188bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1840cf010 0x7fe1840cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe188bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe1840cfd80 0x7fe1840d0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe188bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840cd520 con 0x7fe1840cf010 2023-05-10T04:20:59.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe188bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1840d2640 con 0x7fe1840cfd80 2023-05-10T04:20:59.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe188bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1841610d0 con 0x7fe18415c590 2023-05-10T04:20:59.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe17bfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1840cf010 0x7fe1840cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe17bfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1840cf010 0x7fe1840cf840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42696/0 (socket says 172.21.15.132:42696) 2023-05-10T04:20:59.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe17bfff700 1 -- 172.21.15.132:0/984280709 learned_addr learned my addr 172.21.15.132:0/984280709 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:59.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe182d9d700 1 --2- 172.21.15.132:0/984280709 >> v2:172.21.15.154:3300/0 conn(0x7fe1840cfd80 0x7fe1840d0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.036+0000 7fe18259c700 1 --2- 172.21.15.132:0/984280709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18415c590 0x7fe184160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe17bfff700 1 -- 172.21.15.132:0/984280709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18415c590 msgr2=0x7fe184160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:59.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe17bfff700 1 --2- 172.21.15.132:0/984280709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18415c590 0x7fe184160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe17bfff700 1 -- 172.21.15.132:0/984280709 >> v2:172.21.15.154:3300/0 conn(0x7fe1840cfd80 msgr2=0x7fe1840d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:59.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe17bfff700 1 --2- 172.21.15.132:0/984280709 >> v2:172.21.15.154:3300/0 conn(0x7fe1840cfd80 0x7fe1840d0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe17bfff700 1 -- 172.21.15.132:0/984280709 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1840d0200 con 0x7fe1840cf010 2023-05-10T04:20:59.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe182d9d700 1 --2- 172.21.15.132:0/984280709 >> v2:172.21.15.154:3300/0 conn(0x7fe1840cfd80 0x7fe1840d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:20:59.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe17bfff700 1 --2- 172.21.15.132:0/984280709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1840cf010 0x7fe1840cf840 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe18408c000 tx=0x7fe16c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ebe6201af33842 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe181d9b700 1 -- 172.21.15.132:0/984280709 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00b870 con 0x7fe1840cf010 2023-05-10T04:20:59.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe181d9b700 1 -- 172.21.15.132:0/984280709 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c00b9d0 con 0x7fe1840cf010 2023-05-10T04:20:59.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.037+0000 7fe181d9b700 1 -- 172.21.15.132:0/984280709 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c00bd60 con 0x7fe1840cf010 2023-05-10T04:20:59.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 -- 172.21.15.132:0/984280709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1840cf010 msgr2=0x7fe1840cf840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 --2- 172.21.15.132:0/984280709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1840cf010 0x7fe1840cf840 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe18408c000 tx=0x7fe16c009bd0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 -- 172.21.15.132:0/984280709 shutdown_connections 2023-05-10T04:20:59.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 --2- 172.21.15.132:0/984280709 >> v2:172.21.15.154:3300/0 conn(0x7fe1840cfd80 0x7fe1840d0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 --2- 172.21.15.132:0/984280709 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe18415c590 0x7fe184160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 --2- 172.21.15.132:0/984280709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1840cf010 0x7fe1840cf840 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 -- 172.21.15.132:0/984280709 >> 172.21.15.132:0/984280709 conn(0x7fe184071b10 msgr2=0x7fe184071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:59.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 -- 172.21.15.132:0/984280709 shutdown_connections 2023-05-10T04:20:59.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.038+0000 7fe188bff700 1 -- 172.21.15.132:0/984280709 wait complete. 2023-05-10T04:20:59.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.040+0000 7fe188bff700 1 Processor -- start 2023-05-10T04:20:59.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.040+0000 7fe188bff700 1 -- start start 2023-05-10T04:20:59.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe188bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1840cf010 0x7fe1840c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe188bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1840cfd80 0x7fe18415eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe188bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18415c590 0x7fe18415f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe188bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840c8830 con 0x7fe18415c590 2023-05-10T04:20:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe188bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840b78f0 con 0x7fe1840cf010 2023-05-10T04:20:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe188bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1840b7bd0 con 0x7fe1840cfd80 2023-05-10T04:20:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe182d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18415c590 0x7fe18415f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe182d9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18415c590 0x7fe18415f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42698/0 (socket says 172.21.15.132:42698) 2023-05-10T04:20:59.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe182d9d700 1 -- 172.21.15.132:0/528382265 learned_addr learned my addr 172.21.15.132:0/528382265 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:59.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe18259c700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1840cf010 0x7fe1840c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe17bfff700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1840cfd80 0x7fe18415eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe182d9d700 1 -- 172.21.15.132:0/528382265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1840cfd80 msgr2=0x7fe18415eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe182d9d700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1840cfd80 0x7fe18415eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe182d9d700 1 -- 172.21.15.132:0/528382265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1840cf010 msgr2=0x7fe1840c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe182d9d700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1840cf010 0x7fe1840c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.042+0000 7fe182d9d700 1 -- 172.21.15.132:0/528382265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16c009550 con 0x7fe18415c590 2023-05-10T04:20:59.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.043+0000 7fe182d9d700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18415c590 0x7fe18415f070 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009fa0 tx=0x7fe17c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.043+0000 7fe17affd700 1 -- 172.21.15.132:0/528382265 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c00ddb0 con 0x7fe18415c590 2023-05-10T04:20:59.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.043+0000 7fe17affd700 1 -- 172.21.15.132:0/528382265 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c00f040 con 0x7fe18415c590 2023-05-10T04:20:59.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.043+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1840cf560 con 0x7fe18415c590 2023-05-10T04:20:59.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.043+0000 7fe17affd700 1 -- 172.21.15.132:0/528382265 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c003c60 con 0x7fe18415c590 2023-05-10T04:20:59.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.043+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1840b23c0 con 0x7fe18415c590 2023-05-10T04:20:59.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.044+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1840cd770 con 0x7fe18415c590 2023-05-10T04:20:59.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.045+0000 7fe17affd700 1 -- 172.21.15.132:0/528382265 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe17c004030 con 0x7fe18415c590 2023-05-10T04:20:59.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.046+0000 7fe17affd700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe16406ace0 0x7fe16406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.046+0000 7fe17affd700 1 -- 172.21.15.132:0/528382265 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe17c089670 con 0x7fe18415c590 2023-05-10T04:20:59.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.046+0000 7fe18259c700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe16406ace0 0x7fe16406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.046+0000 7fe18259c700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe16406ace0 0x7fe16406d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe174006b20 tx=0x7fe174008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.050+0000 7fe17affd700 1 -- 172.21.15.132:0/528382265 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe17c0545e0 con 0x7fe18415c590 2023-05-10T04:20:59.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.239+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 --> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe1840b7a60 con 0x7fe16406ace0 2023-05-10T04:20:59.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.249+0000 7fe17affd700 1 -- 172.21.15.132:0/528382265 <== mgr.4100 v2:172.21.15.132:6832/1621031024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+309153 (secure 0 0 0) 0x7fe1840b7a60 con 0x7fe16406ace0 2023-05-10T04:20:59.255 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:59.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe16406ace0 msgr2=0x7fe16406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe16406ace0 0x7fe16406d190 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe174006b20 tx=0x7fe174008040 comp rx=0 tx=0).stop 2023-05-10T04:20:59.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18415c590 msgr2=0x7fe18415f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18415c590 0x7fe18415f070 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe17c009fa0 tx=0x7fe17c00d3b0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 shutdown_connections 2023-05-10T04:20:59.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe16406ace0 0x7fe16406d190 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18415c590 0x7fe18415f070 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe1840cf010 0x7fe1840c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 --2- 172.21.15.132:0/528382265 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe1840cfd80 0x7fe18415eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 >> 172.21.15.132:0/528382265 conn(0x7fe184071b10 msgr2=0x7fe1840d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:59.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 shutdown_connections 2023-05-10T04:20:59.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.254+0000 7fe188bff700 1 -- 172.21.15.132:0/528382265 wait complete. 2023-05-10T04:20:59.259 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-05-10T04:20:59.273 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-05-10T04:20:57.345822+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591166,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":184,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":139,"ondisk_log_size":139,"up":184,"acting":184,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":39,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70376,"kb_used_data":4648,"kb_used_omap":0,"kb_used_meta":65664,"kb_avail":754904344,"statfs":{"total":773094113280,"available":773022048256,"internally_reserved":0,"allocated":4759552,"data_stored":2713260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67239936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000833"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967349+0000","last_change":"2023-05-10T04:20:54.965493+0000","last_active":"2023-05-10T04:20:54.967349+0000","last_peered":"2023-05-10T04:20:54.967349+0000","last_clean":"2023-05-10T04:20:54.967349+0000","last_became_active":"2023-05-10T04:20:54.965124+0000","last_became_peered":"2023-05-10T04:20:54.965124+0000","last_unstale":"2023-05-10T04:20:54.967349+0000","last_undegraded":"2023-05-10T04:20:54.967349+0000","last_fullsized":"2023-05-10T04:20:54.967349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:04:43.432203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976999+0000","last_change":"2023-05-10T04:20:54.970379+0000","last_active":"2023-05-10T04:20:54.976999+0000","last_peered":"2023-05-10T04:20:54.976999+0000","last_clean":"2023-05-10T04:20:54.976999+0000","last_became_active":"2023-05-10T04:20:54.970116+0000","last_became_peered":"2023-05-10T04:20:54.970116+0000","last_unstale":"2023-05-10T04:20:54.976999+0000","last_undegraded":"2023-05-10T04:20:54.976999+0000","last_fullsized":"2023-05-10T04:20:54.976999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:49:39.818147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971268+0000","last_change":"2023-05-10T04:20:54.968515+0000","last_active":"2023-05-10T04:20:54.971268+0000","last_peered":"2023-05-10T04:20:54.971268+0000","last_clean":"2023-05-10T04:20:54.971268+0000","last_became_active":"2023-05-10T04:20:54.968257+0000","last_became_peered":"2023-05-10T04:20:54.968257+0000","last_unstale":"2023-05-10T04:20:54.971268+0000","last_undegraded":"2023-05-10T04:20:54.971268+0000","last_fullsized":"2023-05-10T04:20:54.971268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:29:33.378827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976248+0000","last_change":"2023-05-10T04:20:54.966825+0000","last_active":"2023-05-10T04:20:54.976248+0000","last_peered":"2023-05-10T04:20:54.976248+0000","last_clean":"2023-05-10T04:20:54.976248+0000","last_became_active":"2023-05-10T04:20:54.966361+0000","last_became_peered":"2023-05-10T04:20:54.966361+0000","last_unstale":"2023-05-10T04:20:54.976248+0000","last_undegraded":"2023-05-10T04:20:54.976248+0000","last_fullsized":"2023-05-10T04:20:54.976248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:36:14.700306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.973562+0000","last_change":"2023-05-10T04:20:54.970135+0000","last_active":"2023-05-10T04:20:54.973562+0000","last_peered":"2023-05-10T04:20:54.973562+0000","last_clean":"2023-05-10T04:20:54.973562+0000","last_became_active":"2023-05-10T04:20:54.969882+0000","last_became_peered":"2023-05-10T04:20:54.969882+0000","last_unstale":"2023-05-10T04:20:54.973562+0000","last_undegraded":"2023-05-10T04:20:54.973562+0000","last_fullsized":"2023-05-10T04:20:54.973562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:07:55.126771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.969589+0000","last_change":"2023-05-10T04:20:54.964982+0000","last_active":"2023-05-10T04:20:54.969589+0000","last_peered":"2023-05-10T04:20:54.969589+0000","last_clean":"2023-05-10T04:20:54.969589+0000","last_became_active":"2023-05-10T04:20:54.964690+0000","last_became_peered":"2023-05-10T04:20:54.964690+0000","last_unstale":"2023-05-10T04:20:54.969589+0000","last_undegraded":"2023-05-10T04:20:54.969589+0000","last_fullsized":"2023-05-10T04:20:54.969589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:51:12.502304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967197+0000","last_change":"2023-05-10T04:20:54.963503+0000","last_active":"2023-05-10T04:20:54.967197+0000","last_peered":"2023-05-10T04:20:54.967197+0000","last_clean":"2023-05-10T04:20:54.967197+0000","last_became_active":"2023-05-10T04:20:54.963242+0000","last_became_peered":"2023-05-10T04:20:54.963242+0000","last_unstale":"2023-05-10T04:20:54.967197+0000","last_undegraded":"2023-05-10T04:20:54.967197+0000","last_fullsized":"2023-05-10T04:20:54.967197+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:36:42.941614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.975876+0000","last_change":"2023-05-10T04:20:54.963632+0000","last_active":"2023-05-10T04:20:54.975876+0000","last_peered":"2023-05-10T04:20:54.975876+0000","last_clean":"2023-05-10T04:20:54.975876+0000","last_became_active":"2023-05-10T04:20:54.963371+0000","last_became_peered":"2023-05-10T04:20:54.963371+0000","last_unstale":"2023-05-10T04:20:54.975876+0000","last_undegraded":"2023-05-10T04:20:54.975876+0000","last_fullsized":"2023-05-10T04:20:54.975876+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:13:36.014721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.972791+0000","last_change":"2023-05-10T04:20:54.970436+0000","last_active":"2023-05-10T04:20:54.972791+0000","last_peered":"2023-05-10T04:20:54.972791+0000","last_clean":"2023-05-10T04:20:54.972791+0000","last_became_active":"2023-05-10T04:20:54.969994+0000","last_became_peered":"2023-05-10T04:20:54.969994+0000","last_unstale":"2023-05-10T04:20:54.972791+0000","last_undegraded":"2023-05-10T04:20:54.972791+0000","last_fullsized":"2023-05-10T04:20:54.972791+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:11:10.428062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:54.451412+0000","last_change":"2023-05-10T04:20:54.451412+0000","last_active":"2023-05-10T04:20:54.451412+0000","last_peered":"2023-05-10T04:20:54.451412+0000","last_clean":"2023-05-10T04:20:54.451412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:54.451412+0000","last_undegraded":"2023-05-10T04:20:54.451412+0000","last_fullsized":"2023-05-10T04:20:54.451412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979056+0000","last_change":"2023-05-10T04:20:54.975484+0000","last_active":"2023-05-10T04:20:54.979056+0000","last_peered":"2023-05-10T04:20:54.979056+0000","last_clean":"2023-05-10T04:20:54.979056+0000","last_became_active":"2023-05-10T04:20:54.966835+0000","last_became_peered":"2023-05-10T04:20:54.966835+0000","last_unstale":"2023-05-10T04:20:54.979056+0000","last_undegraded":"2023-05-10T04:20:54.979056+0000","last_fullsized":"2023-05-10T04:20:54.979056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:07:52.098991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.973945+0000","last_change":"2023-05-10T04:20:54.962927+0000","last_active":"2023-05-10T04:20:54.973945+0000","last_peered":"2023-05-10T04:20:54.973945+0000","last_clean":"2023-05-10T04:20:54.973945+0000","last_became_active":"2023-05-10T04:20:54.962485+0000","last_became_peered":"2023-05-10T04:20:54.962485+0000","last_unstale":"2023-05-10T04:20:54.973945+0000","last_undegraded":"2023-05-10T04:20:54.973945+0000","last_fullsized":"2023-05-10T04:20:54.973945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:19:10.330448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.969641+0000","last_change":"2023-05-10T04:20:54.963696+0000","last_active":"2023-05-10T04:20:54.969641+0000","last_peered":"2023-05-10T04:20:54.969641+0000","last_clean":"2023-05-10T04:20:54.969641+0000","last_became_active":"2023-05-10T04:20:54.963445+0000","last_became_peered":"2023-05-10T04:20:54.963445+0000","last_unstale":"2023-05-10T04:20:54.969641+0000","last_undegraded":"2023-05-10T04:20:54.969641+0000","last_fullsized":"2023-05-10T04:20:54.969641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:28:16.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978312+0000","last_change":"2023-05-10T04:20:54.971756+0000","last_active":"2023-05-10T04:20:54.978312+0000","last_peered":"2023-05-10T04:20:54.978312+0000","last_clean":"2023-05-10T04:20:54.978312+0000","last_became_active":"2023-05-10T04:20:54.971482+0000","last_became_peered":"2023-05-10T04:20:54.971482+0000","last_unstale":"2023-05-10T04:20:54.978312+0000","last_undegraded":"2023-05-10T04:20:54.978312+0000","last_fullsized":"2023-05-10T04:20:54.978312+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:29:33.378827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978106+0000","last_change":"2023-05-10T04:20:54.971129+0000","last_active":"2023-05-10T04:20:54.978106+0000","last_peered":"2023-05-10T04:20:54.978106+0000","last_clean":"2023-05-10T04:20:54.978106+0000","last_became_active":"2023-05-10T04:20:54.970851+0000","last_became_peered":"2023-05-10T04:20:54.970851+0000","last_unstale":"2023-05-10T04:20:54.978106+0000","last_undegraded":"2023-05-10T04:20:54.978106+0000","last_fullsized":"2023-05-10T04:20:54.978106+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:17:52.655046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979541+0000","last_change":"2023-05-10T04:20:54.976921+0000","last_active":"2023-05-10T04:20:54.979541+0000","last_peered":"2023-05-10T04:20:54.979541+0000","last_clean":"2023-05-10T04:20:54.979541+0000","last_became_active":"2023-05-10T04:20:54.976641+0000","last_became_peered":"2023-05-10T04:20:54.976641+0000","last_unstale":"2023-05-10T04:20:54.979541+0000","last_undegraded":"2023-05-10T04:20:54.979541+0000","last_fullsized":"2023-05-10T04:20:54.979541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:54:59.376839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970532+0000","last_change":"2023-05-10T04:20:54.968930+0000","last_active":"2023-05-10T04:20:54.970532+0000","last_peered":"2023-05-10T04:20:54.970532+0000","last_clean":"2023-05-10T04:20:54.970532+0000","last_became_active":"2023-05-10T04:20:54.968507+0000","last_became_peered":"2023-05-10T04:20:54.968507+0000","last_unstale":"2023-05-10T04:20:54.970532+0000","last_undegraded":"2023-05-10T04:20:54.970532+0000","last_fullsized":"2023-05-10T04:20:54.970532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:29:53.626260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971019+0000","last_change":"2023-05-10T04:20:54.967803+0000","last_active":"2023-05-10T04:20:54.971019+0000","last_peered":"2023-05-10T04:20:54.971019+0000","last_clean":"2023-05-10T04:20:54.971019+0000","last_became_active":"2023-05-10T04:20:54.967524+0000","last_became_peered":"2023-05-10T04:20:54.967524+0000","last_unstale":"2023-05-10T04:20:54.971019+0000","last_undegraded":"2023-05-10T04:20:54.971019+0000","last_fullsized":"2023-05-10T04:20:54.971019+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:41:12.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.975905+0000","last_change":"2023-05-10T04:20:54.970646+0000","last_active":"2023-05-10T04:20:54.975905+0000","last_peered":"2023-05-10T04:20:54.975905+0000","last_clean":"2023-05-10T04:20:54.975905+0000","last_became_active":"2023-05-10T04:20:54.970383+0000","last_became_peered":"2023-05-10T04:20:54.970383+0000","last_unstale":"2023-05-10T04:20:54.975905+0000","last_undegraded":"2023-05-10T04:20:54.975905+0000","last_fullsized":"2023-05-10T04:20:54.975905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:28:18.570843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:54.451412+0000","last_change":"2023-05-10T04:20:54.451412+0000","last_active":"2023-05-10T04:20:54.451412+0000","last_peered":"2023-05-10T04:20:54.451412+0000","last_clean":"2023-05-10T04:20:54.451412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:54.451412+0000","last_undegraded":"2023-05-10T04:20:54.451412+0000","last_fullsized":"2023-05-10T04:20:54.451412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978351+0000","last_change":"2023-05-10T04:20:54.972170+0000","last_active":"2023-05-10T04:20:54.978351+0000","last_peered":"2023-05-10T04:20:54.978351+0000","last_clean":"2023-05-10T04:20:54.978351+0000","last_became_active":"2023-05-10T04:20:54.971900+0000","last_became_peered":"2023-05-10T04:20:54.971900+0000","last_unstale":"2023-05-10T04:20:54.978351+0000","last_undegraded":"2023-05-10T04:20:54.978351+0000","last_fullsized":"2023-05-10T04:20:54.978351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:34:15.611736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.966655+0000","last_change":"2023-05-10T04:20:54.964088+0000","last_active":"2023-05-10T04:20:54.966655+0000","last_peered":"2023-05-10T04:20:54.966655+0000","last_clean":"2023-05-10T04:20:54.966655+0000","last_became_active":"2023-05-10T04:20:54.963826+0000","last_became_peered":"2023-05-10T04:20:54.963826+0000","last_unstale":"2023-05-10T04:20:54.966655+0000","last_undegraded":"2023-05-10T04:20:54.966655+0000","last_fullsized":"2023-05-10T04:20:54.966655+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:10:21.900202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967215+0000","last_change":"2023-05-10T04:20:54.964795+0000","last_active":"2023-05-10T04:20:54.967215+0000","last_peered":"2023-05-10T04:20:54.967215+0000","last_clean":"2023-05-10T04:20:54.967215+0000","last_became_active":"2023-05-10T04:20:54.964516+0000","last_became_peered":"2023-05-10T04:20:54.964516+0000","last_unstale":"2023-05-10T04:20:54.967215+0000","last_undegraded":"2023-05-10T04:20:54.967215+0000","last_fullsized":"2023-05-10T04:20:54.967215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:08:18.392166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.964174+0000","last_change":"2023-05-10T04:20:54.961509+0000","last_active":"2023-05-10T04:20:54.964174+0000","last_peered":"2023-05-10T04:20:54.964174+0000","last_clean":"2023-05-10T04:20:54.964174+0000","last_became_active":"2023-05-10T04:20:54.961255+0000","last_became_peered":"2023-05-10T04:20:54.961255+0000","last_unstale":"2023-05-10T04:20:54.964174+0000","last_undegraded":"2023-05-10T04:20:54.964174+0000","last_fullsized":"2023-05-10T04:20:54.964174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:11.802052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.968410+0000","last_change":"2023-05-10T04:20:54.966273+0000","last_active":"2023-05-10T04:20:54.968410+0000","last_peered":"2023-05-10T04:20:54.968410+0000","last_clean":"2023-05-10T04:20:54.968410+0000","last_became_active":"2023-05-10T04:20:54.965911+0000","last_became_peered":"2023-05-10T04:20:54.965911+0000","last_unstale":"2023-05-10T04:20:54.968410+0000","last_undegraded":"2023-05-10T04:20:54.968410+0000","last_fullsized":"2023-05-10T04:20:54.968410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:40.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.975519+0000","last_change":"2023-05-10T04:20:54.965746+0000","last_active":"2023-05-10T04:20:54.975519+0000","last_peered":"2023-05-10T04:20:54.975519+0000","last_clean":"2023-05-10T04:20:54.975519+0000","last_became_active":"2023-05-10T04:20:54.964196+0000","last_became_peered":"2023-05-10T04:20:54.964196+0000","last_unstale":"2023-05-10T04:20:54.975519+0000","last_undegraded":"2023-05-10T04:20:54.975519+0000","last_fullsized":"2023-05-10T04:20:54.975519+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:41:12.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967976+0000","last_change":"2023-05-10T04:20:54.966461+0000","last_active":"2023-05-10T04:20:54.967976+0000","last_peered":"2023-05-10T04:20:54.967976+0000","last_clean":"2023-05-10T04:20:54.967976+0000","last_became_active":"2023-05-10T04:20:54.966216+0000","last_became_peered":"2023-05-10T04:20:54.966216+0000","last_unstale":"2023-05-10T04:20:54.967976+0000","last_undegraded":"2023-05-10T04:20:54.967976+0000","last_fullsized":"2023-05-10T04:20:54.967976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:30:08.077888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.963936+0000","last_change":"2023-05-10T04:20:54.957470+0000","last_active":"2023-05-10T04:20:54.963936+0000","last_peered":"2023-05-10T04:20:54.963936+0000","last_clean":"2023-05-10T04:20:54.963936+0000","last_became_active":"2023-05-10T04:20:54.957207+0000","last_became_peered":"2023-05-10T04:20:54.957207+0000","last_unstale":"2023-05-10T04:20:54.963936+0000","last_undegraded":"2023-05-10T04:20:54.963936+0000","last_fullsized":"2023-05-10T04:20:54.963936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:16:34.409120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967323+0000","last_change":"2023-05-10T04:20:54.965744+0000","last_active":"2023-05-10T04:20:54.967323+0000","last_peered":"2023-05-10T04:20:54.967323+0000","last_clean":"2023-05-10T04:20:54.967323+0000","last_became_active":"2023-05-10T04:20:54.965421+0000","last_became_peered":"2023-05-10T04:20:54.965421+0000","last_unstale":"2023-05-10T04:20:54.967323+0000","last_undegraded":"2023-05-10T04:20:54.967323+0000","last_fullsized":"2023-05-10T04:20:54.967323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:31:38.581615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957307+0000","last_change":"2023-05-10T04:20:54.950851+0000","last_active":"2023-05-10T04:20:54.957307+0000","last_peered":"2023-05-10T04:20:54.957307+0000","last_clean":"2023-05-10T04:20:54.957307+0000","last_became_active":"2023-05-10T04:20:54.950597+0000","last_became_peered":"2023-05-10T04:20:54.950597+0000","last_unstale":"2023-05-10T04:20:54.957307+0000","last_undegraded":"2023-05-10T04:20:54.957307+0000","last_fullsized":"2023-05-10T04:20:54.957307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:04.312090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.968285+0000","last_change":"2023-05-10T04:20:54.961467+0000","last_active":"2023-05-10T04:20:54.968285+0000","last_peered":"2023-05-10T04:20:54.968285+0000","last_clean":"2023-05-10T04:20:54.968285+0000","last_became_active":"2023-05-10T04:20:54.961157+0000","last_became_peered":"2023-05-10T04:20:54.961157+0000","last_unstale":"2023-05-10T04:20:54.968285+0000","last_undegraded":"2023-05-10T04:20:54.968285+0000","last_fullsized":"2023-05-10T04:20:54.968285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:11.802052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979167+0000","last_change":"2023-05-10T04:20:54.976004+0000","last_active":"2023-05-10T04:20:54.979167+0000","last_peered":"2023-05-10T04:20:54.979167+0000","last_clean":"2023-05-10T04:20:54.979167+0000","last_became_active":"2023-05-10T04:20:54.966903+0000","last_became_peered":"2023-05-10T04:20:54.966903+0000","last_unstale":"2023-05-10T04:20:54.979167+0000","last_undegraded":"2023-05-10T04:20:54.979167+0000","last_fullsized":"2023-05-10T04:20:54.979167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:59:37.266937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971093+0000","last_change":"2023-05-10T04:20:54.968241+0000","last_active":"2023-05-10T04:20:54.971093+0000","last_peered":"2023-05-10T04:20:54.971093+0000","last_clean":"2023-05-10T04:20:54.971093+0000","last_became_active":"2023-05-10T04:20:54.967948+0000","last_became_peered":"2023-05-10T04:20:54.967948+0000","last_unstale":"2023-05-10T04:20:54.971093+0000","last_undegraded":"2023-05-10T04:20:54.971093+0000","last_fullsized":"2023-05-10T04:20:54.971093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:53:17.540742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970285+0000","last_change":"2023-05-10T04:20:54.474706+0000","last_active":"2023-05-10T04:20:54.970285+0000","last_peered":"2023-05-10T04:20:54.970285+0000","last_clean":"2023-05-10T04:20:54.970285+0000","last_became_active":"2023-05-10T04:20:54.474347+0000","last_became_peered":"2023-05-10T04:20:54.474347+0000","last_unstale":"2023-05-10T04:20:54.970285+0000","last_undegraded":"2023-05-10T04:20:54.970285+0000","last_fullsized":"2023-05-10T04:20:54.970285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:03.309151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.975958+0000","last_change":"2023-05-10T04:20:54.971777+0000","last_active":"2023-05-10T04:20:54.975958+0000","last_peered":"2023-05-10T04:20:54.975958+0000","last_clean":"2023-05-10T04:20:54.975958+0000","last_became_active":"2023-05-10T04:20:54.971512+0000","last_became_peered":"2023-05-10T04:20:54.971512+0000","last_unstale":"2023-05-10T04:20:54.975958+0000","last_undegraded":"2023-05-10T04:20:54.975958+0000","last_fullsized":"2023-05-10T04:20:54.975958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:23:34.631288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.958041+0000","last_change":"2023-05-10T04:20:54.473160+0000","last_active":"2023-05-10T04:20:54.958041+0000","last_peered":"2023-05-10T04:20:54.958041+0000","last_clean":"2023-05-10T04:20:54.958041+0000","last_became_active":"2023-05-10T04:20:54.472893+0000","last_became_peered":"2023-05-10T04:20:54.472893+0000","last_unstale":"2023-05-10T04:20:54.958041+0000","last_undegraded":"2023-05-10T04:20:54.958041+0000","last_fullsized":"2023-05-10T04:20:54.958041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:42:05.355245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978905+0000","last_change":"2023-05-10T04:20:54.971648+0000","last_active":"2023-05-10T04:20:54.978905+0000","last_peered":"2023-05-10T04:20:54.978905+0000","last_clean":"2023-05-10T04:20:54.978905+0000","last_became_active":"2023-05-10T04:20:54.971343+0000","last_became_peered":"2023-05-10T04:20:54.971343+0000","last_unstale":"2023-05-10T04:20:54.978905+0000","last_undegraded":"2023-05-10T04:20:54.978905+0000","last_fullsized":"2023-05-10T04:20:54.978905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:51.126879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.966679+0000","last_change":"2023-05-10T04:20:54.473995+0000","last_active":"2023-05-10T04:20:54.966679+0000","last_peered":"2023-05-10T04:20:54.966679+0000","last_clean":"2023-05-10T04:20:54.966679+0000","last_became_active":"2023-05-10T04:20:54.473640+0000","last_became_peered":"2023-05-10T04:20:54.473640+0000","last_unstale":"2023-05-10T04:20:54.966679+0000","last_undegraded":"2023-05-10T04:20:54.966679+0000","last_fullsized":"2023-05-10T04:20:54.966679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:49:38.815208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979214+0000","last_change":"2023-05-10T04:20:54.976262+0000","last_active":"2023-05-10T04:20:54.979214+0000","last_peered":"2023-05-10T04:20:54.979214+0000","last_clean":"2023-05-10T04:20:54.979214+0000","last_became_active":"2023-05-10T04:20:54.966987+0000","last_became_peered":"2023-05-10T04:20:54.966987+0000","last_unstale":"2023-05-10T04:20:54.979214+0000","last_undegraded":"2023-05-10T04:20:54.979214+0000","last_fullsized":"2023-05-10T04:20:54.979214+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:30:15.512791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.958268+0000","last_change":"2023-05-10T04:20:54.473872+0000","last_active":"2023-05-10T04:20:54.958268+0000","last_peered":"2023-05-10T04:20:54.958268+0000","last_clean":"2023-05-10T04:20:54.958268+0000","last_became_active":"2023-05-10T04:20:54.473616+0000","last_became_peered":"2023-05-10T04:20:54.473616+0000","last_unstale":"2023-05-10T04:20:54.958268+0000","last_undegraded":"2023-05-10T04:20:54.958268+0000","last_fullsized":"2023-05-10T04:20:54.958268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:32:58.248077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967252+0000","last_change":"2023-05-10T04:20:54.964085+0000","last_active":"2023-05-10T04:20:54.967252+0000","last_peered":"2023-05-10T04:20:54.967252+0000","last_clean":"2023-05-10T04:20:54.967252+0000","last_became_active":"2023-05-10T04:20:54.963812+0000","last_became_peered":"2023-05-10T04:20:54.963812+0000","last_unstale":"2023-05-10T04:20:54.967252+0000","last_undegraded":"2023-05-10T04:20:54.967252+0000","last_fullsized":"2023-05-10T04:20:54.967252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:37:47.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.964092+0000","last_change":"2023-05-10T04:20:54.474896+0000","last_active":"2023-05-10T04:20:54.964092+0000","last_peered":"2023-05-10T04:20:54.964092+0000","last_clean":"2023-05-10T04:20:54.964092+0000","last_became_active":"2023-05-10T04:20:54.474382+0000","last_became_peered":"2023-05-10T04:20:54.474382+0000","last_unstale":"2023-05-10T04:20:54.964092+0000","last_undegraded":"2023-05-10T04:20:54.964092+0000","last_fullsized":"2023-05-10T04:20:54.964092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:19:09.327509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:54.451412+0000","last_change":"2023-05-10T04:20:54.451412+0000","last_active":"2023-05-10T04:20:54.451412+0000","last_peered":"2023-05-10T04:20:54.451412+0000","last_clean":"2023-05-10T04:20:54.451412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:54.451412+0000","last_undegraded":"2023-05-10T04:20:54.451412+0000","last_fullsized":"2023-05-10T04:20:54.451412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.965333+0000","last_change":"2023-05-10T04:20:54.475843+0000","last_active":"2023-05-10T04:20:54.965333+0000","last_peered":"2023-05-10T04:20:54.965333+0000","last_clean":"2023-05-10T04:20:54.965333+0000","last_became_active":"2023-05-10T04:20:54.475569+0000","last_became_peered":"2023-05-10T04:20:54.475569+0000","last_unstale":"2023-05-10T04:20:54.965333+0000","last_undegraded":"2023-05-10T04:20:54.965333+0000","last_fullsized":"2023-05-10T04:20:54.965333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:50:42.610097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:54.451412+0000","last_change":"2023-05-10T04:20:54.451412+0000","last_active":"2023-05-10T04:20:54.451412+0000","last_peered":"2023-05-10T04:20:54.451412+0000","last_clean":"2023-05-10T04:20:54.451412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:54.451412+0000","last_undegraded":"2023-05-10T04:20:54.451412+0000","last_fullsized":"2023-05-10T04:20:54.451412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957746+0000","last_change":"2023-05-10T04:20:54.478854+0000","last_active":"2023-05-10T04:20:54.957746+0000","last_peered":"2023-05-10T04:20:54.957746+0000","last_clean":"2023-05-10T04:20:54.957746+0000","last_became_active":"2023-05-10T04:20:54.478581+0000","last_became_peered":"2023-05-10T04:20:54.478581+0000","last_unstale":"2023-05-10T04:20:54.957746+0000","last_undegraded":"2023-05-10T04:20:54.957746+0000","last_fullsized":"2023-05-10T04:20:54.957746+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:10.799112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.956435+0000","last_change":"2023-05-10T04:20:54.954581+0000","last_active":"2023-05-10T04:20:54.956435+0000","last_peered":"2023-05-10T04:20:54.956435+0000","last_clean":"2023-05-10T04:20:54.956435+0000","last_became_active":"2023-05-10T04:20:54.953958+0000","last_became_peered":"2023-05-10T04:20:54.953958+0000","last_unstale":"2023-05-10T04:20:54.956435+0000","last_undegraded":"2023-05-10T04:20:54.956435+0000","last_fullsized":"2023-05-10T04:20:54.956435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:44:59.457203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:53.448472+0000","last_change":"2023-05-10T04:20:53.448472+0000","last_active":"2023-05-10T04:20:53.448472+0000","last_peered":"2023-05-10T04:20:53.448472+0000","last_clean":"2023-05-10T04:20:53.448472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:53.448472+0000","last_undegraded":"2023-05-10T04:20:53.448472+0000","last_fullsized":"2023-05-10T04:20:53.448472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.964685+0000","last_change":"2023-05-10T04:20:54.962342+0000","last_active":"2023-05-10T04:20:54.964685+0000","last_peered":"2023-05-10T04:20:54.964685+0000","last_clean":"2023-05-10T04:20:54.964685+0000","last_became_active":"2023-05-10T04:20:54.962089+0000","last_became_peered":"2023-05-10T04:20:54.962089+0000","last_unstale":"2023-05-10T04:20:54.964685+0000","last_undegraded":"2023-05-10T04:20:54.964685+0000","last_fullsized":"2023-05-10T04:20:54.964685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:15:24.216089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.949631+0000","last_change":"2023-05-10T04:20:54.480029+0000","last_active":"2023-05-10T04:20:54.949631+0000","last_peered":"2023-05-10T04:20:54.949631+0000","last_clean":"2023-05-10T04:20:54.949631+0000","last_became_active":"2023-05-10T04:20:54.479780+0000","last_became_peered":"2023-05-10T04:20:54.479780+0000","last_unstale":"2023-05-10T04:20:54.949631+0000","last_undegraded":"2023-05-10T04:20:54.949631+0000","last_fullsized":"2023-05-10T04:20:54.949631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:17:51.652107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970826+0000","last_change":"2023-05-10T04:20:54.966827+0000","last_active":"2023-05-10T04:20:54.970826+0000","last_peered":"2023-05-10T04:20:54.970826+0000","last_clean":"2023-05-10T04:20:54.970826+0000","last_became_active":"2023-05-10T04:20:54.966504+0000","last_became_peered":"2023-05-10T04:20:54.966504+0000","last_unstale":"2023-05-10T04:20:54.970826+0000","last_undegraded":"2023-05-10T04:20:54.970826+0000","last_fullsized":"2023-05-10T04:20:54.970826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:51.126879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:53.448472+0000","last_change":"2023-05-10T04:20:53.448472+0000","last_active":"2023-05-10T04:20:53.448472+0000","last_peered":"2023-05-10T04:20:53.448472+0000","last_clean":"2023-05-10T04:20:53.448472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:53.448472+0000","last_undegraded":"2023-05-10T04:20:53.448472+0000","last_fullsized":"2023-05-10T04:20:53.448472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978157+0000","last_change":"2023-05-10T04:20:54.971672+0000","last_active":"2023-05-10T04:20:54.978157+0000","last_peered":"2023-05-10T04:20:54.978157+0000","last_clean":"2023-05-10T04:20:54.978157+0000","last_became_active":"2023-05-10T04:20:54.971410+0000","last_became_peered":"2023-05-10T04:20:54.971410+0000","last_unstale":"2023-05-10T04:20:54.978157+0000","last_undegraded":"2023-05-10T04:20:54.978157+0000","last_fullsized":"2023-05-10T04:20:54.978157+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:10:18.575649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.969074+0000","last_change":"2023-05-10T04:20:54.482889+0000","last_active":"2023-05-10T04:20:54.969074+0000","last_peered":"2023-05-10T04:20:54.969074+0000","last_clean":"2023-05-10T04:20:54.969074+0000","last_became_active":"2023-05-10T04:20:54.482570+0000","last_became_peered":"2023-05-10T04:20:54.482570+0000","last_unstale":"2023-05-10T04:20:54.969074+0000","last_undegraded":"2023-05-10T04:20:54.969074+0000","last_fullsized":"2023-05-10T04:20:54.969074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:52:31.298336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976722+0000","last_change":"2023-05-10T04:20:54.973673+0000","last_active":"2023-05-10T04:20:54.976722+0000","last_peered":"2023-05-10T04:20:54.976722+0000","last_clean":"2023-05-10T04:20:54.976722+0000","last_became_active":"2023-05-10T04:20:54.973411+0000","last_became_peered":"2023-05-10T04:20:54.973411+0000","last_unstale":"2023-05-10T04:20:54.976722+0000","last_undegraded":"2023-05-10T04:20:54.976722+0000","last_fullsized":"2023-05-10T04:20:54.976722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:42:31.126965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:53.448472+0000","last_change":"2023-05-10T04:20:53.448472+0000","last_active":"2023-05-10T04:20:53.448472+0000","last_peered":"2023-05-10T04:20:53.448472+0000","last_clean":"2023-05-10T04:20:53.448472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:53.448472+0000","last_undegraded":"2023-05-10T04:20:53.448472+0000","last_fullsized":"2023-05-10T04:20:53.448472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971240+0000","last_change":"2023-05-10T04:20:54.968348+0000","last_active":"2023-05-10T04:20:54.971240+0000","last_peered":"2023-05-10T04:20:54.971240+0000","last_clean":"2023-05-10T04:20:54.971240+0000","last_became_active":"2023-05-10T04:20:54.967871+0000","last_became_peered":"2023-05-10T04:20:54.967871+0000","last_unstale":"2023-05-10T04:20:54.971240+0000","last_undegraded":"2023-05-10T04:20:54.971240+0000","last_fullsized":"2023-05-10T04:20:54.971240+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:30:15.512791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971678+0000","last_change":"2023-05-10T04:20:54.476720+0000","last_active":"2023-05-10T04:20:54.971678+0000","last_peered":"2023-05-10T04:20:54.971678+0000","last_clean":"2023-05-10T04:20:54.971678+0000","last_became_active":"2023-05-10T04:20:54.476403+0000","last_became_peered":"2023-05-10T04:20:54.476403+0000","last_unstale":"2023-05-10T04:20:54.971678+0000","last_undegraded":"2023-05-10T04:20:54.971678+0000","last_fullsized":"2023-05-10T04:20:54.971678+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:37:16.405142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.966196+0000","last_change":"2023-05-10T04:20:54.961959+0000","last_active":"2023-05-10T04:20:54.966196+0000","last_peered":"2023-05-10T04:20:54.966196+0000","last_clean":"2023-05-10T04:20:54.966196+0000","last_became_active":"2023-05-10T04:20:54.961661+0000","last_became_peered":"2023-05-10T04:20:54.961661+0000","last_unstale":"2023-05-10T04:20:54.966196+0000","last_undegraded":"2023-05-10T04:20:54.966196+0000","last_fullsized":"2023-05-10T04:20:54.966196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:20:12.317448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957566+0000","last_change":"2023-05-10T04:20:54.476606+0000","last_active":"2023-05-10T04:20:54.957566+0000","last_peered":"2023-05-10T04:20:54.957566+0000","last_clean":"2023-05-10T04:20:54.957566+0000","last_became_active":"2023-05-10T04:20:54.476275+0000","last_became_peered":"2023-05-10T04:20:54.476275+0000","last_unstale":"2023-05-10T04:20:54.957566+0000","last_undegraded":"2023-05-10T04:20:54.957566+0000","last_fullsized":"2023-05-10T04:20:54.957566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:43:43.752659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976608+0000","last_change":"2023-05-10T04:20:54.973446+0000","last_active":"2023-05-10T04:20:54.976608+0000","last_peered":"2023-05-10T04:20:54.976608+0000","last_clean":"2023-05-10T04:20:54.976608+0000","last_became_active":"2023-05-10T04:20:54.973172+0000","last_became_peered":"2023-05-10T04:20:54.973172+0000","last_unstale":"2023-05-10T04:20:54.976608+0000","last_undegraded":"2023-05-10T04:20:54.976608+0000","last_fullsized":"2023-05-10T04:20:54.976608+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:21:16.337962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.948067+0000","last_change":"2023-05-10T04:20:54.479522+0000","last_active":"2023-05-10T04:20:54.948067+0000","last_peered":"2023-05-10T04:20:54.948067+0000","last_clean":"2023-05-10T04:20:54.948067+0000","last_became_active":"2023-05-10T04:20:54.478917+0000","last_became_peered":"2023-05-10T04:20:54.478917+0000","last_unstale":"2023-05-10T04:20:54.948067+0000","last_undegraded":"2023-05-10T04:20:54.948067+0000","last_fullsized":"2023-05-10T04:20:54.948067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:33:24.674196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970745+0000","last_change":"2023-05-10T04:20:54.968085+0000","last_active":"2023-05-10T04:20:54.970745+0000","last_peered":"2023-05-10T04:20:54.970745+0000","last_clean":"2023-05-10T04:20:54.970745+0000","last_became_active":"2023-05-10T04:20:54.967813+0000","last_became_peered":"2023-05-10T04:20:54.967813+0000","last_unstale":"2023-05-10T04:20:54.970745+0000","last_undegraded":"2023-05-10T04:20:54.970745+0000","last_fullsized":"2023-05-10T04:20:54.970745+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:28:16.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:53.448472+0000","last_change":"2023-05-10T04:20:53.448472+0000","last_active":"2023-05-10T04:20:53.448472+0000","last_peered":"2023-05-10T04:20:53.448472+0000","last_clean":"2023-05-10T04:20:53.448472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:53.448472+0000","last_undegraded":"2023-05-10T04:20:53.448472+0000","last_fullsized":"2023-05-10T04:20:53.448472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.966468+0000","last_change":"2023-05-10T04:20:54.962439+0000","last_active":"2023-05-10T04:20:54.966468+0000","last_peered":"2023-05-10T04:20:54.966468+0000","last_clean":"2023-05-10T04:20:54.966468+0000","last_became_active":"2023-05-10T04:20:54.962167+0000","last_became_peered":"2023-05-10T04:20:54.962167+0000","last_unstale":"2023-05-10T04:20:54.966468+0000","last_undegraded":"2023-05-10T04:20:54.966468+0000","last_fullsized":"2023-05-10T04:20:54.966468+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:48:48.614594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976043+0000","last_change":"2023-05-10T04:20:54.484031+0000","last_active":"2023-05-10T04:20:54.976043+0000","last_peered":"2023-05-10T04:20:54.976043+0000","last_clean":"2023-05-10T04:20:54.976043+0000","last_became_active":"2023-05-10T04:20:54.483699+0000","last_became_peered":"2023-05-10T04:20:54.483699+0000","last_unstale":"2023-05-10T04:20:54.976043+0000","last_undegraded":"2023-05-10T04:20:54.976043+0000","last_fullsized":"2023-05-10T04:20:54.976043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:03:15.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971266+0000","last_change":"2023-05-10T04:20:54.968370+0000","last_active":"2023-05-10T04:20:54.971266+0000","last_peered":"2023-05-10T04:20:54.971266+0000","last_clean":"2023-05-10T04:20:54.971266+0000","last_became_active":"2023-05-10T04:20:54.968073+0000","last_became_peered":"2023-05-10T04:20:54.968073+0000","last_unstale":"2023-05-10T04:20:54.971266+0000","last_undegraded":"2023-05-10T04:20:54.971266+0000","last_fullsized":"2023-05-10T04:20:54.971266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:32:33.997995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967972+0000","last_change":"2023-05-10T04:20:54.482027+0000","last_active":"2023-05-10T04:20:54.967972+0000","last_peered":"2023-05-10T04:20:54.967972+0000","last_clean":"2023-05-10T04:20:54.967972+0000","last_became_active":"2023-05-10T04:20:54.479355+0000","last_became_peered":"2023-05-10T04:20:54.479355+0000","last_unstale":"2023-05-10T04:20:54.967972+0000","last_undegraded":"2023-05-10T04:20:54.967972+0000","last_fullsized":"2023-05-10T04:20:54.967972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:02:08.771960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.973926+0000","last_change":"2023-05-10T04:20:54.962724+0000","last_active":"2023-05-10T04:20:54.973926+0000","last_peered":"2023-05-10T04:20:54.973926+0000","last_clean":"2023-05-10T04:20:54.973926+0000","last_became_active":"2023-05-10T04:20:54.962181+0000","last_became_peered":"2023-05-10T04:20:54.962181+0000","last_unstale":"2023-05-10T04:20:54.973926+0000","last_undegraded":"2023-05-10T04:20:54.973926+0000","last_fullsized":"2023-05-10T04:20:54.973926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:33:25.677135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.972007+0000","last_change":"2023-05-10T04:20:54.480645+0000","last_active":"2023-05-10T04:20:54.972007+0000","last_peered":"2023-05-10T04:20:54.972007+0000","last_clean":"2023-05-10T04:20:54.972007+0000","last_became_active":"2023-05-10T04:20:54.480386+0000","last_became_peered":"2023-05-10T04:20:54.480386+0000","last_unstale":"2023-05-10T04:20:54.972007+0000","last_undegraded":"2023-05-10T04:20:54.972007+0000","last_fullsized":"2023-05-10T04:20:54.972007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:41:28.014383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971080+0000","last_change":"2023-05-10T04:20:54.967983+0000","last_active":"2023-05-10T04:20:54.971080+0000","last_peered":"2023-05-10T04:20:54.971080+0000","last_clean":"2023-05-10T04:20:54.971080+0000","last_became_active":"2023-05-10T04:20:54.967677+0000","last_became_peered":"2023-05-10T04:20:54.967677+0000","last_unstale":"2023-05-10T04:20:54.971080+0000","last_undegraded":"2023-05-10T04:20:54.971080+0000","last_fullsized":"2023-05-10T04:20:54.971080+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:10:18.575649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.947920+0000","last_change":"2023-05-10T04:20:54.479959+0000","last_active":"2023-05-10T04:20:54.947920+0000","last_peered":"2023-05-10T04:20:54.947920+0000","last_clean":"2023-05-10T04:20:54.947920+0000","last_became_active":"2023-05-10T04:20:54.479009+0000","last_became_peered":"2023-05-10T04:20:54.479009+0000","last_unstale":"2023-05-10T04:20:54.947920+0000","last_undegraded":"2023-05-10T04:20:54.947920+0000","last_fullsized":"2023-05-10T04:20:54.947920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:52:31.298336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:54.451412+0000","last_change":"2023-05-10T04:20:54.451412+0000","last_active":"2023-05-10T04:20:54.451412+0000","last_peered":"2023-05-10T04:20:54.451412+0000","last_clean":"2023-05-10T04:20:54.451412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:54.451412+0000","last_undegraded":"2023-05-10T04:20:54.451412+0000","last_fullsized":"2023-05-10T04:20:54.451412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:53.448472+0000","last_change":"2023-05-10T04:20:53.448472+0000","last_active":"2023-05-10T04:20:53.448472+0000","last_peered":"2023-05-10T04:20:53.448472+0000","last_clean":"2023-05-10T04:20:53.448472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:53.448472+0000","last_undegraded":"2023-05-10T04:20:53.448472+0000","last_fullsized":"2023-05-10T04:20:53.448472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.968359+0000","last_change":"2023-05-10T04:20:54.960386+0000","last_active":"2023-05-10T04:20:54.968359+0000","last_peered":"2023-05-10T04:20:54.968359+0000","last_clean":"2023-05-10T04:20:54.968359+0000","last_became_active":"2023-05-10T04:20:54.960118+0000","last_became_peered":"2023-05-10T04:20:54.960118+0000","last_unstale":"2023-05-10T04:20:54.968359+0000","last_undegraded":"2023-05-10T04:20:54.968359+0000","last_fullsized":"2023-05-10T04:20:54.968359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:47:31.167944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957714+0000","last_change":"2023-05-10T04:20:54.478376+0000","last_active":"2023-05-10T04:20:54.957714+0000","last_peered":"2023-05-10T04:20:54.957714+0000","last_clean":"2023-05-10T04:20:54.957714+0000","last_became_active":"2023-05-10T04:20:54.477989+0000","last_became_peered":"2023-05-10T04:20:54.477989+0000","last_unstale":"2023-05-10T04:20:54.957714+0000","last_undegraded":"2023-05-10T04:20:54.957714+0000","last_fullsized":"2023-05-10T04:20:54.957714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:47:30.165005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979273+0000","last_change":"2023-05-10T04:20:54.976623+0000","last_active":"2023-05-10T04:20:54.979273+0000","last_peered":"2023-05-10T04:20:54.979273+0000","last_clean":"2023-05-10T04:20:54.979273+0000","last_became_active":"2023-05-10T04:20:54.970516+0000","last_became_peered":"2023-05-10T04:20:54.970516+0000","last_unstale":"2023-05-10T04:20:54.979273+0000","last_undegraded":"2023-05-10T04:20:54.979273+0000","last_fullsized":"2023-05-10T04:20:54.979273+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:41:29.017322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:53.448472+0000","last_change":"2023-05-10T04:20:53.448472+0000","last_active":"2023-05-10T04:20:53.448472+0000","last_peered":"2023-05-10T04:20:53.448472+0000","last_clean":"2023-05-10T04:20:53.448472+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:53.448472+0000","last_undegraded":"2023-05-10T04:20:53.448472+0000","last_fullsized":"2023-05-10T04:20:53.448472+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978129+0000","last_change":"2023-05-10T04:20:54.971102+0000","last_active":"2023-05-10T04:20:54.978129+0000","last_peered":"2023-05-10T04:20:54.978129+0000","last_clean":"2023-05-10T04:20:54.978129+0000","last_became_active":"2023-05-10T04:20:54.970820+0000","last_became_peered":"2023-05-10T04:20:54.970820+0000","last_unstale":"2023-05-10T04:20:54.978129+0000","last_undegraded":"2023-05-10T04:20:54.978129+0000","last_fullsized":"2023-05-10T04:20:54.978129+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:00:36.690080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.942651+0000","last_change":"2023-05-10T04:20:54.468090+0000","last_active":"2023-05-10T04:20:54.942651+0000","last_peered":"2023-05-10T04:20:54.942651+0000","last_clean":"2023-05-10T04:20:54.942651+0000","last_became_active":"2023-05-10T04:20:54.467717+0000","last_became_peered":"2023-05-10T04:20:54.467717+0000","last_unstale":"2023-05-10T04:20:54.942651+0000","last_undegraded":"2023-05-10T04:20:54.942651+0000","last_fullsized":"2023-05-10T04:20:54.942651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:07.619870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.961880+0000","last_change":"2023-05-10T04:20:54.958648+0000","last_active":"2023-05-10T04:20:54.961880+0000","last_peered":"2023-05-10T04:20:54.961880+0000","last_clean":"2023-05-10T04:20:54.961880+0000","last_became_active":"2023-05-10T04:20:54.958393+0000","last_became_peered":"2023-05-10T04:20:54.958393+0000","last_unstale":"2023-05-10T04:20:54.961880+0000","last_undegraded":"2023-05-10T04:20:54.961880+0000","last_fullsized":"2023-05-10T04:20:54.961880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:11:10.428062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.946482+0000","last_change":"2023-05-10T04:20:54.474264+0000","last_active":"2023-05-10T04:20:54.946482+0000","last_peered":"2023-05-10T04:20:54.946482+0000","last_clean":"2023-05-10T04:20:54.946482+0000","last_became_active":"2023-05-10T04:20:54.473942+0000","last_became_peered":"2023-05-10T04:20:54.473942+0000","last_unstale":"2023-05-10T04:20:54.946482+0000","last_undegraded":"2023-05-10T04:20:54.946482+0000","last_fullsized":"2023-05-10T04:20:54.946482+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:23:21.887450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.958089+0000","last_change":"2023-05-10T04:19:04.607342+0000","last_active":"2023-05-10T04:20:54.958089+0000","last_peered":"2023-05-10T04:20:54.958089+0000","last_clean":"2023-05-10T04:20:54.958089+0000","last_became_active":"2023-05-10T04:19:04.606956+0000","last_became_peered":"2023-05-10T04:19:04.606956+0000","last_unstale":"2023-05-10T04:20:54.958089+0000","last_undegraded":"2023-05-10T04:20:54.958089+0000","last_fullsized":"2023-05-10T04:20:54.958089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:18:12.655852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.956406+0000","last_change":"2023-05-10T04:20:54.953725+0000","last_active":"2023-05-10T04:20:54.956406+0000","last_peered":"2023-05-10T04:20:54.956406+0000","last_clean":"2023-05-10T04:20:54.956406+0000","last_became_active":"2023-05-10T04:20:54.953461+0000","last_became_peered":"2023-05-10T04:20:54.953461+0000","last_unstale":"2023-05-10T04:20:54.956406+0000","last_undegraded":"2023-05-10T04:20:54.956406+0000","last_fullsized":"2023-05-10T04:20:54.956406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:37:26.400833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.960675+0000","last_change":"2023-05-10T04:20:54.483341+0000","last_active":"2023-05-10T04:20:54.960675+0000","last_peered":"2023-05-10T04:20:54.960675+0000","last_clean":"2023-05-10T04:20:54.960675+0000","last_became_active":"2023-05-10T04:20:54.482875+0000","last_became_peered":"2023-05-10T04:20:54.482875+0000","last_unstale":"2023-05-10T04:20:54.960675+0000","last_undegraded":"2023-05-10T04:20:54.960675+0000","last_fullsized":"2023-05-10T04:20:54.960675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:22.228486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.943632+0000","last_change":"2023-05-10T04:19:04.607370+0000","last_active":"2023-05-10T04:20:54.943632+0000","last_peered":"2023-05-10T04:20:54.943632+0000","last_clean":"2023-05-10T04:20:54.943632+0000","last_became_active":"2023-05-10T04:19:04.606959+0000","last_became_peered":"2023-05-10T04:19:04.606959+0000","last_unstale":"2023-05-10T04:20:54.943632+0000","last_undegraded":"2023-05-10T04:20:54.943632+0000","last_fullsized":"2023-05-10T04:20:54.943632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:56:22.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:54.451412+0000","last_change":"2023-05-10T04:20:54.451412+0000","last_active":"2023-05-10T04:20:54.451412+0000","last_peered":"2023-05-10T04:20:54.451412+0000","last_clean":"2023-05-10T04:20:54.451412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:54.451412+0000","last_undegraded":"2023-05-10T04:20:54.451412+0000","last_fullsized":"2023-05-10T04:20:54.451412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957841+0000","last_change":"2023-05-10T04:20:54.478279+0000","last_active":"2023-05-10T04:20:54.957841+0000","last_peered":"2023-05-10T04:20:54.957841+0000","last_clean":"2023-05-10T04:20:54.957841+0000","last_became_active":"2023-05-10T04:20:54.477878+0000","last_became_peered":"2023-05-10T04:20:54.477878+0000","last_unstale":"2023-05-10T04:20:54.957841+0000","last_undegraded":"2023-05-10T04:20:54.957841+0000","last_fullsized":"2023-05-10T04:20:54.957841+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:28:15.854356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.946855+0000","last_change":"2023-05-10T04:19:04.443832+0000","last_active":"2023-05-10T04:20:54.946855+0000","last_peered":"2023-05-10T04:20:54.946855+0000","last_clean":"2023-05-10T04:20:54.946855+0000","last_became_active":"2023-05-10T04:19:04.443487+0000","last_became_peered":"2023-05-10T04:19:04.443487+0000","last_unstale":"2023-05-10T04:20:54.946855+0000","last_undegraded":"2023-05-10T04:20:54.946855+0000","last_fullsized":"2023-05-10T04:20:54.946855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:16:36.949507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979038+0000","last_change":"2023-05-10T04:20:54.975420+0000","last_active":"2023-05-10T04:20:54.979038+0000","last_peered":"2023-05-10T04:20:54.979038+0000","last_clean":"2023-05-10T04:20:54.979038+0000","last_became_active":"2023-05-10T04:20:54.972308+0000","last_became_peered":"2023-05-10T04:20:54.972308+0000","last_unstale":"2023-05-10T04:20:54.979038+0000","last_undegraded":"2023-05-10T04:20:54.979038+0000","last_fullsized":"2023-05-10T04:20:54.979038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:52:13.147526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971115+0000","last_change":"2023-05-10T04:20:54.477385+0000","last_active":"2023-05-10T04:20:54.971115+0000","last_peered":"2023-05-10T04:20:54.971115+0000","last_clean":"2023-05-10T04:20:54.971115+0000","last_became_active":"2023-05-10T04:20:54.477126+0000","last_became_peered":"2023-05-10T04:20:54.477126+0000","last_unstale":"2023-05-10T04:20:54.971115+0000","last_undegraded":"2023-05-10T04:20:54.971115+0000","last_fullsized":"2023-05-10T04:20:54.971115+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:54.407052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.942885+0000","last_change":"2023-05-10T04:19:04.443331+0000","last_active":"2023-05-10T04:20:54.942885+0000","last_peered":"2023-05-10T04:20:54.942885+0000","last_clean":"2023-05-10T04:20:54.942885+0000","last_became_active":"2023-05-10T04:19:04.443060+0000","last_became_peered":"2023-05-10T04:19:04.443060+0000","last_unstale":"2023-05-10T04:20:54.942885+0000","last_undegraded":"2023-05-10T04:20:54.942885+0000","last_fullsized":"2023-05-10T04:20:54.942885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:11:31.397341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.949982+0000","last_change":"2023-05-10T04:18:57.192195+0000","last_active":"2023-05-10T04:20:54.949982+0000","last_peered":"2023-05-10T04:20:54.949982+0000","last_clean":"2023-05-10T04:20:54.949982+0000","last_became_active":"2023-05-10T04:18:57.191298+0000","last_became_peered":"2023-05-10T04:18:57.191298+0000","last_unstale":"2023-05-10T04:20:54.949982+0000","last_undegraded":"2023-05-10T04:20:54.949982+0000","last_fullsized":"2023-05-10T04:20:54.949982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_clean_scrub_stamp":"2023-05-10T04:18:56.172967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:32:17.333292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979753+0000","last_change":"2023-05-10T04:20:54.976398+0000","last_active":"2023-05-10T04:20:54.979753+0000","last_peered":"2023-05-10T04:20:54.979753+0000","last_clean":"2023-05-10T04:20:54.979753+0000","last_became_active":"2023-05-10T04:20:54.976115+0000","last_became_peered":"2023-05-10T04:20:54.976115+0000","last_unstale":"2023-05-10T04:20:54.979753+0000","last_undegraded":"2023-05-10T04:20:54.979753+0000","last_fullsized":"2023-05-10T04:20:54.979753+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:50:08.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.947643+0000","last_change":"2023-05-10T04:20:54.477576+0000","last_active":"2023-05-10T04:20:54.947643+0000","last_peered":"2023-05-10T04:20:54.947643+0000","last_clean":"2023-05-10T04:20:54.947643+0000","last_became_active":"2023-05-10T04:20:54.477327+0000","last_became_peered":"2023-05-10T04:20:54.477327+0000","last_unstale":"2023-05-10T04:20:54.947643+0000","last_undegraded":"2023-05-10T04:20:54.947643+0000","last_fullsized":"2023-05-10T04:20:54.947643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:54:30.366803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.942737+0000","last_change":"2023-05-10T04:19:04.443785+0000","last_active":"2023-05-10T04:20:54.942737+0000","last_peered":"2023-05-10T04:20:54.942737+0000","last_clean":"2023-05-10T04:20:54.942737+0000","last_became_active":"2023-05-10T04:19:04.443499+0000","last_became_peered":"2023-05-10T04:19:04.443499+0000","last_unstale":"2023-05-10T04:20:54.942737+0000","last_undegraded":"2023-05-10T04:20:54.942737+0000","last_fullsized":"2023-05-10T04:20:54.942737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:14:09.836730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970878+0000","last_change":"2023-05-10T04:20:54.967046+0000","last_active":"2023-05-10T04:20:54.970878+0000","last_peered":"2023-05-10T04:20:54.970878+0000","last_clean":"2023-05-10T04:20:54.970878+0000","last_became_active":"2023-05-10T04:20:54.966787+0000","last_became_peered":"2023-05-10T04:20:54.966787+0000","last_unstale":"2023-05-10T04:20:54.970878+0000","last_undegraded":"2023-05-10T04:20:54.970878+0000","last_fullsized":"2023-05-10T04:20:54.970878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:07:52.098991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.948188+0000","last_change":"2023-05-10T04:20:54.474021+0000","last_active":"2023-05-10T04:20:54.948188+0000","last_peered":"2023-05-10T04:20:54.948188+0000","last_clean":"2023-05-10T04:20:54.948188+0000","last_became_active":"2023-05-10T04:20:54.473724+0000","last_became_peered":"2023-05-10T04:20:54.473724+0000","last_unstale":"2023-05-10T04:20:54.948188+0000","last_undegraded":"2023-05-10T04:20:54.948188+0000","last_fullsized":"2023-05-10T04:20:54.948188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:29:52.623321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.944085+0000","last_change":"2023-05-10T04:19:04.442968+0000","last_active":"2023-05-10T04:20:54.944085+0000","last_peered":"2023-05-10T04:20:54.944085+0000","last_clean":"2023-05-10T04:20:54.944085+0000","last_became_active":"2023-05-10T04:19:04.442633+0000","last_became_peered":"2023-05-10T04:19:04.442633+0000","last_unstale":"2023-05-10T04:20:54.944085+0000","last_undegraded":"2023-05-10T04:20:54.944085+0000","last_fullsized":"2023-05-10T04:20:54.944085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:45:40.910809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978373+0000","last_change":"2023-05-10T04:20:54.972257+0000","last_active":"2023-05-10T04:20:54.978373+0000","last_peered":"2023-05-10T04:20:54.978373+0000","last_clean":"2023-05-10T04:20:54.978373+0000","last_became_active":"2023-05-10T04:20:54.971992+0000","last_became_peered":"2023-05-10T04:20:54.971992+0000","last_unstale":"2023-05-10T04:20:54.978373+0000","last_undegraded":"2023-05-10T04:20:54.978373+0000","last_fullsized":"2023-05-10T04:20:54.978373+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:02:09.774899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.943571+0000","last_change":"2023-05-10T04:20:54.468285+0000","last_active":"2023-05-10T04:20:54.943571+0000","last_peered":"2023-05-10T04:20:54.943571+0000","last_clean":"2023-05-10T04:20:54.943571+0000","last_became_active":"2023-05-10T04:20:54.467879+0000","last_became_peered":"2023-05-10T04:20:54.467879+0000","last_unstale":"2023-05-10T04:20:54.943571+0000","last_undegraded":"2023-05-10T04:20:54.943571+0000","last_fullsized":"2023-05-10T04:20:54.943571+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:27:55.497922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-05-10T04:20:47.078206+0000","last_change":"2023-05-10T04:19:04.440282+0000","last_active":"2023-05-10T04:20:47.078206+0000","last_peered":"2023-05-10T04:20:47.078206+0000","last_clean":"2023-05-10T04:20:47.078206+0000","last_became_active":"2023-05-10T04:19:04.439945+0000","last_became_peered":"2023-05-10T04:19:04.439945+0000","last_unstale":"2023-05-10T04:20:47.078206+0000","last_undegraded":"2023-05-10T04:20:47.078206+0000","last_fullsized":"2023-05-10T04:20:47.078206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:20:06.607332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-10T04:20:54.451412+0000","last_change":"2023-05-10T04:20:54.451412+0000","last_active":"2023-05-10T04:20:54.451412+0000","last_peered":"2023-05-10T04:20:54.451412+0000","last_clean":"2023-05-10T04:20:54.451412+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-10T04:20:54.451412+0000","last_undegraded":"2023-05-10T04:20:54.451412+0000","last_fullsized":"2023-05-10T04:20:54.451412+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957698+0000","last_change":"2023-05-10T04:20:54.482625+0000","last_active":"2023-05-10T04:20:54.957698+0000","last_peered":"2023-05-10T04:20:54.957698+0000","last_clean":"2023-05-10T04:20:54.957698+0000","last_became_active":"2023-05-10T04:20:54.482356+0000","last_became_peered":"2023-05-10T04:20:54.482356+0000","last_unstale":"2023-05-10T04:20:54.957698+0000","last_undegraded":"2023-05-10T04:20:54.957698+0000","last_fullsized":"2023-05-10T04:20:54.957698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:51:11.499364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.944015+0000","last_change":"2023-05-10T04:19:04.444610+0000","last_active":"2023-05-10T04:20:54.944015+0000","last_peered":"2023-05-10T04:20:54.944015+0000","last_clean":"2023-05-10T04:20:54.944015+0000","last_became_active":"2023-05-10T04:19:04.444273+0000","last_became_peered":"2023-05-10T04:19:04.444273+0000","last_unstale":"2023-05-10T04:20:54.944015+0000","last_undegraded":"2023-05-10T04:20:54.944015+0000","last_fullsized":"2023-05-10T04:20:54.944015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:54:05.497607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":114,"acting":114,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":798,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22,"ondisk_log_size":22,"up":52,"acting":52,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":16,"seq":68719476763,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8488,"kb_used_data":416,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363352,"statfs":{"total":96636764160,"available":96628072448,"internally_reserved":0,"allocated":425984,"data_stored":180602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.88},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.89800000000000002}]},{"osd":1,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.73799999999999999}]},{"osd":2,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.83099999999999996}]},{"osd":3,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.75700000000000001}]},{"osd":5,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71499999999999997}]},{"osd":6,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.84099999999999997}]}]},{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8448,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363392,"statfs":{"total":96636764160,"available":96628113408,"internally_reserved":0,"allocated":450560,"data_stored":194040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.51400000000000001}]},{"osd":1,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.4729999999999999,"5min":4.4729999999999999,"15min":4.4729999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.54800000000000004}]},{"osd":3,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.63}]},{"osd":4,"last update":"Wed May 10 04:20:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9604,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362236,"statfs":{"total":96636764160,"available":96626929664,"internally_reserved":0,"allocated":1044480,"data_stored":784408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.314}]},{"osd":2,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.503},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.51000000000000001}]},{"osd":4,"last update":"Wed May 10 04:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.629},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.4459999999999997,"5min":4.4459999999999997,"15min":4.4459999999999997},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.621},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.71299999999999997}]},{"osd":7,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.65500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":438272,"data_stored":187092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":0.437},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.3070000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.376}]},{"osd":2,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.1070000000000002,"5min":4.1070000000000002,"15min":4.1070000000000002},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Wed May 10 04:19:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.6190000000000002,"5min":3.6190000000000002,"15min":3.6190000000000002},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.78400000000000003}]},{"osd":7,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8656,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363184,"statfs":{"total":96636764160,"available":96627900416,"internally_reserved":0,"allocated":466944,"data_stored":201578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.8719999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.5}]},{"osd":3,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.441}]},{"osd":4,"last update":"Wed May 10 04:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.627},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.4900000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.62},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.5529999999999999,"5min":4.5529999999999999,"15min":4.5529999999999999},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8640,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363200,"statfs":{"total":96636764160,"available":96627916800,"internally_reserved":0,"allocated":450560,"data_stored":194040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed May 10 04:20:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.873}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9528,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362312,"statfs":{"total":96636764160,"available":96627007488,"internally_reserved":0,"allocated":1032192,"data_stored":777460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58499999999999996}]},{"osd":1,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.754}]},{"osd":2,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72099999999999997}]},{"osd":4,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.74199999999999999}]},{"osd":7,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8512,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363328,"statfs":{"total":96636764160,"available":96628047872,"internally_reserved":0,"allocated":450560,"data_stored":194040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.77100000000000002}]},{"osd":2,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.627},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67300000000000004}]},{"osd":4,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.81899999999999995}]},{"osd":5,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.752},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.85099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T04:20:59.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-10T04:20:59.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.495+0000 7faaabdff700 1 Processor -- start 2023-05-10T04:20:59.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.495+0000 7faaabdff700 1 -- start start 2023-05-10T04:20:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.496+0000 7faaabdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40cfbf0 0x7faaa41608f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.496+0000 7faaabdff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faaa40d1100 0x7faaa40d1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.496+0000 7faaabdff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaa40d0020 con 0x7faaa40b87a0 2023-05-10T04:20:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.496+0000 7faaabdff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaa40d02d0 con 0x7faaa40d1100 2023-05-10T04:20:59.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.496+0000 7faaabdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa40d0cb0 con 0x7faaa40cfbf0 2023-05-10T04:20:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.496+0000 7faaa939a700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40cfbf0 0x7faaa41608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.496+0000 7faaa9b9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7faaa40b87a0 0x7faaa41601e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:54002/0 (socket says 172.21.15.132:54002) 2023-05-10T04:20:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.497+0000 7faaaa39c700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7faaa40d1100 0x7faaa40d1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.497+0000 7faaa9b9b700 1 -- 172.21.15.132:0/3459183433 learned_addr learned my addr 172.21.15.132:0/3459183433 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:59.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.497+0000 7faaaa39c700 1 -- 172.21.15.132:0/3459183433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40cfbf0 msgr2=0x7faaa41608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.497+0000 7faaaa39c700 1 --2- 172.21.15.132:0/3459183433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40cfbf0 0x7faaa41608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.497+0000 7faaaa39c700 1 -- 172.21.15.132:0/3459183433 >> v1:172.21.15.154:6789/0 conn(0x7faaa40b87a0 legacy=0x7faaa41601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.497+0000 7faaaa39c700 1 -- 172.21.15.132:0/3459183433 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa40cdc60 con 0x7faaa40d1100 2023-05-10T04:20:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.497+0000 7faaa939a700 1 --2- 172.21.15.132:0/3459183433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40cfbf0 0x7faaa41608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.497+0000 7faaaa39c700 1 --2- 172.21.15.132:0/3459183433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40d1100 0x7faaa40d1580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009d90 tx=0x7faa9c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d858e51f06f4865e server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaa8b99700 1 -- 172.21.15.132:0/3459183433 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c00e070 con 0x7faaa40d1100 2023-05-10T04:20:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaa8b99700 1 -- 172.21.15.132:0/3459183433 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c003a20 con 0x7faaa40d1100 2023-05-10T04:20:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaa8b99700 1 -- 172.21.15.132:0/3459183433 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c003dd0 con 0x7faaa40d1100 2023-05-10T04:20:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaabdff700 1 -- 172.21.15.132:0/3459183433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40d1100 msgr2=0x7faaa40d1580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaabdff700 1 --2- 172.21.15.132:0/3459183433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40d1100 0x7faaa40d1580 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa9c009d90 tx=0x7faa9c00b330 comp rx=0 tx=0).stop 2023-05-10T04:20:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaabdff700 1 -- 172.21.15.132:0/3459183433 shutdown_connections 2023-05-10T04:20:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaabdff700 1 --2- 172.21.15.132:0/3459183433 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40d1100 0x7faaa40d1580 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaabdff700 1 --2- 172.21.15.132:0/3459183433 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40cfbf0 0x7faaa41608f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaabdff700 1 -- 172.21.15.132:0/3459183433 >> 172.21.15.132:0/3459183433 conn(0x7faaa4071b10 msgr2=0x7faaa4071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:59.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaabdff700 1 -- 172.21.15.132:0/3459183433 shutdown_connections 2023-05-10T04:20:59.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.498+0000 7faaabdff700 1 -- 172.21.15.132:0/3459183433 wait complete. 2023-05-10T04:20:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.500+0000 7faaabdff700 1 Processor -- start 2023-05-10T04:20:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.500+0000 7faaabdff700 1 -- start start 2023-05-10T04:20:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaabdff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaa40b87a0 0x7faaa414d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaabdff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40cfbf0 0x7faaa415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaabdff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40d1100 0x7faaa40ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaabdff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa414d8c0 con 0x7faaa40b87a0 2023-05-10T04:20:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaabdff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415f300 con 0x7faaa40cfbf0 2023-05-10T04:20:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaabdff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaa415e6f0 con 0x7faaa40d1100 2023-05-10T04:20:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaa9b9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaa40b87a0 0x7faaa414d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaa9b9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaa40b87a0 0x7faaa414d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42704/0 (socket says 172.21.15.132:42704) 2023-05-10T04:20:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaa9b9b700 1 -- 172.21.15.132:0/4107009848 learned_addr learned my addr 172.21.15.132:0/4107009848 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaaa39c700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40d1100 0x7faaa40ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.501+0000 7faaa939a700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40cfbf0 0x7faaa415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faaa9b9b700 1 -- 172.21.15.132:0/4107009848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40d1100 msgr2=0x7faaa40ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faaa9b9b700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40d1100 0x7faaa40ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faaa9b9b700 1 -- 172.21.15.132:0/4107009848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40cfbf0 msgr2=0x7faaa415dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faaa9b9b700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40cfbf0 0x7faaa415dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faaa9b9b700 1 -- 172.21.15.132:0/4107009848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa940094a0 con 0x7faaa40b87a0 2023-05-10T04:20:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faaa9b9b700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaa40b87a0 0x7faaa414d380 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7faaa000c780 tx=0x7faaa000ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faa9a7fc700 1 -- 172.21.15.132:0/4107009848 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa0004c80 con 0x7faaa40b87a0 2023-05-10T04:20:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faa9a7fc700 1 -- 172.21.15.132:0/4107009848 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa0004de0 con 0x7faaa40b87a0 2023-05-10T04:20:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faa9a7fc700 1 -- 172.21.15.132:0/4107009848 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa00072f0 con 0x7faaa40b87a0 2023-05-10T04:20:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9c009a70 con 0x7faaa40b87a0 2023-05-10T04:20:59.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.502+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaa40cd980 con 0x7faaa40b87a0 2023-05-10T04:20:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.503+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaa40cd6a0 con 0x7faaa40b87a0 2023-05-10T04:20:59.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.504+0000 7faa9a7fc700 1 -- 172.21.15.132:0/4107009848 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faaa0007450 con 0x7faaa40b87a0 2023-05-10T04:20:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.505+0000 7faa9a7fc700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faa8806ace0 0x7faa8806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.505+0000 7faa9a7fc700 1 -- 172.21.15.132:0/4107009848 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7faaa00892a0 con 0x7faaa40b87a0 2023-05-10T04:20:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.506+0000 7faaa939a700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faa8806ace0 0x7faa8806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.506+0000 7faaa939a700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faa8806ace0 0x7faa8806d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faaa40cd0a0 tx=0x7faa94009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.509+0000 7faa9a7fc700 1 -- 172.21.15.132:0/4107009848 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7faaa0054210 con 0x7faaa40b87a0 2023-05-10T04:20:59.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.698+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 --> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faaa406d2c0 con 0x7faa8806ace0 2023-05-10T04:20:59.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.707+0000 7faa9a7fc700 1 -- 172.21.15.132:0/4107009848 <== mgr.4100 v2:172.21.15.132:6832/1621031024 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+311132 (secure 0 0 0) 0x7faaa406d2c0 con 0x7faa8806ace0 2023-05-10T04:20:59.712 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:20:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.711+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faa8806ace0 msgr2=0x7faa8806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.711+0000 7faaabdff700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faa8806ace0 0x7faa8806d190 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faaa40cd0a0 tx=0x7faa94009210 comp rx=0 tx=0).stop 2023-05-10T04:20:59.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.711+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaa40b87a0 msgr2=0x7faaa414d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.711+0000 7faaabdff700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaa40b87a0 0x7faaa414d380 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7faaa000c780 tx=0x7faaa000ca90 comp rx=0 tx=0).stop 2023-05-10T04:20:59.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.711+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 shutdown_connections 2023-05-10T04:20:59.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.712+0000 7faaabdff700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7faa8806ace0 0x7faa8806d190 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.712+0000 7faaabdff700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7faaa40d1100 0x7faaa40ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.712+0000 7faaabdff700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaa40b87a0 0x7faaa414d380 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.712+0000 7faaabdff700 1 --2- 172.21.15.132:0/4107009848 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7faaa40cfbf0 0x7faaa415dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.712+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 >> 172.21.15.132:0/4107009848 conn(0x7faaa4071b10 msgr2=0x7faaa40cf100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:59.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.712+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 shutdown_connections 2023-05-10T04:20:59.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.712+0000 7faaabdff700 1 -- 172.21.15.132:0/4107009848 wait complete. 2023-05-10T04:20:59.716 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-05-10T04:20:59.731 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":96,"stamp":"2023-05-10T04:20:59.346146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70636,"kb_used_data":4716,"kb_used_omap":0,"kb_used_meta":65856,"kb_avail":754904084,"statfs":{"total":773094113280,"available":773021782016,"internally_reserved":0,"allocated":4829184,"data_stored":2742775,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":67436544},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.894283"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967349+0000","last_change":"2023-05-10T04:20:54.965493+0000","last_active":"2023-05-10T04:20:54.967349+0000","last_peered":"2023-05-10T04:20:54.967349+0000","last_clean":"2023-05-10T04:20:54.967349+0000","last_became_active":"2023-05-10T04:20:54.965124+0000","last_became_peered":"2023-05-10T04:20:54.965124+0000","last_unstale":"2023-05-10T04:20:54.967349+0000","last_undegraded":"2023-05-10T04:20:54.967349+0000","last_fullsized":"2023-05-10T04:20:54.967349+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:04:43.432203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976999+0000","last_change":"2023-05-10T04:20:54.970379+0000","last_active":"2023-05-10T04:20:54.976999+0000","last_peered":"2023-05-10T04:20:54.976999+0000","last_clean":"2023-05-10T04:20:54.976999+0000","last_became_active":"2023-05-10T04:20:54.970116+0000","last_became_peered":"2023-05-10T04:20:54.970116+0000","last_unstale":"2023-05-10T04:20:54.976999+0000","last_undegraded":"2023-05-10T04:20:54.976999+0000","last_fullsized":"2023-05-10T04:20:54.976999+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:49:39.818147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971268+0000","last_change":"2023-05-10T04:20:54.968515+0000","last_active":"2023-05-10T04:20:54.971268+0000","last_peered":"2023-05-10T04:20:54.971268+0000","last_clean":"2023-05-10T04:20:54.971268+0000","last_became_active":"2023-05-10T04:20:54.968257+0000","last_became_peered":"2023-05-10T04:20:54.968257+0000","last_unstale":"2023-05-10T04:20:54.971268+0000","last_undegraded":"2023-05-10T04:20:54.971268+0000","last_fullsized":"2023-05-10T04:20:54.971268+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:29:33.378827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976248+0000","last_change":"2023-05-10T04:20:54.966825+0000","last_active":"2023-05-10T04:20:54.976248+0000","last_peered":"2023-05-10T04:20:54.976248+0000","last_clean":"2023-05-10T04:20:54.976248+0000","last_became_active":"2023-05-10T04:20:54.966361+0000","last_became_peered":"2023-05-10T04:20:54.966361+0000","last_unstale":"2023-05-10T04:20:54.976248+0000","last_undegraded":"2023-05-10T04:20:54.976248+0000","last_fullsized":"2023-05-10T04:20:54.976248+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:36:14.700306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.973562+0000","last_change":"2023-05-10T04:20:54.970135+0000","last_active":"2023-05-10T04:20:54.973562+0000","last_peered":"2023-05-10T04:20:54.973562+0000","last_clean":"2023-05-10T04:20:54.973562+0000","last_became_active":"2023-05-10T04:20:54.969882+0000","last_became_peered":"2023-05-10T04:20:54.969882+0000","last_unstale":"2023-05-10T04:20:54.973562+0000","last_undegraded":"2023-05-10T04:20:54.973562+0000","last_fullsized":"2023-05-10T04:20:54.973562+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:07:55.126771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.969589+0000","last_change":"2023-05-10T04:20:54.964982+0000","last_active":"2023-05-10T04:20:54.969589+0000","last_peered":"2023-05-10T04:20:54.969589+0000","last_clean":"2023-05-10T04:20:54.969589+0000","last_became_active":"2023-05-10T04:20:54.964690+0000","last_became_peered":"2023-05-10T04:20:54.964690+0000","last_unstale":"2023-05-10T04:20:54.969589+0000","last_undegraded":"2023-05-10T04:20:54.969589+0000","last_fullsized":"2023-05-10T04:20:54.969589+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:51:12.502304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967197+0000","last_change":"2023-05-10T04:20:54.963503+0000","last_active":"2023-05-10T04:20:54.967197+0000","last_peered":"2023-05-10T04:20:54.967197+0000","last_clean":"2023-05-10T04:20:54.967197+0000","last_became_active":"2023-05-10T04:20:54.963242+0000","last_became_peered":"2023-05-10T04:20:54.963242+0000","last_unstale":"2023-05-10T04:20:54.967197+0000","last_undegraded":"2023-05-10T04:20:54.967197+0000","last_fullsized":"2023-05-10T04:20:54.967197+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:36:42.941614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.975876+0000","last_change":"2023-05-10T04:20:54.963632+0000","last_active":"2023-05-10T04:20:54.975876+0000","last_peered":"2023-05-10T04:20:54.975876+0000","last_clean":"2023-05-10T04:20:54.975876+0000","last_became_active":"2023-05-10T04:20:54.963371+0000","last_became_peered":"2023-05-10T04:20:54.963371+0000","last_unstale":"2023-05-10T04:20:54.975876+0000","last_undegraded":"2023-05-10T04:20:54.975876+0000","last_fullsized":"2023-05-10T04:20:54.975876+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:13:36.014721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.972791+0000","last_change":"2023-05-10T04:20:54.970436+0000","last_active":"2023-05-10T04:20:54.972791+0000","last_peered":"2023-05-10T04:20:54.972791+0000","last_clean":"2023-05-10T04:20:54.972791+0000","last_became_active":"2023-05-10T04:20:54.969994+0000","last_became_peered":"2023-05-10T04:20:54.969994+0000","last_unstale":"2023-05-10T04:20:54.972791+0000","last_undegraded":"2023-05-10T04:20:54.972791+0000","last_fullsized":"2023-05-10T04:20:54.972791+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:11:10.428062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.581108+0000","last_change":"2023-05-10T04:20:54.952808+0000","last_active":"2023-05-10T04:20:56.581108+0000","last_peered":"2023-05-10T04:20:56.581108+0000","last_clean":"2023-05-10T04:20:56.581108+0000","last_became_active":"2023-05-10T04:20:54.952540+0000","last_became_peered":"2023-05-10T04:20:54.952540+0000","last_unstale":"2023-05-10T04:20:56.581108+0000","last_undegraded":"2023-05-10T04:20:56.581108+0000","last_fullsized":"2023-05-10T04:20:56.581108+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:43:26.137494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979056+0000","last_change":"2023-05-10T04:20:54.975484+0000","last_active":"2023-05-10T04:20:54.979056+0000","last_peered":"2023-05-10T04:20:54.979056+0000","last_clean":"2023-05-10T04:20:54.979056+0000","last_became_active":"2023-05-10T04:20:54.966835+0000","last_became_peered":"2023-05-10T04:20:54.966835+0000","last_unstale":"2023-05-10T04:20:54.979056+0000","last_undegraded":"2023-05-10T04:20:54.979056+0000","last_fullsized":"2023-05-10T04:20:54.979056+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:07:52.098991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.973945+0000","last_change":"2023-05-10T04:20:54.962927+0000","last_active":"2023-05-10T04:20:54.973945+0000","last_peered":"2023-05-10T04:20:54.973945+0000","last_clean":"2023-05-10T04:20:54.973945+0000","last_became_active":"2023-05-10T04:20:54.962485+0000","last_became_peered":"2023-05-10T04:20:54.962485+0000","last_unstale":"2023-05-10T04:20:54.973945+0000","last_undegraded":"2023-05-10T04:20:54.973945+0000","last_fullsized":"2023-05-10T04:20:54.973945+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:19:10.330448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.969641+0000","last_change":"2023-05-10T04:20:54.963696+0000","last_active":"2023-05-10T04:20:54.969641+0000","last_peered":"2023-05-10T04:20:54.969641+0000","last_clean":"2023-05-10T04:20:54.969641+0000","last_became_active":"2023-05-10T04:20:54.963445+0000","last_became_peered":"2023-05-10T04:20:54.963445+0000","last_unstale":"2023-05-10T04:20:54.969641+0000","last_undegraded":"2023-05-10T04:20:54.969641+0000","last_fullsized":"2023-05-10T04:20:54.969641+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:28:16.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978312+0000","last_change":"2023-05-10T04:20:54.971756+0000","last_active":"2023-05-10T04:20:54.978312+0000","last_peered":"2023-05-10T04:20:54.978312+0000","last_clean":"2023-05-10T04:20:54.978312+0000","last_became_active":"2023-05-10T04:20:54.971482+0000","last_became_peered":"2023-05-10T04:20:54.971482+0000","last_unstale":"2023-05-10T04:20:54.978312+0000","last_undegraded":"2023-05-10T04:20:54.978312+0000","last_fullsized":"2023-05-10T04:20:54.978312+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:29:33.378827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978106+0000","last_change":"2023-05-10T04:20:54.971129+0000","last_active":"2023-05-10T04:20:54.978106+0000","last_peered":"2023-05-10T04:20:54.978106+0000","last_clean":"2023-05-10T04:20:54.978106+0000","last_became_active":"2023-05-10T04:20:54.970851+0000","last_became_peered":"2023-05-10T04:20:54.970851+0000","last_unstale":"2023-05-10T04:20:54.978106+0000","last_undegraded":"2023-05-10T04:20:54.978106+0000","last_fullsized":"2023-05-10T04:20:54.978106+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:17:52.655046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979541+0000","last_change":"2023-05-10T04:20:54.976921+0000","last_active":"2023-05-10T04:20:54.979541+0000","last_peered":"2023-05-10T04:20:54.979541+0000","last_clean":"2023-05-10T04:20:54.979541+0000","last_became_active":"2023-05-10T04:20:54.976641+0000","last_became_peered":"2023-05-10T04:20:54.976641+0000","last_unstale":"2023-05-10T04:20:54.979541+0000","last_undegraded":"2023-05-10T04:20:54.979541+0000","last_fullsized":"2023-05-10T04:20:54.979541+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:54:59.376839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970532+0000","last_change":"2023-05-10T04:20:54.968930+0000","last_active":"2023-05-10T04:20:54.970532+0000","last_peered":"2023-05-10T04:20:54.970532+0000","last_clean":"2023-05-10T04:20:54.970532+0000","last_became_active":"2023-05-10T04:20:54.968507+0000","last_became_peered":"2023-05-10T04:20:54.968507+0000","last_unstale":"2023-05-10T04:20:54.970532+0000","last_undegraded":"2023-05-10T04:20:54.970532+0000","last_fullsized":"2023-05-10T04:20:54.970532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:29:53.626260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971019+0000","last_change":"2023-05-10T04:20:54.967803+0000","last_active":"2023-05-10T04:20:54.971019+0000","last_peered":"2023-05-10T04:20:54.971019+0000","last_clean":"2023-05-10T04:20:54.971019+0000","last_became_active":"2023-05-10T04:20:54.967524+0000","last_became_peered":"2023-05-10T04:20:54.967524+0000","last_unstale":"2023-05-10T04:20:54.971019+0000","last_undegraded":"2023-05-10T04:20:54.971019+0000","last_fullsized":"2023-05-10T04:20:54.971019+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:41:12.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.975905+0000","last_change":"2023-05-10T04:20:54.970646+0000","last_active":"2023-05-10T04:20:54.975905+0000","last_peered":"2023-05-10T04:20:54.975905+0000","last_clean":"2023-05-10T04:20:54.975905+0000","last_became_active":"2023-05-10T04:20:54.970383+0000","last_became_peered":"2023-05-10T04:20:54.970383+0000","last_unstale":"2023-05-10T04:20:54.975905+0000","last_undegraded":"2023-05-10T04:20:54.975905+0000","last_fullsized":"2023-05-10T04:20:54.975905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:28:18.570843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580865+0000","last_change":"2023-05-10T04:20:54.955693+0000","last_active":"2023-05-10T04:20:56.580865+0000","last_peered":"2023-05-10T04:20:56.580865+0000","last_clean":"2023-05-10T04:20:56.580865+0000","last_became_active":"2023-05-10T04:20:54.953666+0000","last_became_peered":"2023-05-10T04:20:54.953666+0000","last_unstale":"2023-05-10T04:20:56.580865+0000","last_undegraded":"2023-05-10T04:20:56.580865+0000","last_fullsized":"2023-05-10T04:20:56.580865+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:22:42.850430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978351+0000","last_change":"2023-05-10T04:20:54.972170+0000","last_active":"2023-05-10T04:20:54.978351+0000","last_peered":"2023-05-10T04:20:54.978351+0000","last_clean":"2023-05-10T04:20:54.978351+0000","last_became_active":"2023-05-10T04:20:54.971900+0000","last_became_peered":"2023-05-10T04:20:54.971900+0000","last_unstale":"2023-05-10T04:20:54.978351+0000","last_undegraded":"2023-05-10T04:20:54.978351+0000","last_fullsized":"2023-05-10T04:20:54.978351+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:34:15.611736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.966655+0000","last_change":"2023-05-10T04:20:54.964088+0000","last_active":"2023-05-10T04:20:54.966655+0000","last_peered":"2023-05-10T04:20:54.966655+0000","last_clean":"2023-05-10T04:20:54.966655+0000","last_became_active":"2023-05-10T04:20:54.963826+0000","last_became_peered":"2023-05-10T04:20:54.963826+0000","last_unstale":"2023-05-10T04:20:54.966655+0000","last_undegraded":"2023-05-10T04:20:54.966655+0000","last_fullsized":"2023-05-10T04:20:54.966655+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:10:21.900202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967215+0000","last_change":"2023-05-10T04:20:54.964795+0000","last_active":"2023-05-10T04:20:54.967215+0000","last_peered":"2023-05-10T04:20:54.967215+0000","last_clean":"2023-05-10T04:20:54.967215+0000","last_became_active":"2023-05-10T04:20:54.964516+0000","last_became_peered":"2023-05-10T04:20:54.964516+0000","last_unstale":"2023-05-10T04:20:54.967215+0000","last_undegraded":"2023-05-10T04:20:54.967215+0000","last_fullsized":"2023-05-10T04:20:54.967215+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:08:18.392166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.964174+0000","last_change":"2023-05-10T04:20:54.961509+0000","last_active":"2023-05-10T04:20:54.964174+0000","last_peered":"2023-05-10T04:20:54.964174+0000","last_clean":"2023-05-10T04:20:54.964174+0000","last_became_active":"2023-05-10T04:20:54.961255+0000","last_became_peered":"2023-05-10T04:20:54.961255+0000","last_unstale":"2023-05-10T04:20:54.964174+0000","last_undegraded":"2023-05-10T04:20:54.964174+0000","last_fullsized":"2023-05-10T04:20:54.964174+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:11.802052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.968410+0000","last_change":"2023-05-10T04:20:54.966273+0000","last_active":"2023-05-10T04:20:54.968410+0000","last_peered":"2023-05-10T04:20:54.968410+0000","last_clean":"2023-05-10T04:20:54.968410+0000","last_became_active":"2023-05-10T04:20:54.965911+0000","last_became_peered":"2023-05-10T04:20:54.965911+0000","last_unstale":"2023-05-10T04:20:54.968410+0000","last_undegraded":"2023-05-10T04:20:54.968410+0000","last_fullsized":"2023-05-10T04:20:54.968410+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:52:40.415920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.975519+0000","last_change":"2023-05-10T04:20:54.965746+0000","last_active":"2023-05-10T04:20:54.975519+0000","last_peered":"2023-05-10T04:20:54.975519+0000","last_clean":"2023-05-10T04:20:54.975519+0000","last_became_active":"2023-05-10T04:20:54.964196+0000","last_became_peered":"2023-05-10T04:20:54.964196+0000","last_unstale":"2023-05-10T04:20:54.975519+0000","last_undegraded":"2023-05-10T04:20:54.975519+0000","last_fullsized":"2023-05-10T04:20:54.975519+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:41:12.925390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967976+0000","last_change":"2023-05-10T04:20:54.966461+0000","last_active":"2023-05-10T04:20:54.967976+0000","last_peered":"2023-05-10T04:20:54.967976+0000","last_clean":"2023-05-10T04:20:54.967976+0000","last_became_active":"2023-05-10T04:20:54.966216+0000","last_became_peered":"2023-05-10T04:20:54.966216+0000","last_unstale":"2023-05-10T04:20:54.967976+0000","last_undegraded":"2023-05-10T04:20:54.967976+0000","last_fullsized":"2023-05-10T04:20:54.967976+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:30:08.077888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.963936+0000","last_change":"2023-05-10T04:20:54.957470+0000","last_active":"2023-05-10T04:20:54.963936+0000","last_peered":"2023-05-10T04:20:54.963936+0000","last_clean":"2023-05-10T04:20:54.963936+0000","last_became_active":"2023-05-10T04:20:54.957207+0000","last_became_peered":"2023-05-10T04:20:54.957207+0000","last_unstale":"2023-05-10T04:20:54.963936+0000","last_undegraded":"2023-05-10T04:20:54.963936+0000","last_fullsized":"2023-05-10T04:20:54.963936+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:16:34.409120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967323+0000","last_change":"2023-05-10T04:20:54.965744+0000","last_active":"2023-05-10T04:20:54.967323+0000","last_peered":"2023-05-10T04:20:54.967323+0000","last_clean":"2023-05-10T04:20:54.967323+0000","last_became_active":"2023-05-10T04:20:54.965421+0000","last_became_peered":"2023-05-10T04:20:54.965421+0000","last_unstale":"2023-05-10T04:20:54.967323+0000","last_undegraded":"2023-05-10T04:20:54.967323+0000","last_fullsized":"2023-05-10T04:20:54.967323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:31:38.581615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957307+0000","last_change":"2023-05-10T04:20:54.950851+0000","last_active":"2023-05-10T04:20:54.957307+0000","last_peered":"2023-05-10T04:20:54.957307+0000","last_clean":"2023-05-10T04:20:54.957307+0000","last_became_active":"2023-05-10T04:20:54.950597+0000","last_became_peered":"2023-05-10T04:20:54.950597+0000","last_unstale":"2023-05-10T04:20:54.957307+0000","last_undegraded":"2023-05-10T04:20:54.957307+0000","last_fullsized":"2023-05-10T04:20:54.957307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:04.312090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.968285+0000","last_change":"2023-05-10T04:20:54.961467+0000","last_active":"2023-05-10T04:20:54.968285+0000","last_peered":"2023-05-10T04:20:54.968285+0000","last_clean":"2023-05-10T04:20:54.968285+0000","last_became_active":"2023-05-10T04:20:54.961157+0000","last_became_peered":"2023-05-10T04:20:54.961157+0000","last_unstale":"2023-05-10T04:20:54.968285+0000","last_undegraded":"2023-05-10T04:20:54.968285+0000","last_fullsized":"2023-05-10T04:20:54.968285+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:11.802052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979167+0000","last_change":"2023-05-10T04:20:54.976004+0000","last_active":"2023-05-10T04:20:54.979167+0000","last_peered":"2023-05-10T04:20:54.979167+0000","last_clean":"2023-05-10T04:20:54.979167+0000","last_became_active":"2023-05-10T04:20:54.966903+0000","last_became_peered":"2023-05-10T04:20:54.966903+0000","last_unstale":"2023-05-10T04:20:54.979167+0000","last_undegraded":"2023-05-10T04:20:54.979167+0000","last_fullsized":"2023-05-10T04:20:54.979167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:59:37.266937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971093+0000","last_change":"2023-05-10T04:20:54.968241+0000","last_active":"2023-05-10T04:20:54.971093+0000","last_peered":"2023-05-10T04:20:54.971093+0000","last_clean":"2023-05-10T04:20:54.971093+0000","last_became_active":"2023-05-10T04:20:54.967948+0000","last_became_peered":"2023-05-10T04:20:54.967948+0000","last_unstale":"2023-05-10T04:20:54.971093+0000","last_undegraded":"2023-05-10T04:20:54.971093+0000","last_fullsized":"2023-05-10T04:20:54.971093+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:53:17.540742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1f","version":"40'4","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970285+0000","last_change":"2023-05-10T04:20:54.474706+0000","last_active":"2023-05-10T04:20:54.970285+0000","last_peered":"2023-05-10T04:20:54.970285+0000","last_clean":"2023-05-10T04:20:54.970285+0000","last_became_active":"2023-05-10T04:20:54.474347+0000","last_became_peered":"2023-05-10T04:20:54.474347+0000","last_unstale":"2023-05-10T04:20:54.970285+0000","last_undegraded":"2023-05-10T04:20:54.970285+0000","last_fullsized":"2023-05-10T04:20:54.970285+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:03.309151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.975958+0000","last_change":"2023-05-10T04:20:54.971777+0000","last_active":"2023-05-10T04:20:54.975958+0000","last_peered":"2023-05-10T04:20:54.975958+0000","last_clean":"2023-05-10T04:20:54.975958+0000","last_became_active":"2023-05-10T04:20:54.971512+0000","last_became_peered":"2023-05-10T04:20:54.971512+0000","last_unstale":"2023-05-10T04:20:54.975958+0000","last_undegraded":"2023-05-10T04:20:54.975958+0000","last_fullsized":"2023-05-10T04:20:54.975958+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:23:34.631288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.958041+0000","last_change":"2023-05-10T04:20:54.473160+0000","last_active":"2023-05-10T04:20:54.958041+0000","last_peered":"2023-05-10T04:20:54.958041+0000","last_clean":"2023-05-10T04:20:54.958041+0000","last_became_active":"2023-05-10T04:20:54.472893+0000","last_became_peered":"2023-05-10T04:20:54.472893+0000","last_unstale":"2023-05-10T04:20:54.958041+0000","last_undegraded":"2023-05-10T04:20:54.958041+0000","last_fullsized":"2023-05-10T04:20:54.958041+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:42:05.355245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978905+0000","last_change":"2023-05-10T04:20:54.971648+0000","last_active":"2023-05-10T04:20:54.978905+0000","last_peered":"2023-05-10T04:20:54.978905+0000","last_clean":"2023-05-10T04:20:54.978905+0000","last_became_active":"2023-05-10T04:20:54.971343+0000","last_became_peered":"2023-05-10T04:20:54.971343+0000","last_unstale":"2023-05-10T04:20:54.978905+0000","last_undegraded":"2023-05-10T04:20:54.978905+0000","last_fullsized":"2023-05-10T04:20:54.978905+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:51.126879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.966679+0000","last_change":"2023-05-10T04:20:54.473995+0000","last_active":"2023-05-10T04:20:54.966679+0000","last_peered":"2023-05-10T04:20:54.966679+0000","last_clean":"2023-05-10T04:20:54.966679+0000","last_became_active":"2023-05-10T04:20:54.473640+0000","last_became_peered":"2023-05-10T04:20:54.473640+0000","last_unstale":"2023-05-10T04:20:54.966679+0000","last_undegraded":"2023-05-10T04:20:54.966679+0000","last_fullsized":"2023-05-10T04:20:54.966679+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:49:38.815208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979214+0000","last_change":"2023-05-10T04:20:54.976262+0000","last_active":"2023-05-10T04:20:54.979214+0000","last_peered":"2023-05-10T04:20:54.979214+0000","last_clean":"2023-05-10T04:20:54.979214+0000","last_became_active":"2023-05-10T04:20:54.966987+0000","last_became_peered":"2023-05-10T04:20:54.966987+0000","last_unstale":"2023-05-10T04:20:54.979214+0000","last_undegraded":"2023-05-10T04:20:54.979214+0000","last_fullsized":"2023-05-10T04:20:54.979214+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:30:15.512791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.958268+0000","last_change":"2023-05-10T04:20:54.473872+0000","last_active":"2023-05-10T04:20:54.958268+0000","last_peered":"2023-05-10T04:20:54.958268+0000","last_clean":"2023-05-10T04:20:54.958268+0000","last_became_active":"2023-05-10T04:20:54.473616+0000","last_became_peered":"2023-05-10T04:20:54.473616+0000","last_unstale":"2023-05-10T04:20:54.958268+0000","last_undegraded":"2023-05-10T04:20:54.958268+0000","last_fullsized":"2023-05-10T04:20:54.958268+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:32:58.248077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967252+0000","last_change":"2023-05-10T04:20:54.964085+0000","last_active":"2023-05-10T04:20:54.967252+0000","last_peered":"2023-05-10T04:20:54.967252+0000","last_clean":"2023-05-10T04:20:54.967252+0000","last_became_active":"2023-05-10T04:20:54.963812+0000","last_became_peered":"2023-05-10T04:20:54.963812+0000","last_unstale":"2023-05-10T04:20:54.967252+0000","last_undegraded":"2023-05-10T04:20:54.967252+0000","last_fullsized":"2023-05-10T04:20:54.967252+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:37:47.924447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1b","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.964092+0000","last_change":"2023-05-10T04:20:54.474896+0000","last_active":"2023-05-10T04:20:54.964092+0000","last_peered":"2023-05-10T04:20:54.964092+0000","last_clean":"2023-05-10T04:20:54.964092+0000","last_became_active":"2023-05-10T04:20:54.474382+0000","last_became_peered":"2023-05-10T04:20:54.474382+0000","last_unstale":"2023-05-10T04:20:54.964092+0000","last_undegraded":"2023-05-10T04:20:54.964092+0000","last_fullsized":"2023-05-10T04:20:54.964092+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:19:09.327509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580727+0000","last_change":"2023-05-10T04:20:54.968086+0000","last_active":"2023-05-10T04:20:56.580727+0000","last_peered":"2023-05-10T04:20:56.580727+0000","last_clean":"2023-05-10T04:20:56.580727+0000","last_became_active":"2023-05-10T04:20:54.967374+0000","last_became_peered":"2023-05-10T04:20:54.967374+0000","last_unstale":"2023-05-10T04:20:56.580727+0000","last_undegraded":"2023-05-10T04:20:56.580727+0000","last_fullsized":"2023-05-10T04:20:56.580727+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:43:33.449115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.965333+0000","last_change":"2023-05-10T04:20:54.475843+0000","last_active":"2023-05-10T04:20:54.965333+0000","last_peered":"2023-05-10T04:20:54.965333+0000","last_clean":"2023-05-10T04:20:54.965333+0000","last_became_active":"2023-05-10T04:20:54.475569+0000","last_became_peered":"2023-05-10T04:20:54.475569+0000","last_unstale":"2023-05-10T04:20:54.965333+0000","last_undegraded":"2023-05-10T04:20:54.965333+0000","last_fullsized":"2023-05-10T04:20:54.965333+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:50:42.610097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580507+0000","last_change":"2023-05-10T04:20:54.950094+0000","last_active":"2023-05-10T04:20:56.580507+0000","last_peered":"2023-05-10T04:20:56.580507+0000","last_clean":"2023-05-10T04:20:56.580507+0000","last_became_active":"2023-05-10T04:20:54.949808+0000","last_became_peered":"2023-05-10T04:20:54.949808+0000","last_unstale":"2023-05-10T04:20:56.580507+0000","last_undegraded":"2023-05-10T04:20:56.580507+0000","last_fullsized":"2023-05-10T04:20:56.580507+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:51:28.168853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957746+0000","last_change":"2023-05-10T04:20:54.478854+0000","last_active":"2023-05-10T04:20:54.957746+0000","last_peered":"2023-05-10T04:20:54.957746+0000","last_clean":"2023-05-10T04:20:54.957746+0000","last_became_active":"2023-05-10T04:20:54.478581+0000","last_became_peered":"2023-05-10T04:20:54.478581+0000","last_unstale":"2023-05-10T04:20:54.957746+0000","last_undegraded":"2023-05-10T04:20:54.957746+0000","last_fullsized":"2023-05-10T04:20:54.957746+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:21:10.799112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.956435+0000","last_change":"2023-05-10T04:20:54.954581+0000","last_active":"2023-05-10T04:20:54.956435+0000","last_peered":"2023-05-10T04:20:54.956435+0000","last_clean":"2023-05-10T04:20:54.956435+0000","last_became_active":"2023-05-10T04:20:54.953958+0000","last_became_peered":"2023-05-10T04:20:54.953958+0000","last_unstale":"2023-05-10T04:20:54.956435+0000","last_undegraded":"2023-05-10T04:20:54.956435+0000","last_fullsized":"2023-05-10T04:20:54.956435+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T10:44:59.457203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580532+0000","last_change":"2023-05-10T04:20:54.479997+0000","last_active":"2023-05-10T04:20:56.580532+0000","last_peered":"2023-05-10T04:20:56.580532+0000","last_clean":"2023-05-10T04:20:56.580532+0000","last_became_active":"2023-05-10T04:20:54.479633+0000","last_became_peered":"2023-05-10T04:20:54.479633+0000","last_unstale":"2023-05-10T04:20:56.580532+0000","last_undegraded":"2023-05-10T04:20:56.580532+0000","last_fullsized":"2023-05-10T04:20:56.580532+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:37:11.923061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.964685+0000","last_change":"2023-05-10T04:20:54.962342+0000","last_active":"2023-05-10T04:20:54.964685+0000","last_peered":"2023-05-10T04:20:54.964685+0000","last_clean":"2023-05-10T04:20:54.964685+0000","last_became_active":"2023-05-10T04:20:54.962089+0000","last_became_peered":"2023-05-10T04:20:54.962089+0000","last_unstale":"2023-05-10T04:20:54.964685+0000","last_undegraded":"2023-05-10T04:20:54.964685+0000","last_fullsized":"2023-05-10T04:20:54.964685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:15:24.216089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.949631+0000","last_change":"2023-05-10T04:20:54.480029+0000","last_active":"2023-05-10T04:20:54.949631+0000","last_peered":"2023-05-10T04:20:54.949631+0000","last_clean":"2023-05-10T04:20:54.949631+0000","last_became_active":"2023-05-10T04:20:54.479780+0000","last_became_peered":"2023-05-10T04:20:54.479780+0000","last_unstale":"2023-05-10T04:20:54.949631+0000","last_undegraded":"2023-05-10T04:20:54.949631+0000","last_fullsized":"2023-05-10T04:20:54.949631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:17:51.652107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970826+0000","last_change":"2023-05-10T04:20:54.966827+0000","last_active":"2023-05-10T04:20:54.970826+0000","last_peered":"2023-05-10T04:20:54.970826+0000","last_clean":"2023-05-10T04:20:54.970826+0000","last_became_active":"2023-05-10T04:20:54.966504+0000","last_became_peered":"2023-05-10T04:20:54.966504+0000","last_unstale":"2023-05-10T04:20:54.970826+0000","last_undegraded":"2023-05-10T04:20:54.970826+0000","last_fullsized":"2023-05-10T04:20:54.970826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:20:51.126879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.581102+0000","last_change":"2023-05-10T04:20:54.479878+0000","last_active":"2023-05-10T04:20:56.581102+0000","last_peered":"2023-05-10T04:20:56.581102+0000","last_clean":"2023-05-10T04:20:56.581102+0000","last_became_active":"2023-05-10T04:20:54.479572+0000","last_became_peered":"2023-05-10T04:20:54.479572+0000","last_unstale":"2023-05-10T04:20:56.581102+0000","last_undegraded":"2023-05-10T04:20:56.581102+0000","last_fullsized":"2023-05-10T04:20:56.581102+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:36:43.810885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978157+0000","last_change":"2023-05-10T04:20:54.971672+0000","last_active":"2023-05-10T04:20:54.978157+0000","last_peered":"2023-05-10T04:20:54.978157+0000","last_clean":"2023-05-10T04:20:54.978157+0000","last_became_active":"2023-05-10T04:20:54.971410+0000","last_became_peered":"2023-05-10T04:20:54.971410+0000","last_unstale":"2023-05-10T04:20:54.978157+0000","last_undegraded":"2023-05-10T04:20:54.978157+0000","last_fullsized":"2023-05-10T04:20:54.978157+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:10:18.575649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"40'3","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.969074+0000","last_change":"2023-05-10T04:20:54.482889+0000","last_active":"2023-05-10T04:20:54.969074+0000","last_peered":"2023-05-10T04:20:54.969074+0000","last_clean":"2023-05-10T04:20:54.969074+0000","last_became_active":"2023-05-10T04:20:54.482570+0000","last_became_peered":"2023-05-10T04:20:54.482570+0000","last_unstale":"2023-05-10T04:20:54.969074+0000","last_undegraded":"2023-05-10T04:20:54.969074+0000","last_fullsized":"2023-05-10T04:20:54.969074+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:52:31.298336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976722+0000","last_change":"2023-05-10T04:20:54.973673+0000","last_active":"2023-05-10T04:20:54.976722+0000","last_peered":"2023-05-10T04:20:54.976722+0000","last_clean":"2023-05-10T04:20:54.976722+0000","last_became_active":"2023-05-10T04:20:54.973411+0000","last_became_peered":"2023-05-10T04:20:54.973411+0000","last_unstale":"2023-05-10T04:20:54.976722+0000","last_undegraded":"2023-05-10T04:20:54.976722+0000","last_fullsized":"2023-05-10T04:20:54.976722+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:42:31.126965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"40'6","reported_seq":19,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.581125+0000","last_change":"2023-05-10T04:20:54.470030+0000","last_active":"2023-05-10T04:20:56.581125+0000","last_peered":"2023-05-10T04:20:56.581125+0000","last_clean":"2023-05-10T04:20:56.581125+0000","last_became_active":"2023-05-10T04:20:54.468825+0000","last_became_peered":"2023-05-10T04:20:54.468825+0000","last_unstale":"2023-05-10T04:20:56.581125+0000","last_undegraded":"2023-05-10T04:20:56.581125+0000","last_fullsized":"2023-05-10T04:20:56.581125+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T08:30:51.183848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971240+0000","last_change":"2023-05-10T04:20:54.968348+0000","last_active":"2023-05-10T04:20:54.971240+0000","last_peered":"2023-05-10T04:20:54.971240+0000","last_clean":"2023-05-10T04:20:54.971240+0000","last_became_active":"2023-05-10T04:20:54.967871+0000","last_became_peered":"2023-05-10T04:20:54.967871+0000","last_unstale":"2023-05-10T04:20:54.971240+0000","last_undegraded":"2023-05-10T04:20:54.971240+0000","last_fullsized":"2023-05-10T04:20:54.971240+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:30:15.512791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.13","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971678+0000","last_change":"2023-05-10T04:20:54.476720+0000","last_active":"2023-05-10T04:20:54.971678+0000","last_peered":"2023-05-10T04:20:54.971678+0000","last_clean":"2023-05-10T04:20:54.971678+0000","last_became_active":"2023-05-10T04:20:54.476403+0000","last_became_peered":"2023-05-10T04:20:54.476403+0000","last_unstale":"2023-05-10T04:20:54.971678+0000","last_undegraded":"2023-05-10T04:20:54.971678+0000","last_fullsized":"2023-05-10T04:20:54.971678+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:37:16.405142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.966196+0000","last_change":"2023-05-10T04:20:54.961959+0000","last_active":"2023-05-10T04:20:54.966196+0000","last_peered":"2023-05-10T04:20:54.966196+0000","last_clean":"2023-05-10T04:20:54.966196+0000","last_became_active":"2023-05-10T04:20:54.961661+0000","last_became_peered":"2023-05-10T04:20:54.961661+0000","last_unstale":"2023-05-10T04:20:54.966196+0000","last_undegraded":"2023-05-10T04:20:54.966196+0000","last_fullsized":"2023-05-10T04:20:54.966196+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:20:12.317448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957566+0000","last_change":"2023-05-10T04:20:54.476606+0000","last_active":"2023-05-10T04:20:54.957566+0000","last_peered":"2023-05-10T04:20:54.957566+0000","last_clean":"2023-05-10T04:20:54.957566+0000","last_became_active":"2023-05-10T04:20:54.476275+0000","last_became_peered":"2023-05-10T04:20:54.476275+0000","last_unstale":"2023-05-10T04:20:54.957566+0000","last_undegraded":"2023-05-10T04:20:54.957566+0000","last_fullsized":"2023-05-10T04:20:54.957566+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:43:43.752659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976608+0000","last_change":"2023-05-10T04:20:54.973446+0000","last_active":"2023-05-10T04:20:54.976608+0000","last_peered":"2023-05-10T04:20:54.976608+0000","last_clean":"2023-05-10T04:20:54.976608+0000","last_became_active":"2023-05-10T04:20:54.973172+0000","last_became_peered":"2023-05-10T04:20:54.973172+0000","last_unstale":"2023-05-10T04:20:54.976608+0000","last_undegraded":"2023-05-10T04:20:54.976608+0000","last_fullsized":"2023-05-10T04:20:54.976608+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:21:16.337962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.948067+0000","last_change":"2023-05-10T04:20:54.479522+0000","last_active":"2023-05-10T04:20:54.948067+0000","last_peered":"2023-05-10T04:20:54.948067+0000","last_clean":"2023-05-10T04:20:54.948067+0000","last_became_active":"2023-05-10T04:20:54.478917+0000","last_became_peered":"2023-05-10T04:20:54.478917+0000","last_unstale":"2023-05-10T04:20:54.948067+0000","last_undegraded":"2023-05-10T04:20:54.948067+0000","last_fullsized":"2023-05-10T04:20:54.948067+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:33:24.674196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970745+0000","last_change":"2023-05-10T04:20:54.968085+0000","last_active":"2023-05-10T04:20:54.970745+0000","last_peered":"2023-05-10T04:20:54.970745+0000","last_clean":"2023-05-10T04:20:54.970745+0000","last_became_active":"2023-05-10T04:20:54.967813+0000","last_became_peered":"2023-05-10T04:20:54.967813+0000","last_unstale":"2023-05-10T04:20:54.970745+0000","last_undegraded":"2023-05-10T04:20:54.970745+0000","last_fullsized":"2023-05-10T04:20:54.970745+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:28:16.857295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"40'8","reported_seq":21,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580779+0000","last_change":"2023-05-10T04:20:54.472856+0000","last_active":"2023-05-10T04:20:56.580779+0000","last_peered":"2023-05-10T04:20:56.580779+0000","last_clean":"2023-05-10T04:20:56.580779+0000","last_became_active":"2023-05-10T04:20:54.472546+0000","last_became_peered":"2023-05-10T04:20:54.472546+0000","last_unstale":"2023-05-10T04:20:56.580779+0000","last_undegraded":"2023-05-10T04:20:56.580779+0000","last_fullsized":"2023-05-10T04:20:56.580779+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:59:29.978474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.966468+0000","last_change":"2023-05-10T04:20:54.962439+0000","last_active":"2023-05-10T04:20:54.966468+0000","last_peered":"2023-05-10T04:20:54.966468+0000","last_clean":"2023-05-10T04:20:54.966468+0000","last_became_active":"2023-05-10T04:20:54.962167+0000","last_became_peered":"2023-05-10T04:20:54.962167+0000","last_unstale":"2023-05-10T04:20:54.966468+0000","last_undegraded":"2023-05-10T04:20:54.966468+0000","last_fullsized":"2023-05-10T04:20:54.966468+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:48:48.614594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.f","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.976043+0000","last_change":"2023-05-10T04:20:54.484031+0000","last_active":"2023-05-10T04:20:54.976043+0000","last_peered":"2023-05-10T04:20:54.976043+0000","last_clean":"2023-05-10T04:20:54.976043+0000","last_became_active":"2023-05-10T04:20:54.483699+0000","last_became_peered":"2023-05-10T04:20:54.483699+0000","last_unstale":"2023-05-10T04:20:54.976043+0000","last_undegraded":"2023-05-10T04:20:54.976043+0000","last_fullsized":"2023-05-10T04:20:54.976043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:03:15.867017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971266+0000","last_change":"2023-05-10T04:20:54.968370+0000","last_active":"2023-05-10T04:20:54.971266+0000","last_peered":"2023-05-10T04:20:54.971266+0000","last_clean":"2023-05-10T04:20:54.971266+0000","last_became_active":"2023-05-10T04:20:54.968073+0000","last_became_peered":"2023-05-10T04:20:54.968073+0000","last_unstale":"2023-05-10T04:20:54.971266+0000","last_undegraded":"2023-05-10T04:20:54.971266+0000","last_fullsized":"2023-05-10T04:20:54.971266+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:32:33.997995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.967972+0000","last_change":"2023-05-10T04:20:54.482027+0000","last_active":"2023-05-10T04:20:54.967972+0000","last_peered":"2023-05-10T04:20:54.967972+0000","last_clean":"2023-05-10T04:20:54.967972+0000","last_became_active":"2023-05-10T04:20:54.479355+0000","last_became_peered":"2023-05-10T04:20:54.479355+0000","last_unstale":"2023-05-10T04:20:54.967972+0000","last_undegraded":"2023-05-10T04:20:54.967972+0000","last_fullsized":"2023-05-10T04:20:54.967972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:02:08.771960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.973926+0000","last_change":"2023-05-10T04:20:54.962724+0000","last_active":"2023-05-10T04:20:54.973926+0000","last_peered":"2023-05-10T04:20:54.973926+0000","last_clean":"2023-05-10T04:20:54.973926+0000","last_became_active":"2023-05-10T04:20:54.962181+0000","last_became_peered":"2023-05-10T04:20:54.962181+0000","last_unstale":"2023-05-10T04:20:54.973926+0000","last_undegraded":"2023-05-10T04:20:54.973926+0000","last_fullsized":"2023-05-10T04:20:54.973926+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:33:25.677135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.d","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.972007+0000","last_change":"2023-05-10T04:20:54.480645+0000","last_active":"2023-05-10T04:20:54.972007+0000","last_peered":"2023-05-10T04:20:54.972007+0000","last_clean":"2023-05-10T04:20:54.972007+0000","last_became_active":"2023-05-10T04:20:54.480386+0000","last_became_peered":"2023-05-10T04:20:54.480386+0000","last_unstale":"2023-05-10T04:20:54.972007+0000","last_undegraded":"2023-05-10T04:20:54.972007+0000","last_fullsized":"2023-05-10T04:20:54.972007+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:41:28.014383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971080+0000","last_change":"2023-05-10T04:20:54.967983+0000","last_active":"2023-05-10T04:20:54.971080+0000","last_peered":"2023-05-10T04:20:54.971080+0000","last_clean":"2023-05-10T04:20:54.971080+0000","last_became_active":"2023-05-10T04:20:54.967677+0000","last_became_peered":"2023-05-10T04:20:54.967677+0000","last_unstale":"2023-05-10T04:20:54.971080+0000","last_undegraded":"2023-05-10T04:20:54.971080+0000","last_fullsized":"2023-05-10T04:20:54.971080+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:10:18.575649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.947920+0000","last_change":"2023-05-10T04:20:54.479959+0000","last_active":"2023-05-10T04:20:54.947920+0000","last_peered":"2023-05-10T04:20:54.947920+0000","last_clean":"2023-05-10T04:20:54.947920+0000","last_became_active":"2023-05-10T04:20:54.479009+0000","last_became_peered":"2023-05-10T04:20:54.479009+0000","last_unstale":"2023-05-10T04:20:54.947920+0000","last_undegraded":"2023-05-10T04:20:54.947920+0000","last_fullsized":"2023-05-10T04:20:54.947920+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T05:52:31.298336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580765+0000","last_change":"2023-05-10T04:20:54.967047+0000","last_active":"2023-05-10T04:20:56.580765+0000","last_peered":"2023-05-10T04:20:56.580765+0000","last_clean":"2023-05-10T04:20:56.580765+0000","last_became_active":"2023-05-10T04:20:54.960651+0000","last_became_peered":"2023-05-10T04:20:54.960651+0000","last_unstale":"2023-05-10T04:20:56.580765+0000","last_undegraded":"2023-05-10T04:20:56.580765+0000","last_fullsized":"2023-05-10T04:20:56.580765+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:44:00.494566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.b","version":"40'2","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580990+0000","last_change":"2023-05-10T04:20:54.480137+0000","last_active":"2023-05-10T04:20:56.580990+0000","last_peered":"2023-05-10T04:20:56.580990+0000","last_clean":"2023-05-10T04:20:56.580990+0000","last_became_active":"2023-05-10T04:20:54.479803+0000","last_became_peered":"2023-05-10T04:20:54.479803+0000","last_unstale":"2023-05-10T04:20:56.580990+0000","last_undegraded":"2023-05-10T04:20:56.580990+0000","last_fullsized":"2023-05-10T04:20:56.580990+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:58:45.558103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.968359+0000","last_change":"2023-05-10T04:20:54.960386+0000","last_active":"2023-05-10T04:20:54.968359+0000","last_peered":"2023-05-10T04:20:54.968359+0000","last_clean":"2023-05-10T04:20:54.968359+0000","last_became_active":"2023-05-10T04:20:54.960118+0000","last_became_peered":"2023-05-10T04:20:54.960118+0000","last_unstale":"2023-05-10T04:20:54.968359+0000","last_undegraded":"2023-05-10T04:20:54.968359+0000","last_fullsized":"2023-05-10T04:20:54.968359+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:47:31.167944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957714+0000","last_change":"2023-05-10T04:20:54.478376+0000","last_active":"2023-05-10T04:20:54.957714+0000","last_peered":"2023-05-10T04:20:54.957714+0000","last_clean":"2023-05-10T04:20:54.957714+0000","last_became_active":"2023-05-10T04:20:54.477989+0000","last_became_peered":"2023-05-10T04:20:54.477989+0000","last_unstale":"2023-05-10T04:20:54.957714+0000","last_undegraded":"2023-05-10T04:20:54.957714+0000","last_fullsized":"2023-05-10T04:20:54.957714+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:47:30.165005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979273+0000","last_change":"2023-05-10T04:20:54.976623+0000","last_active":"2023-05-10T04:20:54.979273+0000","last_peered":"2023-05-10T04:20:54.979273+0000","last_clean":"2023-05-10T04:20:54.979273+0000","last_became_active":"2023-05-10T04:20:54.970516+0000","last_became_peered":"2023-05-10T04:20:54.970516+0000","last_unstale":"2023-05-10T04:20:54.979273+0000","last_undegraded":"2023-05-10T04:20:54.979273+0000","last_fullsized":"2023-05-10T04:20:54.979273+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:41:29.017322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580479+0000","last_change":"2023-05-10T04:20:54.480297+0000","last_active":"2023-05-10T04:20:56.580479+0000","last_peered":"2023-05-10T04:20:56.580479+0000","last_clean":"2023-05-10T04:20:56.580479+0000","last_became_active":"2023-05-10T04:20:54.479530+0000","last_became_peered":"2023-05-10T04:20:54.479530+0000","last_unstale":"2023-05-10T04:20:56.580479+0000","last_undegraded":"2023-05-10T04:20:56.580479+0000","last_fullsized":"2023-05-10T04:20:56.580479+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:02:49.577170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978129+0000","last_change":"2023-05-10T04:20:54.971102+0000","last_active":"2023-05-10T04:20:54.978129+0000","last_peered":"2023-05-10T04:20:54.978129+0000","last_clean":"2023-05-10T04:20:54.978129+0000","last_became_active":"2023-05-10T04:20:54.970820+0000","last_became_peered":"2023-05-10T04:20:54.970820+0000","last_unstale":"2023-05-10T04:20:54.978129+0000","last_undegraded":"2023-05-10T04:20:54.978129+0000","last_fullsized":"2023-05-10T04:20:54.978129+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:00:36.690080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.942651+0000","last_change":"2023-05-10T04:20:54.468090+0000","last_active":"2023-05-10T04:20:54.942651+0000","last_peered":"2023-05-10T04:20:54.942651+0000","last_clean":"2023-05-10T04:20:54.942651+0000","last_became_active":"2023-05-10T04:20:54.467717+0000","last_became_peered":"2023-05-10T04:20:54.467717+0000","last_unstale":"2023-05-10T04:20:54.942651+0000","last_undegraded":"2023-05-10T04:20:54.942651+0000","last_fullsized":"2023-05-10T04:20:54.942651+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:32:07.619870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.961880+0000","last_change":"2023-05-10T04:20:54.958648+0000","last_active":"2023-05-10T04:20:54.961880+0000","last_peered":"2023-05-10T04:20:54.961880+0000","last_clean":"2023-05-10T04:20:54.961880+0000","last_became_active":"2023-05-10T04:20:54.958393+0000","last_became_peered":"2023-05-10T04:20:54.958393+0000","last_unstale":"2023-05-10T04:20:54.961880+0000","last_undegraded":"2023-05-10T04:20:54.961880+0000","last_fullsized":"2023-05-10T04:20:54.961880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:11:10.428062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.946482+0000","last_change":"2023-05-10T04:20:54.474264+0000","last_active":"2023-05-10T04:20:54.946482+0000","last_peered":"2023-05-10T04:20:54.946482+0000","last_clean":"2023-05-10T04:20:54.946482+0000","last_became_active":"2023-05-10T04:20:54.473942+0000","last_became_peered":"2023-05-10T04:20:54.473942+0000","last_unstale":"2023-05-10T04:20:54.946482+0000","last_undegraded":"2023-05-10T04:20:54.946482+0000","last_fullsized":"2023-05-10T04:20:54.946482+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T15:23:21.887450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":39,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.958089+0000","last_change":"2023-05-10T04:19:04.607342+0000","last_active":"2023-05-10T04:20:54.958089+0000","last_peered":"2023-05-10T04:20:54.958089+0000","last_clean":"2023-05-10T04:20:54.958089+0000","last_became_active":"2023-05-10T04:19:04.606956+0000","last_became_peered":"2023-05-10T04:19:04.606956+0000","last_unstale":"2023-05-10T04:20:54.958089+0000","last_undegraded":"2023-05-10T04:20:54.958089+0000","last_fullsized":"2023-05-10T04:20:54.958089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:18:12.655852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.956406+0000","last_change":"2023-05-10T04:20:54.953725+0000","last_active":"2023-05-10T04:20:54.956406+0000","last_peered":"2023-05-10T04:20:54.956406+0000","last_clean":"2023-05-10T04:20:54.956406+0000","last_became_active":"2023-05-10T04:20:54.953461+0000","last_became_peered":"2023-05-10T04:20:54.953461+0000","last_unstale":"2023-05-10T04:20:54.956406+0000","last_undegraded":"2023-05-10T04:20:54.956406+0000","last_fullsized":"2023-05-10T04:20:54.956406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T14:37:26.400833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.960675+0000","last_change":"2023-05-10T04:20:54.483341+0000","last_active":"2023-05-10T04:20:54.960675+0000","last_peered":"2023-05-10T04:20:54.960675+0000","last_clean":"2023-05-10T04:20:54.960675+0000","last_became_active":"2023-05-10T04:20:54.482875+0000","last_became_peered":"2023-05-10T04:20:54.482875+0000","last_unstale":"2023-05-10T04:20:54.960675+0000","last_undegraded":"2023-05-10T04:20:54.960675+0000","last_fullsized":"2023-05-10T04:20:54.960675+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:31:22.228486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.943632+0000","last_change":"2023-05-10T04:19:04.607370+0000","last_active":"2023-05-10T04:20:54.943632+0000","last_peered":"2023-05-10T04:20:54.943632+0000","last_clean":"2023-05-10T04:20:54.943632+0000","last_became_active":"2023-05-10T04:19:04.606959+0000","last_became_peered":"2023-05-10T04:19:04.606959+0000","last_unstale":"2023-05-10T04:20:54.943632+0000","last_undegraded":"2023-05-10T04:20:54.943632+0000","last_fullsized":"2023-05-10T04:20:54.943632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:56:22.619780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.581184+0000","last_change":"2023-05-10T04:20:54.949428+0000","last_active":"2023-05-10T04:20:56.581184+0000","last_peered":"2023-05-10T04:20:56.581184+0000","last_clean":"2023-05-10T04:20:56.581184+0000","last_became_active":"2023-05-10T04:20:54.949135+0000","last_became_peered":"2023-05-10T04:20:54.949135+0000","last_unstale":"2023-05-10T04:20:56.581184+0000","last_undegraded":"2023-05-10T04:20:56.581184+0000","last_fullsized":"2023-05-10T04:20:56.581184+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:49:17.416815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957841+0000","last_change":"2023-05-10T04:20:54.478279+0000","last_active":"2023-05-10T04:20:54.957841+0000","last_peered":"2023-05-10T04:20:54.957841+0000","last_clean":"2023-05-10T04:20:54.957841+0000","last_became_active":"2023-05-10T04:20:54.477878+0000","last_became_peered":"2023-05-10T04:20:54.477878+0000","last_unstale":"2023-05-10T04:20:54.957841+0000","last_undegraded":"2023-05-10T04:20:54.957841+0000","last_fullsized":"2023-05-10T04:20:54.957841+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:28:15.854356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.946855+0000","last_change":"2023-05-10T04:19:04.443832+0000","last_active":"2023-05-10T04:20:54.946855+0000","last_peered":"2023-05-10T04:20:54.946855+0000","last_clean":"2023-05-10T04:20:54.946855+0000","last_became_active":"2023-05-10T04:19:04.443487+0000","last_became_peered":"2023-05-10T04:19:04.443487+0000","last_unstale":"2023-05-10T04:20:54.946855+0000","last_undegraded":"2023-05-10T04:20:54.946855+0000","last_fullsized":"2023-05-10T04:20:54.946855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:16:36.949507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979038+0000","last_change":"2023-05-10T04:20:54.975420+0000","last_active":"2023-05-10T04:20:54.979038+0000","last_peered":"2023-05-10T04:20:54.979038+0000","last_clean":"2023-05-10T04:20:54.979038+0000","last_became_active":"2023-05-10T04:20:54.972308+0000","last_became_peered":"2023-05-10T04:20:54.972308+0000","last_unstale":"2023-05-10T04:20:54.979038+0000","last_undegraded":"2023-05-10T04:20:54.979038+0000","last_fullsized":"2023-05-10T04:20:54.979038+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:52:13.147526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.7","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.971115+0000","last_change":"2023-05-10T04:20:54.477385+0000","last_active":"2023-05-10T04:20:54.971115+0000","last_peered":"2023-05-10T04:20:54.971115+0000","last_clean":"2023-05-10T04:20:54.971115+0000","last_became_active":"2023-05-10T04:20:54.477126+0000","last_became_peered":"2023-05-10T04:20:54.477126+0000","last_unstale":"2023-05-10T04:20:54.971115+0000","last_undegraded":"2023-05-10T04:20:54.971115+0000","last_fullsized":"2023-05-10T04:20:54.971115+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:17:54.407052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.942885+0000","last_change":"2023-05-10T04:19:04.443331+0000","last_active":"2023-05-10T04:20:54.942885+0000","last_peered":"2023-05-10T04:20:54.942885+0000","last_clean":"2023-05-10T04:20:54.942885+0000","last_became_active":"2023-05-10T04:19:04.443060+0000","last_became_peered":"2023-05-10T04:19:04.443060+0000","last_unstale":"2023-05-10T04:20:54.942885+0000","last_undegraded":"2023-05-10T04:20:54.942885+0000","last_fullsized":"2023-05-10T04:20:54.942885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:11:31.397341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":199,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.949982+0000","last_change":"2023-05-10T04:18:57.192195+0000","last_active":"2023-05-10T04:20:54.949982+0000","last_peered":"2023-05-10T04:20:54.949982+0000","last_clean":"2023-05-10T04:20:54.949982+0000","last_became_active":"2023-05-10T04:18:57.191298+0000","last_became_peered":"2023-05-10T04:18:57.191298+0000","last_unstale":"2023-05-10T04:20:54.949982+0000","last_undegraded":"2023-05-10T04:20:54.949982+0000","last_fullsized":"2023-05-10T04:20:54.949982+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:18:56.172967+0000","last_clean_scrub_stamp":"2023-05-10T04:18:56.172967+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T13:32:17.333292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.979753+0000","last_change":"2023-05-10T04:20:54.976398+0000","last_active":"2023-05-10T04:20:54.979753+0000","last_peered":"2023-05-10T04:20:54.979753+0000","last_clean":"2023-05-10T04:20:54.979753+0000","last_became_active":"2023-05-10T04:20:54.976115+0000","last_became_peered":"2023-05-10T04:20:54.976115+0000","last_unstale":"2023-05-10T04:20:54.979753+0000","last_undegraded":"2023-05-10T04:20:54.979753+0000","last_fullsized":"2023-05-10T04:20:54.979753+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:50:08.206008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.947643+0000","last_change":"2023-05-10T04:20:54.477576+0000","last_active":"2023-05-10T04:20:54.947643+0000","last_peered":"2023-05-10T04:20:54.947643+0000","last_clean":"2023-05-10T04:20:54.947643+0000","last_became_active":"2023-05-10T04:20:54.477327+0000","last_became_peered":"2023-05-10T04:20:54.477327+0000","last_unstale":"2023-05-10T04:20:54.947643+0000","last_undegraded":"2023-05-10T04:20:54.947643+0000","last_fullsized":"2023-05-10T04:20:54.947643+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:54:30.366803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.942737+0000","last_change":"2023-05-10T04:19:04.443785+0000","last_active":"2023-05-10T04:20:54.942737+0000","last_peered":"2023-05-10T04:20:54.942737+0000","last_clean":"2023-05-10T04:20:54.942737+0000","last_became_active":"2023-05-10T04:19:04.443499+0000","last_became_peered":"2023-05-10T04:19:04.443499+0000","last_unstale":"2023-05-10T04:20:54.942737+0000","last_undegraded":"2023-05-10T04:20:54.942737+0000","last_fullsized":"2023-05-10T04:20:54.942737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T16:14:09.836730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.970878+0000","last_change":"2023-05-10T04:20:54.967046+0000","last_active":"2023-05-10T04:20:54.970878+0000","last_peered":"2023-05-10T04:20:54.970878+0000","last_clean":"2023-05-10T04:20:54.970878+0000","last_became_active":"2023-05-10T04:20:54.966787+0000","last_became_peered":"2023-05-10T04:20:54.966787+0000","last_unstale":"2023-05-10T04:20:54.970878+0000","last_undegraded":"2023-05-10T04:20:54.970878+0000","last_fullsized":"2023-05-10T04:20:54.970878+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:07:52.098991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.948188+0000","last_change":"2023-05-10T04:20:54.474021+0000","last_active":"2023-05-10T04:20:54.948188+0000","last_peered":"2023-05-10T04:20:54.948188+0000","last_clean":"2023-05-10T04:20:54.948188+0000","last_became_active":"2023-05-10T04:20:54.473724+0000","last_became_peered":"2023-05-10T04:20:54.473724+0000","last_unstale":"2023-05-10T04:20:54.948188+0000","last_undegraded":"2023-05-10T04:20:54.948188+0000","last_fullsized":"2023-05-10T04:20:54.948188+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:29:52.623321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.944085+0000","last_change":"2023-05-10T04:19:04.442968+0000","last_active":"2023-05-10T04:20:54.944085+0000","last_peered":"2023-05-10T04:20:54.944085+0000","last_clean":"2023-05-10T04:20:54.944085+0000","last_became_active":"2023-05-10T04:19:04.442633+0000","last_became_peered":"2023-05-10T04:19:04.442633+0000","last_unstale":"2023-05-10T04:20:54.944085+0000","last_undegraded":"2023-05-10T04:20:54.944085+0000","last_fullsized":"2023-05-10T04:20:54.944085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:45:40.910809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.978373+0000","last_change":"2023-05-10T04:20:54.972257+0000","last_active":"2023-05-10T04:20:54.978373+0000","last_peered":"2023-05-10T04:20:54.978373+0000","last_clean":"2023-05-10T04:20:54.978373+0000","last_became_active":"2023-05-10T04:20:54.971992+0000","last_became_peered":"2023-05-10T04:20:54.971992+0000","last_unstale":"2023-05-10T04:20:54.978373+0000","last_undegraded":"2023-05-10T04:20:54.978373+0000","last_fullsized":"2023-05-10T04:20:54.978373+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T12:02:09.774899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.943571+0000","last_change":"2023-05-10T04:20:54.468285+0000","last_active":"2023-05-10T04:20:54.943571+0000","last_peered":"2023-05-10T04:20:54.943571+0000","last_clean":"2023-05-10T04:20:54.943571+0000","last_became_active":"2023-05-10T04:20:54.467879+0000","last_became_peered":"2023-05-10T04:20:54.467879+0000","last_unstale":"2023-05-10T04:20:54.943571+0000","last_undegraded":"2023-05-10T04:20:54.943571+0000","last_fullsized":"2023-05-10T04:20:54.943571+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T11:27:55.497922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.581183+0000","last_change":"2023-05-10T04:19:04.440282+0000","last_active":"2023-05-10T04:20:56.581183+0000","last_peered":"2023-05-10T04:20:56.581183+0000","last_clean":"2023-05-10T04:20:56.581183+0000","last_became_active":"2023-05-10T04:19:04.439945+0000","last_became_peered":"2023-05-10T04:19:04.439945+0000","last_unstale":"2023-05-10T04:20:56.581183+0000","last_undegraded":"2023-05-10T04:20:56.581183+0000","last_fullsized":"2023-05-10T04:20:56.581183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T06:40:50.488657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-05-10T04:20:56.580575+0000","last_change":"2023-05-10T04:20:54.954377+0000","last_active":"2023-05-10T04:20:56.580575+0000","last_peered":"2023-05-10T04:20:56.580575+0000","last_clean":"2023-05-10T04:20:56.580575+0000","last_became_active":"2023-05-10T04:20:54.954095+0000","last_became_peered":"2023-05-10T04:20:54.954095+0000","last_unstale":"2023-05-10T04:20:56.580575+0000","last_undegraded":"2023-05-10T04:20:56.580575+0000","last_fullsized":"2023-05-10T04:20:56.580575+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:54.451412+0000","last_clean_scrub_stamp":"2023-05-10T04:20:54.451412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T07:08:11.795303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.957698+0000","last_change":"2023-05-10T04:20:54.482625+0000","last_active":"2023-05-10T04:20:54.957698+0000","last_peered":"2023-05-10T04:20:54.957698+0000","last_clean":"2023-05-10T04:20:54.957698+0000","last_became_active":"2023-05-10T04:20:54.482356+0000","last_became_peered":"2023-05-10T04:20:54.482356+0000","last_unstale":"2023-05-10T04:20:54.957698+0000","last_undegraded":"2023-05-10T04:20:54.957698+0000","last_fullsized":"2023-05-10T04:20:54.957698+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:20:53.448472+0000","last_clean_scrub_stamp":"2023-05-10T04:20:53.448472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T04:51:11.499364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":43,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-05-10T04:20:54.944015+0000","last_change":"2023-05-10T04:19:04.444610+0000","last_active":"2023-05-10T04:20:54.944015+0000","last_peered":"2023-05-10T04:20:54.944015+0000","last_clean":"2023-05-10T04:20:54.944015+0000","last_became_active":"2023-05-10T04:19:04.444273+0000","last_became_peered":"2023-05-10T04:19:04.444273+0000","last_unstale":"2023-05-10T04:20:54.944015+0000","last_undegraded":"2023-05-10T04:20:54.944015+0000","last_fullsized":"2023-05-10T04:20:54.944015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-10T04:19:03.426166+0000","last_clean_scrub_stamp":"2023-05-10T04:19:03.426166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-11T09:54:05.497607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":4,"up_from":16,"seq":68719476764,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8748,"kb_used_data":484,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363092,"statfs":{"total":96636764160,"available":96627806208,"internally_reserved":0,"allocated":495616,"data_stored":210117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.67200000000000004}]},{"osd":1,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.81000000000000005}]},{"osd":2,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.751},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.72299999999999998}]},{"osd":3,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.79300000000000004}]},{"osd":5,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76300000000000001}]},{"osd":6,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58399999999999996}]}]},{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8448,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363392,"statfs":{"total":96636764160,"available":96628113408,"internally_reserved":0,"allocated":450560,"data_stored":194040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.51400000000000001}]},{"osd":1,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":4.4729999999999999,"5min":4.4729999999999999,"15min":4.4729999999999999},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.54800000000000004}]},{"osd":3,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.63}]},{"osd":4,"last update":"Wed May 10 04:20:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.877,"5min":0.877,"15min":0.877},"last":0.52500000000000002}]},{"osd":5,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.72099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9604,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362236,"statfs":{"total":96636764160,"available":96626929664,"internally_reserved":0,"allocated":1044480,"data_stored":784408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.314}]},{"osd":2,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.503},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.51000000000000001}]},{"osd":4,"last update":"Wed May 10 04:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.77200000000000002}]},{"osd":5,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.629},{"interface":"front","average":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":4.4459999999999997,"5min":4.4459999999999997,"15min":4.4459999999999997},"last":0.70299999999999996}]},{"osd":6,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.621},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.71299999999999997}]},{"osd":7,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.65500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8500,"kb_used_data":428,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363340,"statfs":{"total":96636764160,"available":96628060160,"internally_reserved":0,"allocated":438272,"data_stored":187092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":3.512,"5min":3.512,"15min":3.512},"last":0.437},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":4.3070000000000004,"5min":4.3070000000000004,"15min":4.3070000000000004},"last":0.376}]},{"osd":2,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1709999999999998,"5min":2.1709999999999998,"15min":2.1709999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":4.1070000000000002,"5min":4.1070000000000002,"15min":4.1070000000000002},"last":0.50900000000000001}]},{"osd":3,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.55400000000000005}]},{"osd":4,"last update":"Wed May 10 04:19:59 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.6190000000000002,"5min":3.6190000000000002,"15min":3.6190000000000002},"last":0.77300000000000002}]},{"osd":5,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":3.6520000000000001,"5min":3.6520000000000001,"15min":3.6520000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.82499999999999996}]},{"osd":6,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":3.8650000000000002,"5min":3.8650000000000002,"15min":3.8650000000000002},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"last":0.78400000000000003}]},{"osd":7,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":3.581,"5min":3.581,"15min":3.581},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"last":0.79800000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8656,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363184,"statfs":{"total":96636764160,"available":96627900416,"internally_reserved":0,"allocated":466944,"data_stored":201578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":4.5860000000000003,"5min":4.5860000000000003,"15min":4.5860000000000003},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":2.8719999999999999,"5min":2.8719999999999999,"15min":2.8719999999999999},"last":0.5}]},{"osd":3,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":4.617,"5min":4.617,"15min":4.617},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.441}]},{"osd":4,"last update":"Wed May 10 04:19:58 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.532,"5min":2.532,"15min":2.532},"last":0.627},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":0.46300000000000002}]},{"osd":5,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.4900000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":0.54600000000000004}]},{"osd":6,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":4.5069999999999997,"5min":4.5069999999999997,"15min":4.5069999999999997},"last":0.62},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.5649999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":2.746,"5min":2.746,"15min":2.746},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":4.5529999999999999,"5min":4.5529999999999999,"15min":4.5529999999999999},"last":0.64800000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8640,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363200,"statfs":{"total":96636764160,"available":96627916800,"internally_reserved":0,"allocated":450560,"data_stored":194040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.51000000000000001}]},{"osd":1,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.58099999999999996}]},{"osd":2,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed May 10 04:20:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.61599999999999999}]},{"osd":5,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.58799999999999997}]},{"osd":6,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.1639999999999999,"5min":1.1639999999999999,"15min":1.1639999999999999},"last":0.69399999999999995}]},{"osd":7,"last update":"Wed May 10 04:19:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.089,"5min":1.089,"15min":1.089},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.873}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9528,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362312,"statfs":{"total":96636764160,"available":96627007488,"internally_reserved":0,"allocated":1032192,"data_stored":777460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.58499999999999996}]},{"osd":1,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.754}]},{"osd":2,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.63},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.61199999999999999}]},{"osd":3,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.72099999999999997}]},{"osd":4,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.74199999999999999}]},{"osd":7,"last update":"Wed May 10 04:19:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8512,"kb_used_data":440,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363328,"statfs":{"total":96636764160,"available":96628047872,"internally_reserved":0,"allocated":450560,"data_stored":194040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70299999999999996}]},{"osd":1,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"last":0.77100000000000002}]},{"osd":2,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.871,"5min":0.871,"15min":0.871},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.72699999999999998}]},{"osd":3,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.627},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.67300000000000004}]},{"osd":4,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.091,"5min":1.091,"15min":1.091},"last":0.81899999999999995}]},{"osd":5,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.752},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.79100000000000004}]},{"osd":7,"last update":"Wed May 10 04:20:00 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.85099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-10T04:20:59.738 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-10T04:20:59.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-05-10T04:20:59.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.960+0000 7fe2d0dff700 1 Processor -- start 2023-05-10T04:20:59.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.960+0000 7fe2d0dff700 1 -- start start 2023-05-10T04:20:59.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.961+0000 7fe2d0dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fe2cc1589d0 0x7fe2cc0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.961+0000 7fe2d0dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc06cdd0 0x7fe2cc06a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.961+0000 7fe2d0dff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2cc0ca890 con 0x7fe2cc0cd690 2023-05-10T04:20:59.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.961+0000 7fe2d0dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc0ca5b0 con 0x7fe2cc1589d0 2023-05-10T04:20:59.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.961+0000 7fe2d0dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0cc670 con 0x7fe2cc06cdd0 2023-05-10T04:20:59.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2cad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc06cdd0 0x7fe2cc06a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2c9d9b700 1 --1- >> v1:172.21.15.154:6789/0 conn(0x7fe2cc0cd690 0x7fe2cc06c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.154:6789/0 says I am v1:172.21.15.132:54006/0 (socket says 172.21.15.132:54006) 2023-05-10T04:20:59.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2cad9d700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc06cdd0 0x7fe2cc06a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.154:3301/0 says I am v2:172.21.15.132:38598/0 (socket says 172.21.15.132:38598) 2023-05-10T04:20:59.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2c9d9b700 1 -- 172.21.15.132:0/1428539931 learned_addr learned my addr 172.21.15.132:0/1428539931 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:20:59.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2ca59c700 1 --2- 172.21.15.132:0/1428539931 >> v2:172.21.15.154:3300/0 conn(0x7fe2cc1589d0 0x7fe2cc0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2cad9d700 1 -- 172.21.15.132:0/1428539931 >> v2:172.21.15.154:3300/0 conn(0x7fe2cc1589d0 msgr2=0x7fe2cc0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:20:59.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2cad9d700 1 --2- 172.21.15.132:0/1428539931 >> v2:172.21.15.154:3300/0 conn(0x7fe2cc1589d0 0x7fe2cc0cd150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2cad9d700 1 -- 172.21.15.132:0/1428539931 >> v1:172.21.15.154:6789/0 conn(0x7fe2cc0cd690 legacy=0x7fe2cc06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2cad9d700 1 -- 172.21.15.132:0/1428539931 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0cc950 con 0x7fe2cc06cdd0 2023-05-10T04:20:59.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.962+0000 7fe2ca59c700 1 --2- 172.21.15.132:0/1428539931 >> v2:172.21.15.154:3300/0 conn(0x7fe2cc1589d0 0x7fe2cc0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:20:59.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.963+0000 7fe2cad9d700 1 --2- 172.21.15.132:0/1428539931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc06cdd0 0x7fe2cc06a3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400bfa0 tx=0x7fe2c400d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9876e2c068687514 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.963+0000 7fe2c959a700 1 -- 172.21.15.132:0/1428539931 <== mon.2 v2:172.21.15.154:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c4010070 con 0x7fe2cc06cdd0 2023-05-10T04:20:59.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2c959a700 1 -- 172.21.15.132:0/1428539931 <== mon.2 v2:172.21.15.154:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c400b2e0 con 0x7fe2cc06cdd0 2023-05-10T04:20:59.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2c959a700 1 -- 172.21.15.132:0/1428539931 <== mon.2 v2:172.21.15.154:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c400dc40 con 0x7fe2cc06cdd0 2023-05-10T04:20:59.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2d0dff700 1 -- 172.21.15.132:0/1428539931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc06cdd0 msgr2=0x7fe2cc06a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/1428539931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc06cdd0 0x7fe2cc06a3e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe2c400bfa0 tx=0x7fe2c400d330 comp rx=0 tx=0).stop 2023-05-10T04:20:59.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2d0dff700 1 -- 172.21.15.132:0/1428539931 shutdown_connections 2023-05-10T04:20:59.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/1428539931 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc06cdd0 0x7fe2cc06a3e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/1428539931 >> v2:172.21.15.154:3300/0 conn(0x7fe2cc1589d0 0x7fe2cc0cd150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2d0dff700 1 -- 172.21.15.132:0/1428539931 >> 172.21.15.132:0/1428539931 conn(0x7fe2cc0cf720 msgr2=0x7fe2cc0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:20:59.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.966+0000 7fe2d0dff700 1 -- 172.21.15.132:0/1428539931 shutdown_connections 2023-05-10T04:20:59.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.967+0000 7fe2d0dff700 1 -- 172.21.15.132:0/1428539931 wait complete. 2023-05-10T04:20:59.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.968+0000 7fe2d0dff700 1 Processor -- start 2023-05-10T04:20:59.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.968+0000 7fe2d0dff700 1 -- start start 2023-05-10T04:20:59.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.969+0000 7fe2d0dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc06cdd0 0x7fe2cc14dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.969+0000 7fe2d0dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2cc0cd690 0x7fe2cc0c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.969+0000 7fe2d0dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc1589d0 0x7fe2cc14d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.969+0000 7fe2d0dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0c7710 con 0x7fe2cc0cd690 2023-05-10T04:20:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.969+0000 7fe2d0dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0c7ee0 con 0x7fe2cc06cdd0 2023-05-10T04:20:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.969+0000 7fe2d0dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0c7920 con 0x7fe2cc1589d0 2023-05-10T04:20:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2cc0cd690 0x7fe2cc0c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2cc0cd690 0x7fe2cc0c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42718/0 (socket says 172.21.15.132:42718) 2023-05-10T04:20:59.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 -- 172.21.15.132:0/2739485445 learned_addr learned my addr 172.21.15.132:0/2739485445 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:20:59.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2ca59c700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc06cdd0 0x7fe2cc14dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2cad9d700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc1589d0 0x7fe2cc14d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 -- 172.21.15.132:0/2739485445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc1589d0 msgr2=0x7fe2cc14d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc1589d0 0x7fe2cc14d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 -- 172.21.15.132:0/2739485445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc06cdd0 msgr2=0x7fe2cc14dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:20:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc06cdd0 0x7fe2cc14dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:20:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 -- 172.21.15.132:0/2739485445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc0094a0 con 0x7fe2cc0cd690 2023-05-10T04:20:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.970+0000 7fe2c9d9b700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2cc0cd690 0x7fe2cc0c71d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c520 tx=0x7fe2c000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.973+0000 7fe2baffd700 1 -- 172.21.15.132:0/2739485445 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0005dc0 con 0x7fe2cc0cd690 2023-05-10T04:20:59.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.973+0000 7fe2baffd700 1 -- 172.21.15.132:0/2739485445 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c00070d0 con 0x7fe2cc0cd690 2023-05-10T04:20:59.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.973+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c400bc80 con 0x7fe2cc0cd690 2023-05-10T04:20:59.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.973+0000 7fe2baffd700 1 -- 172.21.15.132:0/2739485445 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0007460 con 0x7fe2cc0cd690 2023-05-10T04:20:59.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.973+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc158da0 con 0x7fe2cc0cd690 2023-05-10T04:20:59.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.974+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc0ccc30 con 0x7fe2cc0cd690 2023-05-10T04:20:59.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.975+0000 7fe2baffd700 1 -- 172.21.15.132:0/2739485445 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe2c00075c0 con 0x7fe2cc0cd690 2023-05-10T04:20:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.975+0000 7fe2baffd700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2ac06ace0 0x7fe2ac06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:20:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.976+0000 7fe2baffd700 1 -- 172.21.15.132:0/2739485445 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe2c0088ad0 con 0x7fe2cc0cd690 2023-05-10T04:20:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.976+0000 7fe2ca59c700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2ac06ace0 0x7fe2ac06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:20:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.976+0000 7fe2ca59c700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2ac06ace0 0x7fe2ac06d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc1f6080 tx=0x7fe2bc009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:20:59.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:20:59.980+0000 7fe2baffd700 1 -- 172.21.15.132:0/2739485445 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe2c00539a0 con 0x7fe2cc0cd690 2023-05-10T04:21:00.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.251+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe2cc158f30 con 0x7fe2cc0cd690 2023-05-10T04:21:00.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.257+0000 7fe2baffd700 1 -- 172.21.15.132:0/2739485445 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe2c0056fc0 con 0x7fe2cc0cd690 2023-05-10T04:21:00.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2ac06ace0 msgr2=0x7fe2ac06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2ac06ace0 0x7fe2ac06d190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc1f6080 tx=0x7fe2bc009210 comp rx=0 tx=0).stop 2023-05-10T04:21:00.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2cc0cd690 msgr2=0x7fe2cc0c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2cc0cd690 0x7fe2cc0c71d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c520 tx=0x7fe2c000c830 comp rx=0 tx=0).stop 2023-05-10T04:21:00.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 shutdown_connections 2023-05-10T04:21:00.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe2ac06ace0 0x7fe2ac06d190 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe2cc1589d0 0x7fe2cc14d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe2cc06cdd0 0x7fe2cc14dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 --2- 172.21.15.132:0/2739485445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2cc0cd690 0x7fe2cc0c71d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 >> 172.21.15.132:0/2739485445 conn(0x7fe2cc0cf720 msgr2=0x7fe2cc0af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:00.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 shutdown_connections 2023-05-10T04:21:00.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.260+0000 7fe2d0dff700 1 -- 172.21.15.132:0/2739485445 wait complete. 2023-05-10T04:21:00.264 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-05-10T04:21:00.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-10T04:21:00.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.461+0000 7fe9477ff700 1 Processor -- start 2023-05-10T04:21:00.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.461+0000 7fe9477ff700 1 -- start start 2023-05-10T04:21:00.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.462+0000 7fe9477ff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9400b87a0 0x7fe9400cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:00.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.462+0000 7fe9477ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9400cdc60 con 0x7fe940160d40 2023-05-10T04:21:00.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.462+0000 7fe9477ff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9400cd6a0 con 0x7fe9401601e0 2023-05-10T04:21:00.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.462+0000 7fe9477ff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9400d02d0 con 0x7fe9400b87a0 2023-05-10T04:21:00.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.462+0000 7fe94559b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9400b87a0 0x7fe9400cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:00.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.462+0000 7fe945d9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe940160d40 0x7fe9400d1100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35904/0 (socket says 172.21.15.132:35904) 2023-05-10T04:21:00.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe945d9c700 1 -- 172.21.15.132:0/1412810165 learned_addr learned my addr 172.21.15.132:0/1412810165 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:21:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe937fff700 1 -- 172.21.15.132:0/1412810165 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114374249 0 0) 0x7fe9400cdc60 con 0x7fe940160d40 2023-05-10T04:21:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe94559b700 1 -- 172.21.15.132:0/1412810165 >> v1:172.21.15.154:6789/0 conn(0x7fe9401601e0 legacy=0x7fe940160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe94559b700 1 -- 172.21.15.132:0/1412810165 >> v1:172.21.15.132:6789/0 conn(0x7fe940160d40 legacy=0x7fe9400d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe94559b700 1 -- 172.21.15.132:0/1412810165 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9400cd980 con 0x7fe9400b87a0 2023-05-10T04:21:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe94559b700 1 --2- 172.21.15.132:0/1412810165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9400b87a0 0x7fe9400cfbf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009840 tx=0x7fe93c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cec8b03478513f6 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe937fff700 1 -- 172.21.15.132:0/1412810165 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c011830 con 0x7fe9400b87a0 2023-05-10T04:21:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe937fff700 1 -- 172.21.15.132:0/1412810165 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93c011990 con 0x7fe9400b87a0 2023-05-10T04:21:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.463+0000 7fe937fff700 1 -- 172.21.15.132:0/1412810165 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93c011d20 con 0x7fe9400b87a0 2023-05-10T04:21:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.464+0000 7fe9477ff700 1 -- 172.21.15.132:0/1412810165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9400b87a0 msgr2=0x7fe9400cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.464+0000 7fe9477ff700 1 --2- 172.21.15.132:0/1412810165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9400b87a0 0x7fe9400cfbf0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe93c009840 tx=0x7fe93c009b50 comp rx=0 tx=0).stop 2023-05-10T04:21:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.464+0000 7fe9477ff700 1 -- 172.21.15.132:0/1412810165 shutdown_connections 2023-05-10T04:21:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.464+0000 7fe9477ff700 1 --2- 172.21.15.132:0/1412810165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9400b87a0 0x7fe9400cfbf0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.464+0000 7fe9477ff700 1 -- 172.21.15.132:0/1412810165 >> 172.21.15.132:0/1412810165 conn(0x7fe940071b10 msgr2=0x7fe940071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.464+0000 7fe9477ff700 1 -- 172.21.15.132:0/1412810165 shutdown_connections 2023-05-10T04:21:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.464+0000 7fe9477ff700 1 -- 172.21.15.132:0/1412810165 wait complete. 2023-05-10T04:21:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.466+0000 7fe9477ff700 1 Processor -- start 2023-05-10T04:21:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.466+0000 7fe9477ff700 1 -- start start 2023-05-10T04:21:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe9477ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9400b87a0 0x7fe94015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe9477ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9401601e0 0x7fe9400c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe9477ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940160d40 0x7fe9400c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe9477ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400c9f80 con 0x7fe940160d40 2023-05-10T04:21:00.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe9477ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9400ca820 con 0x7fe9400b87a0 2023-05-10T04:21:00.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe9477ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9401f2fb0 con 0x7fe9401601e0 2023-05-10T04:21:00.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe945d9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940160d40 0x7fe9400c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:00.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe945d9c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940160d40 0x7fe9400c8aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42726/0 (socket says 172.21.15.132:42726) 2023-05-10T04:21:00.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe945d9c700 1 -- 172.21.15.132:0/1365812070 learned_addr learned my addr 172.21.15.132:0/1365812070 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:00.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe94559b700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9400b87a0 0x7fe94015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:00.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe944d9a700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9401601e0 0x7fe9400c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe945d9c700 1 -- 172.21.15.132:0/1365812070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9401601e0 msgr2=0x7fe9400c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe945d9c700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9401601e0 0x7fe9400c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe945d9c700 1 -- 172.21.15.132:0/1365812070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9400b87a0 msgr2=0x7fe94015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe945d9c700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9400b87a0 0x7fe94015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.467+0000 7fe945d9c700 1 -- 172.21.15.132:0/1365812070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c0094a0 con 0x7fe940160d40 2023-05-10T04:21:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.468+0000 7fe945d9c700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940160d40 0x7fe9400c8aa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe93800cbd0 tx=0x7fe93800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.468+0000 7fe935ffb700 1 -- 172.21.15.132:0/1365812070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe93800ab70 con 0x7fe940160d40 2023-05-10T04:21:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.468+0000 7fe935ffb700 1 -- 172.21.15.132:0/1365812070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93800acf0 con 0x7fe940160d40 2023-05-10T04:21:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.468+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9400d19a0 con 0x7fe940160d40 2023-05-10T04:21:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.468+0000 7fe935ffb700 1 -- 172.21.15.132:0/1365812070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe938007310 con 0x7fe940160d40 2023-05-10T04:21:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.468+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9400d1810 con 0x7fe940160d40 2023-05-10T04:21:00.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.469+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9400d1b30 con 0x7fe940160d40 2023-05-10T04:21:00.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.470+0000 7fe935ffb700 1 -- 172.21.15.132:0/1365812070 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe938007470 con 0x7fe940160d40 2023-05-10T04:21:00.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.471+0000 7fe935ffb700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe92406ace0 0x7fe92406d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:00.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.471+0000 7fe935ffb700 1 -- 172.21.15.132:0/1365812070 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fe938089430 con 0x7fe940160d40 2023-05-10T04:21:00.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.471+0000 7fe94559b700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe92406ace0 0x7fe92406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:00.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.472+0000 7fe94559b700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe92406ace0 0x7fe92406d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe9400c99d0 tx=0x7fe93c01c040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:00.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.475+0000 7fe935ffb700 1 -- 172.21.15.132:0/1365812070 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fe938054390 con 0x7fe940160d40 2023-05-10T04:21:00.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.710+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe9400ca960 con 0x7fe940160d40 2023-05-10T04:21:00.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.710+0000 7fe935ffb700 1 -- 172.21.15.132:0/1365812070 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4680 (secure 0 0 0) 0x7fe93800ae60 con 0x7fe940160d40 2023-05-10T04:21:00.713 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:21:00.713 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5407,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6834/3576545090","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6832","nonce":3576545090},{"type":"v1","addr":"172.21.15.154:6834","nonce":3576545090}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5410,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.154:6835/1200014464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:6833","nonce":1200014464},{"type":"v1","addr":"172.21.15.154:6835","nonce":1200014464}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5517,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/130175157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":130175157},{"type":"v1","addr":"172.21.15.132:6835","nonce":130175157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-10T04:20:54.936636+0000","modified":"2023-05-10T04:20:57.951378+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5526},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5526":{"gid":5526,"name":"c","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.132:6837/1800881311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":1800881311},{"type":"v1","addr":"172.21.15.132:6837","nonce":1800881311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-10T04:21:00.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe92406ace0 msgr2=0x7fe92406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe92406ace0 0x7fe92406d190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe9400c99d0 tx=0x7fe93c01c040 comp rx=0 tx=0).stop 2023-05-10T04:21:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940160d40 msgr2=0x7fe9400c8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940160d40 0x7fe9400c8aa0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fe93800cbd0 tx=0x7fe93800cf90 comp rx=0 tx=0).stop 2023-05-10T04:21:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 shutdown_connections 2023-05-10T04:21:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fe92406ace0 0x7fe92406d190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe940160d40 0x7fe9400c8aa0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fe9400b87a0 0x7fe94015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 --2- 172.21.15.132:0/1365812070 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fe9401601e0 0x7fe9400c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 >> 172.21.15.132:0/1365812070 conn(0x7fe940071b10 msgr2=0x7fe9400cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 shutdown_connections 2023-05-10T04:21:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:00.713+0000 7fe9477ff700 1 -- 172.21.15.132:0/1365812070 wait complete. 2023-05-10T04:21:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 17 2023-05-10T04:21:01.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-10T04:20:54.936636+0000', 'modified': '2023-05-10T04:20:57.951378+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5526}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5526': {'gid': 5526, 'name': 'c', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.132:6837/1800881311', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6836', 'nonce': 1800881311}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 1800881311}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-10T04:21:01.135 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-10T04:21:01.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-10T04:21:01.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.321+0000 7feededff700 1 Processor -- start 2023-05-10T04:21:01.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.321+0000 7feededff700 1 -- start start 2023-05-10T04:21:01.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.322+0000 7feededff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7feed815c590 0x7feed8160b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.322+0000 7feededff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed80cd520 con 0x7feed80cf010 2023-05-10T04:21:01.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.322+0000 7feededff700 1 -- --> v1:172.21.15.154:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feed80d2640 con 0x7feed80cff50 2023-05-10T04:21:01.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.322+0000 7feededff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feed81610d0 con 0x7feed815c590 2023-05-10T04:21:01.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.322+0000 7feed7fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feed80cf010 0x7feed80cf840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35914/0 (socket says 172.21.15.132:35914) 2023-05-10T04:21:01.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.322+0000 7feed7fff700 1 -- 172.21.15.132:0/1134790705 learned_addr learned my addr 172.21.15.132:0/1134790705 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:21:01.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feedcb9b700 1 --2- 172.21.15.132:0/1134790705 >> v2:172.21.15.154:3300/0 conn(0x7feed815c590 0x7feed8160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080857888 0 0) 0x7feed80cd520 con 0x7feed80cf010 2023-05-10T04:21:01.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec80035b0 con 0x7feed80cf010 2023-05-10T04:21:01.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 <== mon.1 v1:172.21.15.154:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738447203 0 0) 0x7feed80d2640 con 0x7feed80cff50 2023-05-10T04:21:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 --> v1:172.21.15.154:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed80cd520 con 0x7feed80cff50 2023-05-10T04:21:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3403517414 0 0) 0x7feec80035b0 con 0x7feed80cf010 2023-05-10T04:21:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 >> v2:172.21.15.154:3300/0 conn(0x7feed815c590 msgr2=0x7feed8160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 --2- 172.21.15.132:0/1134790705 >> v2:172.21.15.154:3300/0 conn(0x7feed815c590 0x7feed8160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 >> v1:172.21.15.154:6789/0 conn(0x7feed80cff50 legacy=0x7feed80d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80b23c0 con 0x7feed80cf010 2023-05-10T04:21:01.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1195258634 0 0) 0x7feec4001670 con 0x7feed80cf010 2023-05-10T04:21:01.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 >> v1:172.21.15.132:6789/0 conn(0x7feed80cf010 legacy=0x7feed80cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec8003be0 0x7feec8003fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8004850 0x7feec8004cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec8005200 0x7feec800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed81610d0 con 0x7feec8005200 2023-05-10T04:21:01.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec800c0e0 con 0x7feec8003be0 2023-05-10T04:21:01.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.323+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec800c270 con 0x7feec8004850 2023-05-10T04:21:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedd39c700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec8005200 0x7feec800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedcb9b700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec8003be0 0x7feec8003fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feed7fff700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8004850 0x7feec8004cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedd39c700 1 -- 172.21.15.132:0/1134790705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8004850 msgr2=0x7feec8004cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedd39c700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8004850 0x7feec8004cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedd39c700 1 -- 172.21.15.132:0/1134790705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec8003be0 msgr2=0x7feec8003fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedd39c700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feec8003be0 0x7feec8003fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedd39c700 1 -- 172.21.15.132:0/1134790705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80035b0 con 0x7feec8005200 2023-05-10T04:21:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedd39c700 1 -- 172.21.15.132:0/1134790705 reap_dead start 2023-05-10T04:21:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.324+0000 7feedd39c700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec8005200 0x7feec800ba10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feed0002230 tx=0x7feec8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f836d07acc8b054c server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0001f30 con 0x7feec8005200 2023-05-10T04:21:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed000ce80 con 0x7feec8005200 2023-05-10T04:21:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feed77fe700 1 -- 172.21.15.132:0/1134790705 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0003c40 con 0x7feec8005200 2023-05-10T04:21:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feededff700 1 -- 172.21.15.132:0/1134790705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec8005200 msgr2=0x7feec800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feededff700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec8005200 0x7feec800ba10 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7feed0002230 tx=0x7feec8005880 comp rx=0 tx=0).stop 2023-05-10T04:21:01.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feededff700 1 -- 172.21.15.132:0/1134790705 shutdown_connections 2023-05-10T04:21:01.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feededff700 1 --2- 172.21.15.132:0/1134790705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec8005200 0x7feec800ba10 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feededff700 1 -- 172.21.15.132:0/1134790705 >> 172.21.15.132:0/1134790705 conn(0x7feed8071b10 msgr2=0x7feed8071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:01.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feededff700 1 -- 172.21.15.132:0/1134790705 shutdown_connections 2023-05-10T04:21:01.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.325+0000 7feededff700 1 -- 172.21.15.132:0/1134790705 wait complete. 2023-05-10T04:21:01.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.327+0000 7feededff700 1 Processor -- start 2023-05-10T04:21:01.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.327+0000 7feededff700 1 -- start start 2023-05-10T04:21:01.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feededff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8005200 0x7feed81512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feededff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feed80b8420 0x7feed80b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feededff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feed815ce10 0x7feed815d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feededff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed80b8dd0 con 0x7feed80b8420 2023-05-10T04:21:01.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feededff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed815e140 con 0x7feed815ce10 2023-05-10T04:21:01.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feededff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed815db80 con 0x7feec8005200 2023-05-10T04:21:01.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feed7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feed80b8420 0x7feed80b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feed7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feed80b8420 0x7feed80b8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42758/0 (socket says 172.21.15.132:42758) 2023-05-10T04:21:01.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feed7fff700 1 -- 172.21.15.132:0/4265367778 learned_addr learned my addr 172.21.15.132:0/4265367778 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:01.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feedcb9b700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8005200 0x7feed81512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.328+0000 7feedd39c700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feed815ce10 0x7feed815d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed7fff700 1 -- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8005200 msgr2=0x7feed81512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed7fff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8005200 0x7feed81512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed7fff700 1 -- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feed815ce10 msgr2=0x7feed815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed7fff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feed815ce10 0x7feed815d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed7fff700 1 -- 172.21.15.132:0/4265367778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed80cd770 con 0x7feed80b8420 2023-05-10T04:21:01.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feedd39c700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feed815ce10 0x7feed815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:21:01.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed7fff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feed80b8420 0x7feed80b8890 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7feec4004f30 tx=0x7feec40073f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed57fa700 1 -- 172.21.15.132:0/4265367778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4012560 con 0x7feed80b8420 2023-05-10T04:21:01.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed57fa700 1 -- 172.21.15.132:0/4265367778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec40126e0 con 0x7feed80b8420 2023-05-10T04:21:01.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feededff700 1 -- 172.21.15.132:0/4265367778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed80cf560 con 0x7feed80b8420 2023-05-10T04:21:01.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feed57fa700 1 -- 172.21.15.132:0/4265367778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4012a90 con 0x7feed80b8420 2023-05-10T04:21:01.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.329+0000 7feededff700 1 -- 172.21.15.132:0/4265367778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed815c960 con 0x7feed80b8420 2023-05-10T04:21:01.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.331+0000 7feed57fa700 1 -- 172.21.15.132:0/4265367778 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feec4012bf0 con 0x7feed80b8420 2023-05-10T04:21:01.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.332+0000 7feed57fa700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feebc06ace0 0x7feebc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.332+0000 7feed57fa700 1 -- 172.21.15.132:0/4265367778 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feec4089600 con 0x7feed80b8420 2023-05-10T04:21:01.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.332+0000 7feedcb9b700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feebc06ace0 0x7feebc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.333+0000 7feedcb9b700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feebc06ace0 0x7feebc06d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feecc009be0 tx=0x7feecc009210 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.334+0000 7feef2783b80 1 Processor -- start 2023-05-10T04:21:01.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.334+0000 7feef2783b80 1 -- start start 2023-05-10T04:21:01.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.335+0000 7feef2783b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92c911b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.335+0000 7feef2783b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92cbcff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.335+0000 7feef2783b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92cc0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.335+0000 7feef2783b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a92b9b010 con 0x559a92cbfdc0 2023-05-10T04:21:01.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.335+0000 7feef2783b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a92bed850 con 0x559a92c934a0 2023-05-10T04:21:01.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.335+0000 7feef2783b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a92be6ce0 con 0x559a92cb5210 2023-05-10T04:21:01.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92cc0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92cc0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42762/0 (socket says 172.21.15.132:42762) 2023-05-10T04:21:01.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 -- 172.21.15.132:0/1105972770 learned_addr learned my addr 172.21.15.132:0/1105972770 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:01.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedcb9b700 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92c911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feed7fff700 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92cbcff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 -- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 msgr2=0x559a92c911b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92c911b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 -- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 msgr2=0x559a92cbcff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92cbcff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 -- 172.21.15.132:0/1105972770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a92a685e0 con 0x559a92cbfdc0 2023-05-10T04:21:01.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedcb9b700 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92c911b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:21:01.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feedd39c700 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92cc0230 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7feed80d1d20 tx=0x7feed0009030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbc99d1ef3bb161 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feec27fc700 1 -- 172.21.15.132:0/1105972770 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed000ce60 con 0x559a92cbfdc0 2023-05-10T04:21:01.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.336+0000 7feec27fc700 1 -- 172.21.15.132:0/1105972770 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0003a00 con 0x559a92cbfdc0 2023-05-10T04:21:01.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feec27fc700 1 -- 172.21.15.132:0/1105972770 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0003db0 con 0x559a92cbfdc0 2023-05-10T04:21:01.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 -- 172.21.15.132:0/1105972770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 msgr2=0x559a92cc0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92cc0230 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7feed80d1d20 tx=0x7feed0009030 comp rx=0 tx=0).stop 2023-05-10T04:21:01.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 -- 172.21.15.132:0/1105972770 shutdown_connections 2023-05-10T04:21:01.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92cc0230 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92c911b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 --2- 172.21.15.132:0/1105972770 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92cbcff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 -- 172.21.15.132:0/1105972770 >> 172.21.15.132:0/1105972770 conn(0x559a92c8aba0 msgr2=0x559a92cdadc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:01.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 -- 172.21.15.132:0/1105972770 shutdown_connections 2023-05-10T04:21:01.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.337+0000 7feef2783b80 1 -- 172.21.15.132:0/1105972770 wait complete. 2023-05-10T04:21:01.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.338+0000 7feef2783b80 1 -- start start 2023-05-10T04:21:01.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.338+0000 7feef2783b80 1 Processor -- start 2023-05-10T04:21:01.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.339+0000 7feef2783b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92c934a0 0x559a92cafde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.339+0000 7feef2783b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cb5210 0x559a92cb3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.339+0000 7feef2783b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92c8ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.339+0000 7feef2783b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a92b88890 con 0x559a92cbfdc0 2023-05-10T04:21:01.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.339+0000 7feef2783b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a92b88530 con 0x559a92cb5210 2023-05-10T04:21:01.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.339+0000 7feef2783b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a92a6a8d0 con 0x559a92c934a0 2023-05-10T04:21:01.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.339+0000 7feef2783b80 10 client.0 _ll_register_callbacks cb 0x559a92ba6730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T04:21:01.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.339+0000 7feedd39c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92c8ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedd39c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92c8ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42772/0 (socket says 172.21.15.132:42772) 2023-05-10T04:21:01.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedd39c700 1 -- 172.21.15.132:0/277843588 learned_addr learned my addr 172.21.15.132:0/277843588 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:01.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedcb9b700 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92c934a0 0x559a92cafde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feed7fff700 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cb5210 0x559a92cb3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedd39c700 1 -- 172.21.15.132:0/277843588 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92c934a0 msgr2=0x559a92cafde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedd39c700 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92c934a0 0x559a92cafde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedd39c700 1 -- 172.21.15.132:0/277843588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cb5210 msgr2=0x559a92cb3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedd39c700 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cb5210 0x559a92cb3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedd39c700 1 -- 172.21.15.132:0/277843588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80035b0 con 0x559a92cbfdc0 2023-05-10T04:21:01.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feedd39c700 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92c8ed90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7feed000ce90 tx=0x7feed000f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633c86432834c667 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feeb77fe700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-05-10T04:21:01.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feeb77fe700 1 -- 172.21.15.132:0/277843588 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed0005050 con 0x559a92cbfdc0 2023-05-10T04:21:01.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feeb77fe700 1 -- 172.21.15.132:0/277843588 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feed001f980 con 0x559a92cbfdc0 2023-05-10T04:21:01.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.340+0000 7feef2783b80 1 -- 172.21.15.132:0/277843588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a92c88360 con 0x559a92cbfdc0 2023-05-10T04:21:01.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feeb77fe700 1 -- 172.21.15.132:0/277843588 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feed001fb40 con 0x559a92cbfdc0 2023-05-10T04:21:01.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feef2783b80 10 client.5700 fetch_fsmap learned FSMap version 17 2023-05-10T04:21:01.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feef2783b80 1 -- 172.21.15.132:0/277843588 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559a92bad140 con 0x559a92cbfdc0 2023-05-10T04:21:01.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feeb77fe700 1 -- 172.21.15.132:0/277843588 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed0036070 con 0x559a92cbfdc0 2023-05-10T04:21:01.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feeb77fe700 1 -- 172.21.15.132:0/277843588 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7feed001a050 con 0x559a92cbfdc0 2023-05-10T04:21:01.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feef2783b80 10 client.5700 fetch_fsmap finished waiting for FSMap version 17 2023-05-10T04:21:01.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feef2783b80 10 client.5700 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-10T04:21:01.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feef2783b80 20 client.5700 populate_metadata read hostname 'smithi132' 2023-05-10T04:21:01.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feef2783b80 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] conn(0x559a92ce9530 0x559a92ce9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feef2783b80 4 client.5700 mds_command: new command op to 5526 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-10T04:21:01.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feef2783b80 1 -- 172.21.15.132:0/277843588 --> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a92ba9050 con 0x559a92ce9530 2023-05-10T04:21:01.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.341+0000 7feedcb9b700 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] conn(0x559a92ce9530 0x559a92ce9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.342+0000 7feeb77fe700 10 client.5700 ms_handle_connect on v2:172.21.15.132:6836/1800881311 2023-05-10T04:21:01.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.342+0000 7feedcb9b700 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] conn(0x559a92ce9530 0x559a92ce9900 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12385a881aa1f07 server_cookie=4d7cfde25c0da10e in_seq=0 out_seq=0 2023-05-10T04:21:01.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.342+0000 7feeb77fe700 1 -- 172.21.15.132:0/277843588 <== mds.0 v2:172.21.15.132:6836/1800881311 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559a92ba9050 con 0x559a92ce9530 2023-05-10T04:21:01.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.342+0000 7feeb77fe700 10 client.5700 handle_command_reply: tid=0 2023-05-10T04:21:01.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 client.5700 shutdown 2023-05-10T04:21:01.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 -- 172.21.15.132:0/277843588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 msgr2=0x559a92c8ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92c8ed90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7feed000ce90 tx=0x7feed000f000 comp rx=0 tx=0).stop 2023-05-10T04:21:01.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 -- 172.21.15.132:0/277843588 shutdown_connections 2023-05-10T04:21:01.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cbfdc0 0x559a92c8ed90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] conn(0x559a92ce9530 0x559a92ce9900 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92c934a0 0x559a92cafde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 --2- 172.21.15.132:0/277843588 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cb5210 0x559a92cb3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feeb77fe700 0 client.5700 ms_handle_reset on v2:172.21.15.132:6836/1800881311 2023-05-10T04:21:01.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 -- 172.21.15.132:0/277843588 >> 172.21.15.132:0/277843588 conn(0x559a92c8aba0 msgr2=0x559a92cbbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:01.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 -- 172.21.15.132:0/277843588 shutdown_connections 2023-05-10T04:21:01.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 1 -- 172.21.15.132:0/277843588 wait complete. 2023-05-10T04:21:01.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.343+0000 7feef2783b80 20 client.5700 trim_cache size 0 max 16384 2023-05-10T04:21:01.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.361+0000 7feef2783b80 1 Processor -- start 2023-05-10T04:21:01.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.361+0000 7feef2783b80 1 -- start start 2023-05-10T04:21:01.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feef2783b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92c934a0 0x559a92cd9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feef2783b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92cda370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feef2783b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cbfdc0 0x559a92cbdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feef2783b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a92c91d20 con 0x559a92c934a0 2023-05-10T04:21:01.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feef2783b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a92cd92e0 con 0x559a92cbfdc0 2023-05-10T04:21:01.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feef2783b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a92c968b0 con 0x559a92cb5210 2023-05-10T04:21:01.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feedcb9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92c934a0 0x559a92cd9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feedcb9b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92c934a0 0x559a92cd9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42780/0 (socket says 172.21.15.132:42780) 2023-05-10T04:21:01.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.362+0000 7feedcb9b700 1 -- 172.21.15.132:0/3467845744 learned_addr learned my addr 172.21.15.132:0/3467845744 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:01.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feedcb9b700 1 -- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 msgr2=0x559a92cda370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feed7fff700 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92cda370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feedd39c700 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cbfdc0 0x559a92cbdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feedcb9b700 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92cda370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feedcb9b700 1 -- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cbfdc0 msgr2=0x559a92cbdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feedcb9b700 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cbfdc0 0x559a92cbdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feedcb9b700 1 -- 172.21.15.132:0/3467845744 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a92bace90 con 0x559a92c934a0 2023-05-10T04:21:01.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feedd39c700 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cbfdc0 0x559a92cbdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:21:01.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feed7fff700 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92cda370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:21:01.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feedcb9b700 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92c934a0 0x559a92cd9550 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x559a92b88560 tx=0x7feecc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c82adb71cdcb90 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feec2ffd700 1 -- 172.21.15.132:0/3467845744 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc026040 con 0x559a92c934a0 2023-05-10T04:21:01.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feec2ffd700 1 -- 172.21.15.132:0/3467845744 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feecc019070 con 0x559a92c934a0 2023-05-10T04:21:01.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.363+0000 7feec2ffd700 1 -- 172.21.15.132:0/3467845744 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feecc02a780 con 0x559a92c934a0 2023-05-10T04:21:01.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 -- 172.21.15.132:0/3467845744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92c934a0 msgr2=0x559a92cd9550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92c934a0 0x559a92cd9550 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x559a92b88560 tx=0x7feecc017000 comp rx=0 tx=0).stop 2023-05-10T04:21:01.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 -- 172.21.15.132:0/3467845744 shutdown_connections 2023-05-10T04:21:01.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92cbfdc0 0x559a92cbdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92c934a0 0x559a92cd9550 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 --2- 172.21.15.132:0/3467845744 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cb5210 0x559a92cda370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 -- 172.21.15.132:0/3467845744 >> 172.21.15.132:0/3467845744 conn(0x559a92c8aba0 msgr2=0x559a92cafb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:01.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 -- 172.21.15.132:0/3467845744 shutdown_connections 2023-05-10T04:21:01.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.364+0000 7feef2783b80 1 -- 172.21.15.132:0/3467845744 wait complete. 2023-05-10T04:21:01.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.365+0000 7feef2783b80 1 -- start start 2023-05-10T04:21:01.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.365+0000 7feef2783b80 1 Processor -- start 2023-05-10T04:21:01.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feef2783b80 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92d2a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feef2783b80 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cb5210 0x559a92c90000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feef2783b80 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cbfdc0 0x559a92cbf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feef2783b80 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a92cdb670 con 0x559a92cb5210 2023-05-10T04:21:01.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feef2783b80 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a92c90870 con 0x559a92c934a0 2023-05-10T04:21:01.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feef2783b80 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x559a92ced8b0 con 0x559a92cbfdc0 2023-05-10T04:21:01.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feef2783b80 10 client.0 _ll_register_callbacks cb 0x7feec8003740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-10T04:21:01.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cb5210 0x559a92c90000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cb5210 0x559a92c90000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42794/0 (socket says 172.21.15.132:42794) 2023-05-10T04:21:01.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 -- 172.21.15.132:0/1348855013 learned_addr learned my addr 172.21.15.132:0/1348855013 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:01.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feedd39c700 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cbfdc0 0x559a92cbf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feedcb9b700 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92d2a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 -- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cbfdc0 msgr2=0x559a92cbf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cbfdc0 0x559a92cbf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 -- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 msgr2=0x559a92d2a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92d2a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 -- 172.21.15.132:0/1348855013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc014ac0 con 0x559a92cb5210 2023-05-10T04:21:01.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feedcb9b700 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92d2a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:21:01.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feed7fff700 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cb5210 0x559a92c90000 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feec40581e0 tx=0x7feec405c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb7581113138c71 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.367+0000 7feeb77fe700 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-05-10T04:21:01.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feeb77fe700 1 -- 172.21.15.132:0/1348855013 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec40872c0 con 0x559a92cb5210 2023-05-10T04:21:01.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feeb77fe700 1 -- 172.21.15.132:0/1348855013 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7feec4087420 con 0x559a92cb5210 2023-05-10T04:21:01.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 1 -- 172.21.15.132:0/1348855013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a92c97860 con 0x559a92cb5210 2023-05-10T04:21:01.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feeb77fe700 1 -- 172.21.15.132:0/1348855013 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec4060110 con 0x559a92cb5210 2023-05-10T04:21:01.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 10 client.5706 fetch_fsmap learned FSMap version 17 2023-05-10T04:21:01.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 1 -- 172.21.15.132:0/1348855013 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x559a929fdc10 con 0x559a92cb5210 2023-05-10T04:21:01.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feeb77fe700 1 -- 172.21.15.132:0/1348855013 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec407a080 con 0x559a92cb5210 2023-05-10T04:21:01.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feeb77fe700 1 -- 172.21.15.132:0/1348855013 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7feec406fb60 con 0x559a92cb5210 2023-05-10T04:21:01.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 10 client.5706 fetch_fsmap finished waiting for FSMap version 17 2023-05-10T04:21:01.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 10 client.5706 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-10T04:21:01.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 20 client.5706 populate_metadata read hostname 'smithi132' 2023-05-10T04:21:01.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] conn(0x559a92cf4e70 0x559a92cf5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 4 client.5706 mds_command: new command op to 5526 tid=0[{"prefix": "status"}] 2023-05-10T04:21:01.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.368+0000 7feef2783b80 1 -- 172.21.15.132:0/1348855013 --> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7feed0003a00 con 0x559a92cf4e70 2023-05-10T04:21:01.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feedcb9b700 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] conn(0x559a92cf4e70 0x559a92cf5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feedcb9b700 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] conn(0x559a92cf4e70 0x559a92cf5240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a6980f61f7ece18 server_cookie=526d2c70314d8385 in_seq=0 out_seq=0 2023-05-10T04:21:01.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feeb77fe700 10 client.5706 ms_handle_connect on v2:172.21.15.132:6836/1800881311 2023-05-10T04:21:01.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feeb77fe700 1 -- 172.21.15.132:0/1348855013 <== mds.0 v2:172.21.15.132:6836/1800881311 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x7feed0003a00 con 0x559a92cf4e70 2023-05-10T04:21:01.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feeb77fe700 10 client.5706 handle_command_reply: tid=0 2023-05-10T04:21:01.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 client.5706 shutdown 2023-05-10T04:21:01.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 -- 172.21.15.132:0/1348855013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cb5210 msgr2=0x559a92c90000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cb5210 0x559a92c90000 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7feec40581e0 tx=0x7feec405c210 comp rx=0 tx=0).stop 2023-05-10T04:21:01.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 -- 172.21.15.132:0/1348855013 shutdown_connections 2023-05-10T04:21:01.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.132:6836/1800881311,v1:172.21.15.132:6837/1800881311] conn(0x559a92cf4e70 0x559a92cf5240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x559a92cbfdc0 0x559a92cbf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x559a92c934a0 0x559a92d2a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 --2- 172.21.15.132:0/1348855013 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559a92cb5210 0x559a92c90000 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feeb77fe700 0 client.5706 ms_handle_reset on v2:172.21.15.132:6836/1800881311 2023-05-10T04:21:01.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.369+0000 7feef2783b80 1 -- 172.21.15.132:0/1348855013 >> 172.21.15.132:0/1348855013 conn(0x559a92c8aba0 msgr2=0x559a92cafb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:01.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feef2783b80 1 -- 172.21.15.132:0/1348855013 shutdown_connections 2023-05-10T04:21:01.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feef2783b80 1 -- 172.21.15.132:0/1348855013 wait complete. 2023-05-10T04:21:01.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feef2783b80 20 client.5706 trim_cache size 0 max 16384 2023-05-10T04:21:01.380 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-05-10T04:21:01.380 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "390ee88e-3ece-4689-996a-1bc273e3e6b7", 2023-05-10T04:21:01.380 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-05-10T04:21:01.381 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5526, 2023-05-10T04:21:01.381 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-05-10T04:21:01.381 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-05-10T04:21:01.381 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-05-10T04:21:01.381 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 6.4309035120000004, 2023-05-10T04:21:01.381 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 17, 2023-05-10T04:21:01.381 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 41, 2023-05-10T04:21:01.381 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 41, 2023-05-10T04:21:01.382 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 15.342209563999999 2023-05-10T04:21:01.382 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-05-10T04:21:01.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 -- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feebc06ace0 msgr2=0x7feebc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feebc06ace0 0x7feebc06d190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7feecc009be0 tx=0x7feecc009210 comp rx=0 tx=0).stop 2023-05-10T04:21:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 -- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feed80b8420 msgr2=0x7feed80b8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feed80b8420 0x7feed80b8890 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7feec4004f30 tx=0x7feec40073f0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 -- 172.21.15.132:0/4265367778 shutdown_connections 2023-05-10T04:21:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7feebc06ace0 0x7feebc06d190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7feed815ce10 0x7feed815d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7feec8005200 0x7feed81512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 --2- 172.21.15.132:0/4265367778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feed80b8420 0x7feed80b8890 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.370+0000 7feededff700 1 -- 172.21.15.132:0/4265367778 >> 172.21.15.132:0/4265367778 conn(0x7feed8071b10 msgr2=0x7feed80d0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.371+0000 7feededff700 1 -- 172.21.15.132:0/4265367778 shutdown_connections 2023-05-10T04:21:01.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.371+0000 7feededff700 1 -- 172.21.15.132:0/4265367778 wait complete. 2023-05-10T04:21:01.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-10T04:21:01.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.570+0000 7f1c30dff700 1 Processor -- start 2023-05-10T04:21:01.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.570+0000 7f1c30dff700 1 -- start start 2023-05-10T04:21:01.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c30dff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c2c1589d0 0x7f1c2c0cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c30dff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f1c2c0cd690 0x7f1c2c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c30dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 0x7f1c2c06cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c30dff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c0ca890 con 0x7f1c2c1589d0 2023-05-10T04:21:01.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c30dff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c2c0ca5b0 con 0x7f1c2c0cd690 2023-05-10T04:21:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c30dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0cc670 con 0x7f1c2c158da0 2023-05-10T04:21:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c2a59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c2c1589d0 0x7f1c2c0cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c2a59c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c2c1589d0 0x7f1c2c0cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42796/0 (socket says 172.21.15.132:42796) 2023-05-10T04:21:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c2a59c700 1 -- 172.21.15.132:0/1840031553 learned_addr learned my addr 172.21.15.132:0/1840031553 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c29d9b700 1 --2- 172.21.15.132:0/1840031553 >> v2:172.21.15.154:3300/0 conn(0x7f1c2c0cd690 0x7f1c2c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.571+0000 7f1c2ad9d700 1 --2- 172.21.15.132:0/1840031553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 0x7f1c2c06cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2a59c700 1 -- 172.21.15.132:0/1840031553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 msgr2=0x7f1c2c06cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2a59c700 1 --2- 172.21.15.132:0/1840031553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 0x7f1c2c06cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2a59c700 1 -- 172.21.15.132:0/1840031553 >> v2:172.21.15.154:3300/0 conn(0x7f1c2c0cd690 msgr2=0x7f1c2c06c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:01.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2a59c700 1 --2- 172.21.15.132:0/1840031553 >> v2:172.21.15.154:3300/0 conn(0x7f1c2c0cd690 0x7f1c2c06c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2a59c700 1 -- 172.21.15.132:0/1840031553 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0cc950 con 0x7f1c2c1589d0 2023-05-10T04:21:01.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c29d9b700 1 --2- 172.21.15.132:0/1840031553 >> v2:172.21.15.154:3300/0 conn(0x7f1c2c0cd690 0x7f1c2c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-10T04:21:01.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2a59c700 1 --2- 172.21.15.132:0/1840031553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c1589d0 0x7f1c2c0cd150 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c070550 tx=0x7f1c1c00be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c06116bb4adb8ce server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2959a700 1 -- 172.21.15.132:0/1840031553 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c00dc70 con 0x7f1c2c1589d0 2023-05-10T04:21:01.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2959a700 1 -- 172.21.15.132:0/1840031553 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c00ddd0 con 0x7f1c2c1589d0 2023-05-10T04:21:01.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.572+0000 7f1c2959a700 1 -- 172.21.15.132:0/1840031553 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c010690 con 0x7f1c2c1589d0 2023-05-10T04:21:01.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 -- 172.21.15.132:0/1840031553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c1589d0 msgr2=0x7f1c2c0cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1840031553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c1589d0 0x7f1c2c0cd150 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c070550 tx=0x7f1c1c00be70 comp rx=0 tx=0).stop 2023-05-10T04:21:01.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 -- 172.21.15.132:0/1840031553 shutdown_connections 2023-05-10T04:21:01.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1840031553 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 0x7f1c2c06cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1840031553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c1589d0 0x7f1c2c0cd150 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1840031553 >> v2:172.21.15.154:3300/0 conn(0x7f1c2c0cd690 0x7f1c2c06c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 -- 172.21.15.132:0/1840031553 >> 172.21.15.132:0/1840031553 conn(0x7f1c2c0cf720 msgr2=0x7f1c2c0cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:01.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 -- 172.21.15.132:0/1840031553 shutdown_connections 2023-05-10T04:21:01.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.573+0000 7f1c30dff700 1 -- 172.21.15.132:0/1840031553 wait complete. 2023-05-10T04:21:01.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.575+0000 7f1c30dff700 1 Processor -- start 2023-05-10T04:21:01.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.575+0000 7f1c30dff700 1 -- start start 2023-05-10T04:21:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c30dff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c0cd690 0x7f1c2c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c30dff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c1589d0 0x7f1c2c146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c30dff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 0x7f1c2c1e2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c30dff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c0c53d0 con 0x7f1c2c0cd690 2023-05-10T04:21:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c30dff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c151470 con 0x7f1c2c1589d0 2023-05-10T04:21:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c30dff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2c146f70 con 0x7f1c2c158da0 2023-05-10T04:21:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2a59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c0cd690 0x7f1c2c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2a59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c0cd690 0x7f1c2c150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42800/0 (socket says 172.21.15.132:42800) 2023-05-10T04:21:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2a59c700 1 -- 172.21.15.132:0/1975599982 learned_addr learned my addr 172.21.15.132:0/1975599982 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c29d9b700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c1589d0 0x7f1c2c146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2ad9d700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 0x7f1c2c1e2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2a59c700 1 -- 172.21.15.132:0/1975599982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 msgr2=0x7f1c2c1e2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2a59c700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 0x7f1c2c1e2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2a59c700 1 -- 172.21.15.132:0/1975599982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c1589d0 msgr2=0x7f1c2c146a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2a59c700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c1589d0 0x7f1c2c146a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.576+0000 7f1c2a59c700 1 -- 172.21.15.132:0/1975599982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c00b7f0 con 0x7f1c2c0cd690 2023-05-10T04:21:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.577+0000 7f1c2a59c700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c0cd690 0x7f1c2c150f30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00beb0 tx=0x7f1c1c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.577+0000 7f1c1affd700 1 -- 172.21.15.132:0/1975599982 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c003b70 con 0x7f1c2c0cd690 2023-05-10T04:21:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.577+0000 7f1c1affd700 1 -- 172.21.15.132:0/1975599982 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1c003cf0 con 0x7f1c2c0cd690 2023-05-10T04:21:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.577+0000 7f1c1affd700 1 -- 172.21.15.132:0/1975599982 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1c0106b0 con 0x7f1c2c0cd690 2023-05-10T04:21:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.577+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c2c0cbc20 con 0x7f1c2c0cd690 2023-05-10T04:21:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.577+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c2c0ccc30 con 0x7f1c2c0cd690 2023-05-10T04:21:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.578+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c2c0cbdb0 con 0x7f1c2c0cd690 2023-05-10T04:21:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.579+0000 7f1c1affd700 1 -- 172.21.15.132:0/1975599982 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1c1c023440 con 0x7f1c2c0cd690 2023-05-10T04:21:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.580+0000 7f1c1affd700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c0c06ace0 0x7f1c0c06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.580+0000 7f1c1affd700 1 -- 172.21.15.132:0/1975599982 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f1c1c08afe0 con 0x7f1c2c0cd690 2023-05-10T04:21:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.580+0000 7f1c29d9b700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c0c06ace0 0x7f1c0c06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.580+0000 7f1c29d9b700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c0c06ace0 0x7f1c0c06d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1c200099d0 tx=0x7f1c20008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:01.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.584+0000 7f1c1affd700 1 -- 172.21.15.132:0/1975599982 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f1c1c055eb0 con 0x7f1c2c0cd690 2023-05-10T04:21:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.822+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f1c2c074430 con 0x7f1c2c0cd690 2023-05-10T04:21:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.822+0000 7f1c1affd700 1 -- 172.21.15.132:0/1975599982 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f1c1c028070 con 0x7f1c2c0cd690 2023-05-10T04:21:01.825 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-10T04:21:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c0c06ace0 msgr2=0x7f1c0c06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c0c06ace0 0x7f1c0c06d190 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1c200099d0 tx=0x7f1c20008040 comp rx=0 tx=0).stop 2023-05-10T04:21:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c0cd690 msgr2=0x7f1c2c150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c0cd690 0x7f1c2c150f30 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c00beb0 tx=0x7f1c1c004750 comp rx=0 tx=0).stop 2023-05-10T04:21:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 shutdown_connections 2023-05-10T04:21:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f1c0c06ace0 0x7f1c0c06d190 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f1c2c158da0 0x7f1c2c1e2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c2c0cd690 0x7f1c2c150f30 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 --2- 172.21.15.132:0/1975599982 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f1c2c1589d0 0x7f1c2c146a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 >> 172.21.15.132:0/1975599982 conn(0x7f1c2c0cf720 msgr2=0x7f1c2c0aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 shutdown_connections 2023-05-10T04:21:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:01.825+0000 7f1c30dff700 1 -- 172.21.15.132:0/1975599982 wait complete. 2023-05-10T04:21:01.844 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-10T04:21:01.844 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-10T04:21:01.845 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-05-10T04:21:01.846 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-10T04:21:01.846 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-10T04:21:01.846 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-10T04:21:01.846 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-10T04:21:01.847 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-10T04:21:01.847 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T04:21:01.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:01.848 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-05-10T04:21:01.887 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-10T04:21:01.887 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-10T04:21:01.887 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-05-10T04:21:01.887 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:21:01.888 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-05-10T04:21:01.888 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:21:01.888 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:21:01.888 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-05-10T04:21:01.888 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-05-10T04:21:01.888 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:21:01.888 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-05-10T04:21:01.889 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-05-10T04:21:01.889 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-05-10T04:21:01.889 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-05-10T04:21:01.889 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-10T04:21:01.890 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-05-10T04:21:01.890 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-05-10T04:21:01.891 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42081sec preferred_lft 42081sec 2023-05-10T04:21:01.891 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::829d:7347:a1a9:23a0/64 scope link noprefixroute 2023-05-10T04:21:01.891 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:21:01.891 INFO:teuthology.orchestra.run.smithi132.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-10T04:21:01.891 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 2a:41:a2:a8:ee:31 brd ff:ff:ff:ff:ff:ff 2023-05-10T04:21:01.891 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-10T04:21:01.891 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:21:01.892 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::6063:3aff:fec3:e05d/64 scope link 2023-05-10T04:21:01.892 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:21:01.892 INFO:teuthology.orchestra.run.smithi132.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T04:21:01.892 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 2a:41:a2:a8:ee:31 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-10T04:21:01.892 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::2841:a2ff:fea8:ee31/64 scope link 2023-05-10T04:21:01.893 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:21:01.893 INFO:teuthology.orchestra.run.smithi132.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-10T04:21:01.893 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 8a:14:bd:ef:9b:e0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-05-10T04:21:01.893 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8814:bdff:feef:9be0/64 scope link 2023-05-10T04:21:01.893 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-05-10T04:21:01.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:01.894 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-10T04:21:01.986 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-05-10T04:21:01.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:01.990 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-05-10T04:21:02.031 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-05-10T04:21:02.031 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-10T04:21:02.031 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-10T04:21:02.032 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-10T04:21:02.032 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-10T04:21:02.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:02.033 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-05-10T04:21:02.033 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-05-10T04:21:02.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-10T04:21:02.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-10T04:21:02.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-10T04:21:02.034 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-05-10T04:21:02.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:02.224 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-05-10T04:21:02.263 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-05-10T04:21:02.263 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-10T04:21:02.263 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-10T04:21:02.264 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:02.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-05-10T04:21:02.364 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-05-10T04:21:02.364 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:21:02.365 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-10T04:21:02.403 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-10T04:21:02.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-10T04:21:02.404 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-10T04:21:02.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:21:02.450 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:21:02.483 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:21:02.586 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:21:02.587 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:21:02.646 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:21:02.648 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:21:02.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:02.649 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:21:02.688 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-05-10T04:21:02.688 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-05-10T04:21:02.732 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-05-10T04:21:02.797 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-05-10T04:21:02.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-05-10T04:21:02.860 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-05-10T04:21:02.864 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-05-10T04:21:02.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:02.865 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-05-10T04:21:02.887 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-05-10T04:21:02.885+0000 7f860b98b5c0 -1 init, newargv = 0x564b98388340 newargc=15 2023-05-10T04:21:02.887 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[146346]: starting ceph client 2023-05-10T04:21:02.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[146346]: starting fuse 2023-05-10T04:21:02.906 INFO:teuthology.orchestra.run.smithi132.stdout:43 2023-05-10T04:21:02.907 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-05-10T04:21:02.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-05-10T04:21:02.908 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-05-10T04:21:02.909 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-05-10T04:21:02.910 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-05-10T04:21:02.910 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-05-10T04:21:02.910 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:21:02.911 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-05-10T04:21:02.911 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-05-10T04:21:02.911 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-05-10T04:21:02.912 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-05-10T04:21:02.912 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:21:02.912 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-05-10T04:21:02.913 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-05-10T04:21:02.913 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-05-10T04:21:02.914 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-05-10T04:21:02.914 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:21:02.914 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-05-10T04:21:02.915 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-05-10T04:21:02.915 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-05-10T04:21:02.915 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-05-10T04:21:02.916 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-05-10T04:21:02.916 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-05-10T04:21:02.916 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-05-10T04:21:02.916 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-05-10T04:21:02.917 DEBUG:teuthology.orchestra.run.smithi132:> 2023-05-10T04:21:02.917 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-05-10T04:21:02.917 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-05-10T04:21:03.082 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.146346.asok 2023-05-10T04:21:03.260 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.146346.asok 2023-05-10T04:21:03.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:03.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.146346.asok status 2023-05-10T04:21:03.474 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-05-10T04:21:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-05-10T04:21:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "2ef5137fbb6e28908d2161218e7b594628c1b6d3", 2023-05-10T04:21:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.0.0-3851-g2ef5137f (2ef5137fbb6e28908d2161218e7b594628c1b6d3) reef (dev)", 2023-05-10T04:21:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-05-10T04:21:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-05-10T04:21:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-05-10T04:21:03.475 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "146346", 2023-05-10T04:21:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-05-10T04:21:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:21:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-05-10T04:21:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-05-10T04:21:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5718, 2023-05-10T04:21:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-05-10T04:21:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-05-10T04:21:03.476 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-05-10T04:21:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 5718 2023-05-10T04:21:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:21:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-05-10T04:21:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-05-10T04:21:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-05-10T04:21:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1949472030 2023-05-10T04:21:03.477 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-05-10T04:21:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:21:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-05-10T04:21:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-05-10T04:21:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-05-10T04:21:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1949472030 2023-05-10T04:21:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-05-10T04:21:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.5718 192.168.0.1:0/1949472030", 2023-05-10T04:21:03.478 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/1949472030", 2023-05-10T04:21:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-05-10T04:21:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 17, 2023-05-10T04:21:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 41, 2023-05-10T04:21:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-05-10T04:21:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-05-10T04:21:03.479 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-05-10T04:21:03.479 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-05-10T04:21:03.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:03.488 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-05-10T04:21:03.489 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-05-10T04:21:03.528 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-05-10T04:21:03.528 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-05-10T04:21:03.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:03.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-10T04:21:03.630 DEBUG:teuthology.orchestra.run.smithi132:> mktemp -d --suffix=xfstests-dev 2023-05-10T04:21:03.669 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.I82EepBFpzxfstests-dev 2023-05-10T04:21:03.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:03.670 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.I82EepBFpzxfstests-dev) 2023-05-10T04:21:03.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:03.773 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.I82EepBFpzxfstests-dev) 2023-05-10T04:21:03.817 INFO:teuthology.orchestra.run.smithi132.stderr:Cloning into '/tmp/tmp.I82EepBFpzxfstests-dev'... 2023-05-10T04:21:04.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:04.633 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-10T04:21:04.719 DEBUG:teuthology.orchestra.run.smithi132:> mktemp -d --suffix=test 2023-05-10T04:21:04.757 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.iExZIwHbrRtest 2023-05-10T04:21:04.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:21:04.758 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-10T04:21:04.843 DEBUG:teuthology.orchestra.run.smithi132:> mktemp -d --suffix=scratch 2023-05-10T04:21:04.922 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.PSQ6POd1Clscratch 2023-05-10T04:21:04.922 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "rhel" and "8.6". 2023-05-10T04:21:04.923 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python2 sqlite xfsprogs-qa-devel 2023-05-10T04:21:05.426 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2023-05-10T04:21:06.369 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:05:12 ago on Wed 10 May 2023 04:15:54 AM UTC. 2023-05-10T04:21:07.713 INFO:teuthology.orchestra.run.smithi132.stdout:Package acl-2.2.53-1.el8.x86_64 is already installed. 2023-05-10T04:21:07.714 INFO:teuthology.orchestra.run.smithi132.stdout:Package attr-2.4.48-3.el8.x86_64 is already installed. 2023-05-10T04:21:07.715 INFO:teuthology.orchestra.run.smithi132.stdout:Package automake-1.16.1-7.el8.noarch is already installed. 2023-05-10T04:21:07.717 INFO:teuthology.orchestra.run.smithi132.stdout:Package bc-1.07.1-5.el8.x86_64 is already installed. 2023-05-10T04:21:07.718 INFO:teuthology.orchestra.run.smithi132.stdout:Package dbench-4.0-20.el8.x86_64 is already installed. 2023-05-10T04:21:07.720 INFO:teuthology.orchestra.run.smithi132.stdout:Package e2fsprogs-1.45.6-4.el8.x86_64 is already installed. 2023-05-10T04:21:07.722 INFO:teuthology.orchestra.run.smithi132.stdout:Package gawk-4.2.1-4.el8.x86_64 is already installed. 2023-05-10T04:21:07.724 INFO:teuthology.orchestra.run.smithi132.stdout:Package gcc-8.5.0-10.1.el8_6.x86_64 is already installed. 2023-05-10T04:21:07.726 INFO:teuthology.orchestra.run.smithi132.stdout:Package libtool-2.4.6-25.el8.x86_64 is already installed. 2023-05-10T04:21:07.728 INFO:teuthology.orchestra.run.smithi132.stdout:Package lvm2-8:2.03.14-3.el8_6.2.x86_64 is already installed. 2023-05-10T04:21:07.729 INFO:teuthology.orchestra.run.smithi132.stdout:Package make-1:4.2.1-11.el8.x86_64 is already installed. 2023-05-10T04:21:07.730 INFO:teuthology.orchestra.run.smithi132.stdout:Package psmisc-23.1-5.el8.x86_64 is already installed. 2023-05-10T04:21:07.731 INFO:teuthology.orchestra.run.smithi132.stdout:Package quota-1:4.04-14.el8.x86_64 is already installed. 2023-05-10T04:21:07.732 INFO:teuthology.orchestra.run.smithi132.stdout:Package sed-4.5-5.el8.x86_64 is already installed. 2023-05-10T04:21:07.733 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-05-10T04:21:07.735 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-10T04:21:07.736 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-05-10T04:21:07.737 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-05-10T04:21:07.738 INFO:teuthology.orchestra.run.smithi132.stdout:Package libaio-devel-0.3.112-1.el8.x86_64 is already installed. 2023-05-10T04:21:07.740 INFO:teuthology.orchestra.run.smithi132.stdout:Package libuuid-devel-2.32.1-35.el8.x86_64 is already installed. 2023-05-10T04:21:07.741 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-devel-5.0.0-10.el8.x86_64 is already installed. 2023-05-10T04:21:07.743 INFO:teuthology.orchestra.run.smithi132.stdout:Package sqlite-3.26.0-15.el8.x86_64 is already installed. 2023-05-10T04:21:07.748 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-05-10T04:21:07.872 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-05-10T04:21:07.874 INFO:teuthology.orchestra.run.smithi132.stdout:==================================================================================================================== 2023-05-10T04:21:07.875 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2023-05-10T04:21:07.875 INFO:teuthology.orchestra.run.smithi132.stdout:==================================================================================================================== 2023-05-10T04:21:07.875 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2023-05-10T04:21:07.875 INFO:teuthology.orchestra.run.smithi132.stdout: dump x86_64 1:0.4-0.36.b46.el8 rhel-8-for-x86_64-baseos-rpms 164 k 2023-05-10T04:21:07.875 INFO:teuthology.orchestra.run.smithi132.stdout: fio x86_64 3.19-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-05-10T04:21:07.875 INFO:teuthology.orchestra.run.smithi132.stdout: indent x86_64 2.2.13-2.el8 epel 187 k 2023-05-10T04:21:07.875 INFO:teuthology.orchestra.run.smithi132.stdout: python2 x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 110 k 2023-05-10T04:21:07.876 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2023-05-10T04:21:07.876 INFO:teuthology.orchestra.run.smithi132.stdout: sqlite x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 668 k 2023-05-10T04:21:07.876 INFO:teuthology.orchestra.run.smithi132.stdout: sqlite-libs x86_64 3.26.0-16.el8_6 rhel-8-for-x86_64-baseos-rpms 581 k 2023-05-10T04:21:07.876 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2023-05-10T04:21:07.876 INFO:teuthology.orchestra.run.smithi132.stdout: daxctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 42 k 2023-05-10T04:21:07.876 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemblk x86_64 1.6.1-1.el8 rhel-8-for-x86_64-appstream-rpms 92 k 2023-05-10T04:21:07.876 INFO:teuthology.orchestra.run.smithi132.stdout: ndctl-libs x86_64 71.1-3.el8 rhel-8-for-x86_64-baseos-rpms 79 k 2023-05-10T04:21:07.877 INFO:teuthology.orchestra.run.smithi132.stdout: python2-libs x86_64 2.7.18-10.module+el8.6.0+14191+7fdd52cd rhel-8-for-x86_64-appstream-rpms 6.0 M 2023-05-10T04:21:07.877 INFO:teuthology.orchestra.run.smithi132.stdout: python2-pip-wheel noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 892 k 2023-05-10T04:21:07.877 INFO:teuthology.orchestra.run.smithi132.stdout: python2-setuptools-wheel noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 287 k 2023-05-10T04:21:07.877 INFO:teuthology.orchestra.run.smithi132.stdout: python2-wheel-wheel noarch 1:0.31.1-3.module+el8.5.0+12203+77770ab7 rhel-8-for-x86_64-appstream-rpms 45 k 2023-05-10T04:21:07.877 INFO:teuthology.orchestra.run.smithi132.stdout: rmt x86_64 2:1.5.3-13.el8 rhel-8-for-x86_64-baseos-rpms 51 k 2023-05-10T04:21:07.877 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2023-05-10T04:21:07.877 INFO:teuthology.orchestra.run.smithi132.stdout: python2-pip noarch 9.0.3-19.module+el8.6.0+13001+ad200bd9 rhel-8-for-x86_64-appstream-rpms 1.6 M 2023-05-10T04:21:07.877 INFO:teuthology.orchestra.run.smithi132.stdout: python2-setuptools noarch 39.0.1-13.module+el8.4.0+9442+27d0e81c rhel-8-for-x86_64-appstream-rpms 642 k 2023-05-10T04:21:07.878 INFO:teuthology.orchestra.run.smithi132.stdout:Enabling module streams: 2023-05-10T04:21:07.878 INFO:teuthology.orchestra.run.smithi132.stdout: python27 2.7 2023-05-10T04:21:07.878 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:21:07.878 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-05-10T04:21:07.879 INFO:teuthology.orchestra.run.smithi132.stdout:==================================================================================================================== 2023-05-10T04:21:07.879 INFO:teuthology.orchestra.run.smithi132.stdout:Install 14 Packages 2023-05-10T04:21:07.879 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 2 Packages 2023-05-10T04:21:07.879 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:21:07.879 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 12 M 2023-05-10T04:21:07.880 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-05-10T04:21:08.388 INFO:teuthology.orchestra.run.smithi132.stdout:(1/16): dump-0.4-0.36.b46.el8.x86_64.rpm 1.7 MB/s | 164 kB 00:00 2023-05-10T04:21:08.412 INFO:teuthology.orchestra.run.smithi132.stdout:(2/16): rmt-1.5.3-13.el8.x86_64.rpm 438 kB/s | 51 kB 00:00 2023-05-10T04:21:08.438 INFO:teuthology.orchestra.run.smithi132.stdout:(3/16): daxctl-libs-71.1-3.el8.x86_64.rpm 840 kB/s | 42 kB 00:00 2023-05-10T04:21:08.463 INFO:teuthology.orchestra.run.smithi132.stdout:(4/16): ndctl-libs-71.1-3.el8.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-05-10T04:21:08.499 INFO:teuthology.orchestra.run.smithi132.stdout:(5/16): python2-setuptools-wheel-39.0.1-13.modu 4.8 MB/s | 287 kB 00:00 2023-05-10T04:21:08.539 INFO:teuthology.orchestra.run.smithi132.stdout:(6/16): python2-setuptools-39.0.1-13.module+el8 8.3 MB/s | 642 kB 00:00 2023-05-10T04:21:08.564 INFO:teuthology.orchestra.run.smithi132.stdout:(7/16): python2-wheel-wheel-0.31.1-3.module+el8 669 kB/s | 45 kB 00:00 2023-05-10T04:21:08.597 INFO:teuthology.orchestra.run.smithi132.stdout:(8/16): fio-3.19-3.el8.x86_64.rpm 9.0 MB/s | 538 kB 00:00 2023-05-10T04:21:08.623 INFO:teuthology.orchestra.run.smithi132.stdout:(9/16): libpmemblk-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 92 kB 00:00 2023-05-10T04:21:08.656 INFO:teuthology.orchestra.run.smithi132.stdout:(10/16): indent-2.2.13-2.el8.x86_64.rpm 516 kB/s | 187 kB 00:00 2023-05-10T04:21:08.682 INFO:teuthology.orchestra.run.smithi132.stdout:(11/16): python2-2.7.18-10.module+el8.6.0+14191 1.3 MB/s | 110 kB 00:00 2023-05-10T04:21:08.765 INFO:teuthology.orchestra.run.smithi132.stdout:(12/16): python2-pip-wheel-9.0.3-19.module+el8. 11 MB/s | 892 kB 00:00 2023-05-10T04:21:08.816 INFO:teuthology.orchestra.run.smithi132.stdout:(13/16): python2-pip-9.0.3-19.module+el8.6.0+13 10 MB/s | 1.6 MB 00:00 2023-05-10T04:21:08.875 INFO:teuthology.orchestra.run.smithi132.stdout:(14/16): sqlite-3.26.0-16.el8_6.x86_64.rpm 6.0 MB/s | 668 kB 00:00 2023-05-10T04:21:08.908 INFO:teuthology.orchestra.run.smithi132.stdout:(15/16): sqlite-libs-3.26.0-16.el8_6.x86_64.rpm 6.2 MB/s | 581 kB 00:00 2023-05-10T04:21:08.992 INFO:teuthology.orchestra.run.smithi132.stdout:(16/16): python2-libs-2.7.18-10.module+el8.6.0+ 16 MB/s | 6.0 MB 00:00 2023-05-10T04:21:08.992 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-05-10T04:21:08.992 INFO:teuthology.orchestra.run.smithi132.stdout:Total 11 MB/s | 12 MB 00:01 2023-05-10T04:21:09.357 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-05-10T04:21:09.402 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-05-10T04:21:09.402 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-05-10T04:21:09.647 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-05-10T04:21:09.653 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-05-10T04:21:10.422 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-05-10T04:21:10.620 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : sqlite-libs-3.26.0-16.el8_6.x86_64 1/18 2023-05-10T04:21:10.788 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : daxctl-libs-71.1-3.el8.x86_64 2/18 2023-05-10T04:21:10.880 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: daxctl-libs-71.1-3.el8.x86_64 2/18 2023-05-10T04:21:11.071 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ndctl-libs-71.1-3.el8.x86_64 3/18 2023-05-10T04:21:11.157 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ndctl-libs-71.1-3.el8.x86_64 3/18 2023-05-10T04:21:11.346 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-05-10T04:21:11.464 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libpmemblk-1.6.1-1.el8.x86_64 4/18 2023-05-10T04:21:11.601 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 5/18 2023-05-10T04:21:11.911 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 6/18 2023-05-10T04:21:12.678 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/18 2023-05-10T04:21:12.971 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 8/18 2023-05-10T04:21:13.180 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 9/18 2023-05-10T04:21:14.576 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 9/18 2023-05-10T04:21:14.928 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 10/18 2023-05-10T04:21:15.098 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rmt-2:1.5.3-13.el8.x86_64 11/18 2023-05-10T04:21:15.454 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : dump-1:0.4-0.36.b46.el8.x86_64 12/18 2023-05-10T04:21:15.746 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fio-3.19-3.el8.x86_64 13/18 2023-05-10T04:21:15.941 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : sqlite-3.26.0-16.el8_6.x86_64 14/18 2023-05-10T04:21:16.129 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 15/18 2023-05-10T04:21:16.338 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : indent-2.2.13-2.el8.x86_64 16/18 2023-05-10T04:21:16.480 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : sqlite-3.26.0-15.el8.x86_64 17/18 2023-05-10T04:21:16.652 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-05-10T04:21:17.075 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-05-10T04:21:17.075 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : indent-2.2.13-2.el8.x86_64 1/18 2023-05-10T04:21:17.075 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : dump-1:0.4-0.36.b46.el8.x86_64 2/18 2023-05-10T04:21:17.076 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rmt-2:1.5.3-13.el8.x86_64 3/18 2023-05-10T04:21:17.076 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : daxctl-libs-71.1-3.el8.x86_64 4/18 2023-05-10T04:21:17.076 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ndctl-libs-71.1-3.el8.x86_64 5/18 2023-05-10T04:21:17.076 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-setuptools-wheel-39.0.1-13.module+el8.4.0+ 6/18 2023-05-10T04:21:17.076 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-setuptools-39.0.1-13.module+el8.4.0+9442+2 7/18 2023-05-10T04:21:17.076 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+1220 8/18 2023-05-10T04:21:17.076 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fio-3.19-3.el8.x86_64 9/18 2023-05-10T04:21:17.077 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemblk-1.6.1-1.el8.x86_64 10/18 2023-05-10T04:21:17.077 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x8 11/18 2023-05-10T04:21:17.077 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52 12/18 2023-05-10T04:21:17.077 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9 13/18 2023-05-10T04:21:17.077 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad 14/18 2023-05-10T04:21:17.077 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sqlite-3.26.0-16.el8_6.x86_64 15/18 2023-05-10T04:21:17.077 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sqlite-3.26.0-15.el8.x86_64 16/18 2023-05-10T04:21:17.077 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sqlite-libs-3.26.0-16.el8_6.x86_64 17/18 2023-05-10T04:21:18.576 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : sqlite-libs-3.26.0-15.el8.x86_64 18/18 2023-05-10T04:21:18.577 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:05:24 ago on Wed 10 May 2023 04:15:54 AM UTC. 2023-05-10T04:21:21.123 INFO:teuthology.orchestra.run.smithi132.stdout:Installed products updated. 2023-05-10T04:21:21.321 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:21:21.322 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2023-05-10T04:21:21.322 INFO:teuthology.orchestra.run.smithi132.stdout: sqlite-3.26.0-16.el8_6.x86_64 sqlite-libs-3.26.0-16.el8_6.x86_64 2023-05-10T04:21:21.322 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2023-05-10T04:21:21.322 INFO:teuthology.orchestra.run.smithi132.stdout: daxctl-libs-71.1-3.el8.x86_64 2023-05-10T04:21:21.322 INFO:teuthology.orchestra.run.smithi132.stdout: dump-1:0.4-0.36.b46.el8.x86_64 2023-05-10T04:21:21.322 INFO:teuthology.orchestra.run.smithi132.stdout: fio-3.19-3.el8.x86_64 2023-05-10T04:21:21.323 INFO:teuthology.orchestra.run.smithi132.stdout: indent-2.2.13-2.el8.x86_64 2023-05-10T04:21:21.323 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemblk-1.6.1-1.el8.x86_64 2023-05-10T04:21:21.323 INFO:teuthology.orchestra.run.smithi132.stdout: ndctl-libs-71.1-3.el8.x86_64 2023-05-10T04:21:21.323 INFO:teuthology.orchestra.run.smithi132.stdout: python2-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-05-10T04:21:21.323 INFO:teuthology.orchestra.run.smithi132.stdout: python2-libs-2.7.18-10.module+el8.6.0+14191+7fdd52cd.x86_64 2023-05-10T04:21:21.323 INFO:teuthology.orchestra.run.smithi132.stdout: python2-pip-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-05-10T04:21:21.323 INFO:teuthology.orchestra.run.smithi132.stdout: python2-pip-wheel-9.0.3-19.module+el8.6.0+13001+ad200bd9.noarch 2023-05-10T04:21:21.323 INFO:teuthology.orchestra.run.smithi132.stdout: python2-setuptools-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-05-10T04:21:21.324 INFO:teuthology.orchestra.run.smithi132.stdout: python2-setuptools-wheel-39.0.1-13.module+el8.4.0+9442+27d0e81c.noarch 2023-05-10T04:21:21.324 INFO:teuthology.orchestra.run.smithi132.stdout: python2-wheel-wheel-1:0.31.1-3.module+el8.5.0+12203+77770ab7.noarch 2023-05-10T04:21:21.324 INFO:teuthology.orchestra.run.smithi132.stdout: rmt-2:1.5.3-13.el8.x86_64 2023-05-10T04:21:21.324 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:21:21.324 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-05-10T04:21:21.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo useradd -m fsgqa 2023-05-10T04:21:21.584 INFO:teuthology.orchestra.run.smithi132.stderr:useradd: user 'fsgqa' already exists 2023-05-10T04:21:21.586 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-10T04:21:21.587 DEBUG:teuthology.orchestra.run.smithi132:> sudo groupadd fsgqa 2023-05-10T04:21:21.647 INFO:teuthology.orchestra.run.smithi132.stderr:groupadd: group 'fsgqa' already exists 2023-05-10T04:21:21.649 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-10T04:21:21.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo useradd fsgqa2 2023-05-10T04:21:23.037 DEBUG:teuthology.orchestra.run.smithi132:> sudo useradd 123456-fsgqa 2023-05-10T04:21:26.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-10T04:21:26.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.529+0000 7f812c7ff700 1 Processor -- start 2023-05-10T04:21:26.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.529+0000 7f812c7ff700 1 -- start start 2023-05-10T04:21:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.530+0000 7f812c7ff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7f81240cd760 0x7f81240cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.530+0000 7f812c7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240adf70 0x7f81240cce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.530+0000 7f812c7ff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81240cc9e0 con 0x7f812415cf10 2023-05-10T04:21:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.530+0000 7f812c7ff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812415de20 con 0x7f81240cd760 2023-05-10T04:21:26.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.530+0000 7f812c7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240ce070 con 0x7f81240adf70 2023-05-10T04:21:26.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.530+0000 7f812ad9c700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f812415cf10 0x7f812406c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55540/0 (socket says 172.21.15.132:55540) 2023-05-10T04:21:26.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.530+0000 7f812ad9c700 1 -- 172.21.15.132:0/3473329603 learned_addr learned my addr 172.21.15.132:0/3473329603 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:21:26.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f812a59b700 1 --2- 172.21.15.132:0/3473329603 >> v2:172.21.15.154:3300/0 conn(0x7f81240cd760 0x7f81240cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:26.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f8129d9a700 1 --2- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240adf70 0x7f81240cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:26.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f8129599700 1 -- 172.21.15.132:0/3473329603 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1544396182 0 0) 0x7f81240cc9e0 con 0x7f812415cf10 2023-05-10T04:21:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f8129599700 1 -- 172.21.15.132:0/3473329603 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81100035b0 con 0x7f812415cf10 2023-05-10T04:21:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f8129599700 1 -- 172.21.15.132:0/3473329603 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 778870980 0 0) 0x7f81100035b0 con 0x7f812415cf10 2023-05-10T04:21:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f812a59b700 1 -- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240adf70 msgr2=0x7f81240cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f812a59b700 1 --2- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240adf70 0x7f81240cce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f812a59b700 1 -- 172.21.15.132:0/3473329603 >> v1:172.21.15.132:6789/0 conn(0x7f812415cf10 legacy=0x7f812406c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f812a59b700 1 -- 172.21.15.132:0/3473329603 --> v2:172.21.15.154:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812415d860 con 0x7f81240cd760 2023-05-10T04:21:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f8129d9a700 1 --2- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240adf70 0x7f81240cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-10T04:21:26.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.531+0000 7f812a59b700 1 --2- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81240cd760 0x7f81240cdb30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8120009840 tx=0x7f8120009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f23761cfdb1380b7 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f8129599700 1 -- 172.21.15.132:0/3473329603 <== mon.1 v2:172.21.15.154:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c0019f0 con 0x7f81240cd760 2023-05-10T04:21:26.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f8129599700 1 -- 172.21.15.132:0/3473329603 <== mon.1 v2:172.21.15.154:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8120004030 con 0x7f81240cd760 2023-05-10T04:21:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f8129599700 1 -- 172.21.15.132:0/3473329603 <== mon.1 v2:172.21.15.154:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81200043c0 con 0x7f81240cd760 2023-05-10T04:21:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f812c7ff700 1 -- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81240cd760 msgr2=0x7f81240cdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f812c7ff700 1 --2- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81240cd760 0x7f81240cdb30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8120009840 tx=0x7f8120009b50 comp rx=0 tx=0).stop 2023-05-10T04:21:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f812c7ff700 1 -- 172.21.15.132:0/3473329603 shutdown_connections 2023-05-10T04:21:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f812c7ff700 1 --2- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f81240cd760 0x7f81240cdb30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f812c7ff700 1 --2- 172.21.15.132:0/3473329603 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240adf70 0x7f81240cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f812c7ff700 1 -- 172.21.15.132:0/3473329603 >> 172.21.15.132:0/3473329603 conn(0x7f81240cf720 msgr2=0x7f81240cb510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:26.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.532+0000 7f812c7ff700 1 -- 172.21.15.132:0/3473329603 shutdown_connections 2023-05-10T04:21:26.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.533+0000 7f812c7ff700 1 -- 172.21.15.132:0/3473329603 wait complete. 2023-05-10T04:21:26.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.534+0000 7f812c7ff700 1 Processor -- start 2023-05-10T04:21:26.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.534+0000 7f812c7ff700 1 -- start start 2023-05-10T04:21:26.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.535+0000 7f812c7ff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81240adf70 0x7f81241518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:26.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.535+0000 7f812c7ff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240cd760 0x7f8124157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:26.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.535+0000 7f812c7ff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812415cf10 0x7f8124157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:26.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.535+0000 7f812c7ff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240c5ad0 con 0x7f81240adf70 2023-05-10T04:21:26.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.535+0000 7f812c7ff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81240c5d20 con 0x7f812415cf10 2023-05-10T04:21:26.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.535+0000 7f812c7ff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240c6000 con 0x7f81240cd760 2023-05-10T04:21:26.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81240adf70 0x7f81241518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:26.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81240adf70 0x7f81241518a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53280/0 (socket says 172.21.15.132:53280) 2023-05-10T04:21:26.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 -- 172.21.15.132:0/543638078 learned_addr learned my addr 172.21.15.132:0/543638078 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:26.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812ad9c700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812415cf10 0x7f8124157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:26.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f8129d9a700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240cd760 0x7f8124157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:26.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 -- 172.21.15.132:0/543638078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240cd760 msgr2=0x7f8124157130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:26.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240cd760 0x7f8124157130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 -- 172.21.15.132:0/543638078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812415cf10 msgr2=0x7f8124157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:26.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812415cf10 0x7f8124157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 -- 172.21.15.132:0/543638078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8114009430 con 0x7f81240adf70 2023-05-10T04:21:26.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812a59b700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81240adf70 0x7f81241518a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f81200090b0 tx=0x7f8120004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:26.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f811affd700 1 -- 172.21.15.132:0/543638078 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120003e20 con 0x7f81240adf70 2023-05-10T04:21:26.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f811affd700 1 -- 172.21.15.132:0/543638078 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812001f070 con 0x7f81240adf70 2023-05-10T04:21:26.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.536+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81200094a0 con 0x7f81240adf70 2023-05-10T04:21:26.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.537+0000 7f811affd700 1 -- 172.21.15.132:0/543638078 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120011870 con 0x7f81240adf70 2023-05-10T04:21:26.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.537+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81240cc670 con 0x7f81240adf70 2023-05-10T04:21:26.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.538+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812415db40 con 0x7f81240adf70 2023-05-10T04:21:26.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.539+0000 7f811affd700 1 -- 172.21.15.132:0/543638078 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f81200119d0 con 0x7f81240adf70 2023-05-10T04:21:26.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.540+0000 7f811affd700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f810806ace0 0x7f810806d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:26.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.540+0000 7f811affd700 1 -- 172.21.15.132:0/543638078 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7f8120021070 con 0x7f81240adf70 2023-05-10T04:21:26.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.540+0000 7f8129d9a700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f810806ace0 0x7f810806d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:26.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.540+0000 7f8129d9a700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f810806ace0 0x7f810806d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f81240cbb80 tx=0x7f8114008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.544+0000 7f811affd700 1 -- 172.21.15.132:0/543638078 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7f8120055f00 con 0x7f81240adf70 2023-05-10T04:21:26.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.822+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8124071600 con 0x7f81240adf70 2023-05-10T04:21:26.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.822+0000 7f811affd700 1 -- 172.21.15.132:0/543638078 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1280 (secure 0 0 0) 0x7f8120059520 con 0x7f81240adf70 2023-05-10T04:21:26.825 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:21:26.825 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":1,"fsid":"390ee88e-3ece-4689-996a-1bc273e3e6b7","modified":"2023-05-10T04:18:04.354206Z","created":"2023-05-10T04:18:04.354206Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:3300","nonce":0},{"type":"v1","addr":"172.21.15.132:6789","nonce":0}]},"addr":"172.21.15.132:6789/0","public_addr":"172.21.15.132:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3300","nonce":0},{"type":"v1","addr":"172.21.15.154:6789","nonce":0}]},"addr":"172.21.15.154:6789/0","public_addr":"172.21.15.154:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.154:3301","nonce":0},{"type":"v1","addr":"172.21.15.154:6790","nonce":0}]},"addr":"172.21.15.154:6790/0","public_addr":"172.21.15.154:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-10T04:21:26.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f810806ace0 msgr2=0x7f810806d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:26.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f810806ace0 0x7f810806d190 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f81240cbb80 tx=0x7f8114008040 comp rx=0 tx=0).stop 2023-05-10T04:21:26.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81240adf70 msgr2=0x7f81241518a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:26.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81240adf70 0x7f81241518a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f81200090b0 tx=0x7f8120004750 comp rx=0 tx=0).stop 2023-05-10T04:21:26.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 shutdown_connections 2023-05-10T04:21:26.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7f810806ace0 0x7f810806d190 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7f812415cf10 0x7f8124157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81240adf70 0x7f81241518a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 --2- 172.21.15.132:0/543638078 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7f81240cd760 0x7f8124157130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:26.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 >> 172.21.15.132:0/543638078 conn(0x7f81240cf720 msgr2=0x7f812415aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:26.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 shutdown_connections 2023-05-10T04:21:26.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:26.825+0000 7f812c7ff700 1 -- 172.21.15.132:0/543638078 wait complete. 2023-05-10T04:21:26.829 INFO:teuthology.orchestra.run.smithi132.stderr:dumped monmap epoch 1 2023-05-10T04:21:26.844 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-05-10T04:21:27.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.032+0000 7fcf21bff700 1 Processor -- start 2023-05-10T04:21:27.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.032+0000 7fcf21bff700 1 -- start start 2023-05-10T04:21:27.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.033+0000 7fcf21bff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf1c0b87a0 0x7fcf1c0cfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:27.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.033+0000 7fcf21bff700 1 --2- >> v2:172.21.15.154:3300/0 conn(0x7fcf1c160d40 0x7fcf1c0d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:27.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.033+0000 7fcf21bff700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf1c0cdc60 con 0x7fcf1c1601e0 2023-05-10T04:21:27.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.033+0000 7fcf21bff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0d02d0 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.033+0000 7fcf21bff700 1 -- --> v2:172.21.15.154:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf1c0d0cb0 con 0x7fcf1c160d40 2023-05-10T04:21:27.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.033+0000 7fcf1b7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf1c0b87a0 0x7fcf1c0cfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:27.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.033+0000 7fcf13fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcf1c1601e0 0x7fcf1c160630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:55544/0 (socket says 172.21.15.132:55544) 2023-05-10T04:21:27.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.033+0000 7fcf13fff700 1 -- 172.21.15.132:0/602287777 learned_addr learned my addr 172.21.15.132:0/602287777 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-05-10T04:21:27.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1bfff700 1 --2- 172.21.15.132:0/602287777 >> v2:172.21.15.154:3300/0 conn(0x7fcf1c160d40 0x7fcf1c0d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:27.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1b7fe700 1 -- 172.21.15.132:0/602287777 >> v2:172.21.15.154:3300/0 conn(0x7fcf1c160d40 msgr2=0x7fcf1c0d1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-10T04:21:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1b7fe700 1 --2- 172.21.15.132:0/602287777 >> v2:172.21.15.154:3300/0 conn(0x7fcf1c160d40 0x7fcf1c0d1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1b7fe700 1 -- 172.21.15.132:0/602287777 >> v1:172.21.15.132:6789/0 conn(0x7fcf1c1601e0 legacy=0x7fcf1c160630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1b7fe700 1 -- 172.21.15.132:0/602287777 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c0cd6a0 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1b7fe700 1 --2- 172.21.15.132:0/602287777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c0cfbf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0d0820 tx=0x7fcf0c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea4394404c695cee server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1affd700 1 -- 172.21.15.132:0/602287777 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c011830 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1affd700 1 -- 172.21.15.132:0/602287777 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c011990 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.034+0000 7fcf1affd700 1 -- 172.21.15.132:0/602287777 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c011d20 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.035+0000 7fcf21bff700 1 -- 172.21.15.132:0/602287777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 msgr2=0x7fcf1c0cfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.035+0000 7fcf21bff700 1 --2- 172.21.15.132:0/602287777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c0cfbf0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c0d0820 tx=0x7fcf0c009b50 comp rx=0 tx=0).stop 2023-05-10T04:21:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.035+0000 7fcf21bff700 1 -- 172.21.15.132:0/602287777 shutdown_connections 2023-05-10T04:21:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.035+0000 7fcf21bff700 1 --2- 172.21.15.132:0/602287777 >> v2:172.21.15.154:3300/0 conn(0x7fcf1c160d40 0x7fcf1c0d1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.035+0000 7fcf21bff700 1 --2- 172.21.15.132:0/602287777 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c0cfbf0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.035+0000 7fcf21bff700 1 -- 172.21.15.132:0/602287777 >> 172.21.15.132:0/602287777 conn(0x7fcf1c071b10 msgr2=0x7fcf1c071f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.035+0000 7fcf21bff700 1 -- 172.21.15.132:0/602287777 shutdown_connections 2023-05-10T04:21:27.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.035+0000 7fcf21bff700 1 -- 172.21.15.132:0/602287777 wait complete. 2023-05-10T04:21:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.037+0000 7fcf21bff700 1 Processor -- start 2023-05-10T04:21:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.037+0000 7fcf21bff700 1 -- start start 2023-05-10T04:21:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf21bff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:27.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf21bff700 1 --2- >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1601e0 0x7fcf1c0c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf21bff700 1 --2- >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c160d40 0x7fcf1c0d1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf21bff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c1517c0 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf21bff700 1 -- --> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0c8670 con 0x7fcf1c160d40 2023-05-10T04:21:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf21bff700 1 -- --> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1c0c8950 con 0x7fcf1c1601e0 2023-05-10T04:21:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1b7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53292/0 (socket says 172.21.15.132:53292) 2023-05-10T04:21:27.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1b7fe700 1 -- 172.21.15.132:0/559598570 learned_addr learned my addr 172.21.15.132:0/559598570 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-05-10T04:21:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1b7fe700 1 -- 172.21.15.132:0/559598570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1601e0 msgr2=0x7fcf1c0c7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1b7fe700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1601e0 0x7fcf1c0c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1bfff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c160d40 0x7fcf1c0d1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1b7fe700 1 -- 172.21.15.132:0/559598570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c160d40 msgr2=0x7fcf1c0d1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1b7fe700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c160d40 0x7fcf1c0d1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1b7fe700 1 -- 172.21.15.132:0/559598570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf0c0094a0 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.038+0000 7fcf1bfff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c160d40 0x7fcf1c0d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-10T04:21:27.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.039+0000 7fcf1b7fe700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c151280 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0097c0 tx=0x7fcf0c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:27.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.039+0000 7fcf18ff9700 1 -- 172.21.15.132:0/559598570 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c0036a0 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.039+0000 7fcf18ff9700 1 -- 172.21.15.132:0/559598570 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0c01e070 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.039+0000 7fcf18ff9700 1 -- 172.21.15.132:0/559598570 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0c003a60 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.039+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1c0d1640 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.039+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1c0cd980 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.040+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1c0d17d0 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.041+0000 7fcf18ff9700 1 -- 172.21.15.132:0/559598570 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf0c003bc0 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.042+0000 7fcf18ff9700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fcefc06ace0 0x7fcefc06d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-10T04:21:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.042+0000 7fcf18ff9700 1 -- 172.21.15.132:0/559598570 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6382+0+0 (secure 0 0 0) 0x7fcf0c08a1a0 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.042+0000 7fcf13fff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fcefc06ace0 0x7fcefc06d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-10T04:21:27.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.043+0000 7fcf13fff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fcefc06ace0 0x7fcefc06d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf04001670 tx=0x7fcf04007ad0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-10T04:21:27.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.046+0000 7fcf18ff9700 1 -- 172.21.15.132:0/559598570 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176824 (secure 0 0 0) 0x7fcf0c055100 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.317+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7fcf1c074430 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.318+0000 7fcf18ff9700 1 -- 172.21.15.132:0/559598570 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v11) v1 ==== 82+0+151 (secure 0 0 0) 0x7fcf0c058720 con 0x7fcf1c0b87a0 2023-05-10T04:21:27.320 INFO:teuthology.orchestra.run.smithi132.stdout:[client.admin] 2023-05-10T04:21:27.320 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD8Gltk5Wa4KRAAC8JrC3EdOfYV0FRtYgxxlA== 2023-05-10T04:21:27.320 INFO:teuthology.orchestra.run.smithi132.stdout: caps mds = "allow *" 2023-05-10T04:21:27.320 INFO:teuthology.orchestra.run.smithi132.stdout: caps mgr = "allow *" 2023-05-10T04:21:27.320 INFO:teuthology.orchestra.run.smithi132.stdout: caps mon = "allow *" 2023-05-10T04:21:27.320 INFO:teuthology.orchestra.run.smithi132.stdout: caps osd = "allow *" 2023-05-10T04:21:27.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fcefc06ace0 msgr2=0x7fcefc06d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:27.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fcefc06ace0 0x7fcefc06d190 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fcf04001670 tx=0x7fcf04007ad0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 msgr2=0x7fcf1c151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-10T04:21:27.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c151280 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fcf0c0097c0 tx=0x7fcf0c004750 comp rx=0 tx=0).stop 2023-05-10T04:21:27.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 shutdown_connections 2023-05-10T04:21:27.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:6832/1621031024,v1:172.21.15.132:6833/1621031024] conn(0x7fcefc06ace0 0x7fcefc06d190 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.154:3300/0,v1:172.21.15.154:6789/0] conn(0x7fcf1c160d40 0x7fcf1c0d1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf1c0b87a0 0x7fcf1c151280 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 --2- 172.21.15.132:0/559598570 >> [v2:172.21.15.154:3301/0,v1:172.21.15.154:6790/0] conn(0x7fcf1c1601e0 0x7fcf1c0c7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-10T04:21:27.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 >> 172.21.15.132:0/559598570 conn(0x7fcf1c071b10 msgr2=0x7fcf1c071ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-10T04:21:27.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 shutdown_connections 2023-05-10T04:21:27.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-05-10T04:21:27.320+0000 7fcf21bff700 1 -- 172.21.15.132:0/559598570 wait complete. 2023-05-10T04:21:27.339 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-05-10T04:21:27.376 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.2UtHDTUFe3 2023-05-10T04:21:27.377 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:21:27.377 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/tmp/tmp.2UtHDTUFe3 2023-05-10T04:21:27.454 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:21:27.454 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/tmp/tmp.I82EepBFpzxfstests-dev/local.config 2023-05-10T04:21:27.554 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.iExZIwHbrRtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.PSQ6POd1Clscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.132:6789 -k /tmp/tmp.2UtHDTUFe3 --client_mountpoint /test" 2023-05-10T04:21:27.554 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-05-10T04:21:27.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/tmp/tmp.I82EepBFpzxfstests-dev/ceph.exclude 2023-05-10T04:21:27.655 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo make) 2023-05-10T04:21:27.778 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize -cfi 2023-05-10T04:21:28.220 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-10T04:21:28.221 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file './config.guess' 2023-05-10T04:21:28.229 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file './config.sub' 2023-05-10T04:21:28.238 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file './install-sh' 2023-05-10T04:21:28.248 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file './ltmain.sh' 2023-05-10T04:21:28.302 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-10T04:21:28.303 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-10T04:21:28.314 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-10T04:21:28.325 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-10T04:21:28.336 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-10T04:21:28.347 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-10T04:21:28.362 INFO:teuthology.orchestra.run.smithi132.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-10T04:21:28.364 INFO:teuthology.orchestra.run.smithi132.stdout:cp include/install-sh . 2023-05-10T04:21:28.367 INFO:teuthology.orchestra.run.smithi132.stdout:aclocal -I m4 2023-05-10T04:21:29.621 INFO:teuthology.orchestra.run.smithi132.stdout:autoheader 2023-05-10T04:21:29.978 INFO:teuthology.orchestra.run.smithi132.stdout:autoconf 2023-05-10T04:21:30.178 INFO:teuthology.orchestra.run.smithi132.stdout:./configure \ 2023-05-10T04:21:30.178 INFO:teuthology.orchestra.run.smithi132.stdout: --libexecdir=/usr/lib \ 2023-05-10T04:21:30.178 INFO:teuthology.orchestra.run.smithi132.stdout: --exec_prefix=/var/lib 2023-05-10T04:21:30.788 INFO:teuthology.orchestra.run.smithi132.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-10T04:21:30.788 INFO:teuthology.orchestra.run.smithi132.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-10T04:21:30.791 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to print strings... printf 2023-05-10T04:21:30.792 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc... gcc 2023-05-10T04:21:30.949 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether the C compiler works... yes 2023-05-10T04:21:30.949 INFO:teuthology.orchestra.run.smithi132.stdout:checking for C compiler default output file name... a.out 2023-05-10T04:21:30.997 INFO:teuthology.orchestra.run.smithi132.stdout:checking for suffix of executables... 2023-05-10T04:21:31.072 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether we are cross compiling... no 2023-05-10T04:21:31.107 INFO:teuthology.orchestra.run.smithi132.stdout:checking for suffix of object files... o 2023-05-10T04:21:31.139 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether we are using the GNU C compiler... yes 2023-05-10T04:21:31.171 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether gcc accepts -g... yes 2023-05-10T04:21:31.217 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc option to accept ISO C89... none needed 2023-05-10T04:21:31.223 INFO:teuthology.orchestra.run.smithi132.stdout:checking for a sed that does not truncate output... /bin/sed 2023-05-10T04:21:31.228 INFO:teuthology.orchestra.run.smithi132.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-05-10T04:21:31.231 INFO:teuthology.orchestra.run.smithi132.stdout:checking for egrep... /bin/grep -E 2023-05-10T04:21:31.233 INFO:teuthology.orchestra.run.smithi132.stdout:checking for fgrep... /bin/grep -F 2023-05-10T04:21:31.241 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ld used by gcc... /bin/ld 2023-05-10T04:21:31.244 INFO:teuthology.orchestra.run.smithi132.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-05-10T04:21:31.259 INFO:teuthology.orchestra.run.smithi132.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-05-10T04:21:31.296 INFO:teuthology.orchestra.run.smithi132.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-05-10T04:21:31.296 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether ln -s works... yes 2023-05-10T04:21:31.311 INFO:teuthology.orchestra.run.smithi132.stdout:checking the maximum length of command line arguments... 1572864 2023-05-10T04:21:31.316 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-10T04:21:31.317 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-10T04:21:31.317 INFO:teuthology.orchestra.run.smithi132.stdout:checking for /bin/ld option to reload object files... -r 2023-05-10T04:21:31.318 INFO:teuthology.orchestra.run.smithi132.stdout:checking for objdump... objdump 2023-05-10T04:21:31.318 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to recognize dependent libraries... pass_all 2023-05-10T04:21:31.318 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dlltool... no 2023-05-10T04:21:31.318 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-10T04:21:31.319 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ar... ar 2023-05-10T04:21:31.375 INFO:teuthology.orchestra.run.smithi132.stdout:checking for archiver @FILE support... @ 2023-05-10T04:21:31.376 INFO:teuthology.orchestra.run.smithi132.stdout:checking for strip... strip 2023-05-10T04:21:31.376 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ranlib... ranlib 2023-05-10T04:21:31.376 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gawk... gawk 2023-05-10T04:21:31.478 INFO:teuthology.orchestra.run.smithi132.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-05-10T04:21:31.480 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sysroot... no 2023-05-10T04:21:31.488 INFO:teuthology.orchestra.run.smithi132.stdout:checking for a working dd... /bin/dd 2023-05-10T04:21:31.494 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-05-10T04:21:31.521 INFO:teuthology.orchestra.run.smithi132.stdout:checking for mt... no 2023-05-10T04:21:31.526 INFO:teuthology.orchestra.run.smithi132.stdout:checking if : is a manifest tool... no 2023-05-10T04:21:31.570 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to run the C preprocessor... gcc -E 2023-05-10T04:21:31.784 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ANSI C header files... yes 2023-05-10T04:21:31.825 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/types.h... yes 2023-05-10T04:21:31.875 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/stat.h... yes 2023-05-10T04:21:31.923 INFO:teuthology.orchestra.run.smithi132.stdout:checking for stdlib.h... yes 2023-05-10T04:21:31.973 INFO:teuthology.orchestra.run.smithi132.stdout:checking for string.h... yes 2023-05-10T04:21:32.024 INFO:teuthology.orchestra.run.smithi132.stdout:checking for memory.h... yes 2023-05-10T04:21:32.073 INFO:teuthology.orchestra.run.smithi132.stdout:checking for strings.h... yes 2023-05-10T04:21:32.126 INFO:teuthology.orchestra.run.smithi132.stdout:checking for inttypes.h... yes 2023-05-10T04:21:32.175 INFO:teuthology.orchestra.run.smithi132.stdout:checking for stdint.h... yes 2023-05-10T04:21:32.243 INFO:teuthology.orchestra.run.smithi132.stdout:checking for unistd.h... yes 2023-05-10T04:21:32.291 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dlfcn.h... yes 2023-05-10T04:21:32.299 INFO:teuthology.orchestra.run.smithi132.stdout:checking for objdir... .libs 2023-05-10T04:21:32.428 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-10T04:21:32.428 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-10T04:21:32.464 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-10T04:21:32.501 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc static flag -static works... no 2023-05-10T04:21:32.549 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc supports -c -o file.o... yes 2023-05-10T04:21:32.550 INFO:teuthology.orchestra.run.smithi132.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-10T04:21:32.563 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-10T04:21:32.610 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether -lc should be explicitly linked in... no 2023-05-10T04:21:32.696 INFO:teuthology.orchestra.run.smithi132.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-10T04:21:32.697 INFO:teuthology.orchestra.run.smithi132.stdout:checking how to hardcode library paths into programs... immediate 2023-05-10T04:21:32.700 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether stripping libraries is possible... yes 2023-05-10T04:21:32.700 INFO:teuthology.orchestra.run.smithi132.stdout:checking if libtool supports shared libraries... yes 2023-05-10T04:21:32.700 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether to build shared libraries... yes 2023-05-10T04:21:32.700 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether to build static libraries... yes 2023-05-10T04:21:32.712 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc... (cached) gcc 2023-05-10T04:21:32.747 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-05-10T04:21:32.747 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-10T04:21:32.748 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-05-10T04:21:32.748 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gmake... /usr/bin/gmake 2023-05-10T04:21:32.748 INFO:teuthology.orchestra.run.smithi132.stderr:./configure: line 12070: test: $(SHELL): binary operator expected 2023-05-10T04:21:32.749 INFO:teuthology.orchestra.run.smithi132.stdout:checking for tar... /bin/tar 2023-05-10T04:21:32.749 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gzip... /bin/gzip 2023-05-10T04:21:32.764 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether gcc -MM is supported... yes 2023-05-10T04:21:32.765 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sort... /bin/sort 2023-05-10T04:21:32.765 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether ln -s works... yes 2023-05-10T04:21:32.766 INFO:teuthology.orchestra.run.smithi132.stdout:checking for rpm... /bin/rpm 2023-05-10T04:21:32.773 INFO:teuthology.orchestra.run.smithi132.stdout:checking for rpmbuild... no 2023-05-10T04:21:32.820 INFO:teuthology.orchestra.run.smithi132.stdout:checking assert.h usability... yes 2023-05-10T04:21:32.835 INFO:teuthology.orchestra.run.smithi132.stdout:checking assert.h presence... yes 2023-05-10T04:21:32.835 INFO:teuthology.orchestra.run.smithi132.stdout:checking for assert.h... yes 2023-05-10T04:21:32.859 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:21:32.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:21:32.888 INFO:teuthology.orchestra.run.smithi132.stdout:checking bstring.h usability... no 2023-05-10T04:21:32.910 INFO:teuthology.orchestra.run.smithi132.stdout:checking bstring.h presence... no 2023-05-10T04:21:32.911 INFO:teuthology.orchestra.run.smithi132.stdout:checking for bstring.h... no 2023-05-10T04:21:32.962 INFO:teuthology.orchestra.run.smithi132.stdout:checking libgen.h usability... yes 2023-05-10T04:21:32.978 INFO:teuthology.orchestra.run.smithi132.stdout:checking libgen.h presence... yes 2023-05-10T04:21:32.978 INFO:teuthology.orchestra.run.smithi132.stdout:checking for libgen.h... yes 2023-05-10T04:21:33.033 INFO:teuthology.orchestra.run.smithi132.stdout:checking dirent.h usability... yes 2023-05-10T04:21:33.048 INFO:teuthology.orchestra.run.smithi132.stdout:checking dirent.h presence... yes 2023-05-10T04:21:33.049 INFO:teuthology.orchestra.run.smithi132.stdout:checking for dirent.h... yes 2023-05-10T04:21:33.123 INFO:teuthology.orchestra.run.smithi132.stdout:checking errno.h usability... yes 2023-05-10T04:21:33.138 INFO:teuthology.orchestra.run.smithi132.stdout:checking errno.h presence... yes 2023-05-10T04:21:33.139 INFO:teuthology.orchestra.run.smithi132.stdout:checking for errno.h... yes 2023-05-10T04:21:33.193 INFO:teuthology.orchestra.run.smithi132.stdout:checking malloc.h usability... yes 2023-05-10T04:21:33.210 INFO:teuthology.orchestra.run.smithi132.stdout:checking malloc.h presence... yes 2023-05-10T04:21:33.210 INFO:teuthology.orchestra.run.smithi132.stdout:checking for malloc.h... yes 2023-05-10T04:21:33.263 INFO:teuthology.orchestra.run.smithi132.stdout:checking uuid.h usability... no 2023-05-10T04:21:33.285 INFO:teuthology.orchestra.run.smithi132.stdout:checking uuid.h presence... no 2023-05-10T04:21:33.286 INFO:teuthology.orchestra.run.smithi132.stdout:checking for uuid.h... no 2023-05-10T04:21:33.335 INFO:teuthology.orchestra.run.smithi132.stdout:checking uuid/uuid.h usability... yes 2023-05-10T04:21:33.353 INFO:teuthology.orchestra.run.smithi132.stdout:checking uuid/uuid.h presence... yes 2023-05-10T04:21:33.353 INFO:teuthology.orchestra.run.smithi132.stdout:checking for uuid/uuid.h... yes 2023-05-10T04:21:33.406 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/uuid.h usability... no 2023-05-10T04:21:33.429 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/uuid.h presence... no 2023-05-10T04:21:33.429 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/uuid.h... no 2023-05-10T04:21:33.477 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/file.h usability... yes 2023-05-10T04:21:33.493 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/file.h presence... yes 2023-05-10T04:21:33.493 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/file.h... yes 2023-05-10T04:21:33.548 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fcntl.h usability... yes 2023-05-10T04:21:33.564 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fcntl.h presence... yes 2023-05-10T04:21:33.564 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/fcntl.h... yes 2023-05-10T04:21:33.617 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/syssgi.h usability... no 2023-05-10T04:21:33.639 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/syssgi.h presence... no 2023-05-10T04:21:33.639 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/syssgi.h... no 2023-05-10T04:21:33.708 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/param.h usability... yes 2023-05-10T04:21:33.728 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/param.h presence... yes 2023-05-10T04:21:33.728 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/param.h... yes 2023-05-10T04:21:33.741 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/stat.h... (cached) yes 2023-05-10T04:21:33.795 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/statvfs.h usability... yes 2023-05-10T04:21:33.811 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/statvfs.h presence... yes 2023-05-10T04:21:33.811 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/statvfs.h... yes 2023-05-10T04:21:33.865 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/time.h usability... yes 2023-05-10T04:21:33.881 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/time.h presence... yes 2023-05-10T04:21:33.881 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/time.h... yes 2023-05-10T04:21:33.941 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/ioctl.h usability... yes 2023-05-10T04:21:33.956 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/ioctl.h presence... yes 2023-05-10T04:21:33.957 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/ioctl.h... yes 2023-05-10T04:21:34.014 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/wait.h usability... yes 2023-05-10T04:21:34.032 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/wait.h presence... yes 2023-05-10T04:21:34.032 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/wait.h... yes 2023-05-10T04:21:34.045 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/types.h... (cached) yes 2023-05-10T04:21:34.057 INFO:teuthology.orchestra.run.smithi132.stdout:checking for strings.h... (cached) yes 2023-05-10T04:21:34.112 INFO:teuthology.orchestra.run.smithi132.stdout:checking err.h usability... yes 2023-05-10T04:21:34.126 INFO:teuthology.orchestra.run.smithi132.stdout:checking err.h presence... yes 2023-05-10T04:21:34.127 INFO:teuthology.orchestra.run.smithi132.stdout:checking for err.h... yes 2023-05-10T04:21:34.180 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/falloc.h usability... yes 2023-05-10T04:21:34.195 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/falloc.h presence... yes 2023-05-10T04:21:34.195 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/falloc.h... yes 2023-05-10T04:21:34.248 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-05-10T04:21:34.270 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-05-10T04:21:34.270 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-10T04:21:34.315 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fs/xfs_itable.h usability... no 2023-05-10T04:21:34.337 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/fs/xfs_itable.h presence... no 2023-05-10T04:21:34.338 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-10T04:21:34.384 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfs/platform_defs.h usability... no 2023-05-10T04:21:34.406 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfs/platform_defs.h presence... no 2023-05-10T04:21:34.406 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/platform_defs.h... no 2023-05-10T04:21:34.451 INFO:teuthology.orchestra.run.smithi132.stdout:checking btrfs/ioctl.h usability... no 2023-05-10T04:21:34.473 INFO:teuthology.orchestra.run.smithi132.stdout:checking btrfs/ioctl.h presence... no 2023-05-10T04:21:34.474 INFO:teuthology.orchestra.run.smithi132.stdout:checking for btrfs/ioctl.h... no 2023-05-10T04:21:34.519 INFO:teuthology.orchestra.run.smithi132.stdout:checking cifs/ioctl.h usability... no 2023-05-10T04:21:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:checking cifs/ioctl.h presence... no 2023-05-10T04:21:34.542 INFO:teuthology.orchestra.run.smithi132.stdout:checking for cifs/ioctl.h... no 2023-05-10T04:21:34.590 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/mman.h usability... yes 2023-05-10T04:21:34.605 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/mman.h presence... yes 2023-05-10T04:21:34.606 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/mman.h... yes 2023-05-10T04:21:34.640 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/xfs_log_format.h... no 2023-05-10T04:21:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:checking for uuid_compare... no 2023-05-10T04:21:34.758 INFO:teuthology.orchestra.run.smithi132.stdout:checking for uuid_compare in -luuid... yes 2023-05-10T04:21:34.832 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/xfs.h... yes 2023-05-10T04:21:34.861 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/libxfs.h... no 2023-05-10T04:21:34.897 INFO:teuthology.orchestra.run.smithi132.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-10T04:21:34.946 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/xqm.h... yes 2023-05-10T04:21:35.025 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-10T04:21:35.067 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfs/handle.h usability... yes 2023-05-10T04:21:35.081 INFO:teuthology.orchestra.run.smithi132.stdout:checking xfs/handle.h presence... yes 2023-05-10T04:21:35.081 INFO:teuthology.orchestra.run.smithi132.stdout:checking for xfs/handle.h... yes 2023-05-10T04:21:35.153 INFO:teuthology.orchestra.run.smithi132.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-10T04:21:35.204 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/acl.h usability... yes 2023-05-10T04:21:35.221 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/acl.h presence... yes 2023-05-10T04:21:35.221 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/acl.h... yes 2023-05-10T04:21:35.271 INFO:teuthology.orchestra.run.smithi132.stdout:checking acl/libacl.h usability... yes 2023-05-10T04:21:35.288 INFO:teuthology.orchestra.run.smithi132.stdout:checking acl/libacl.h presence... yes 2023-05-10T04:21:35.289 INFO:teuthology.orchestra.run.smithi132.stdout:checking for acl/libacl.h... yes 2023-05-10T04:21:35.346 INFO:teuthology.orchestra.run.smithi132.stdout:checking for acl_init in -lacl... yes 2023-05-10T04:21:35.389 INFO:teuthology.orchestra.run.smithi132.stdout:checking gdbm-ndbm.h usability... no 2023-05-10T04:21:35.411 INFO:teuthology.orchestra.run.smithi132.stdout:checking gdbm-ndbm.h presence... no 2023-05-10T04:21:35.412 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gdbm-ndbm.h... no 2023-05-10T04:21:35.453 INFO:teuthology.orchestra.run.smithi132.stdout:checking gdbm/ndbm.h usability... no 2023-05-10T04:21:35.475 INFO:teuthology.orchestra.run.smithi132.stdout:checking gdbm/ndbm.h presence... no 2023-05-10T04:21:35.476 INFO:teuthology.orchestra.run.smithi132.stdout:checking for gdbm/ndbm.h... no 2023-05-10T04:21:35.516 INFO:teuthology.orchestra.run.smithi132.stdout:checking ndbm.h usability... no 2023-05-10T04:21:35.538 INFO:teuthology.orchestra.run.smithi132.stdout:checking ndbm.h presence... no 2023-05-10T04:21:35.539 INFO:teuthology.orchestra.run.smithi132.stdout:checking for ndbm.h... no 2023-05-10T04:21:35.584 INFO:teuthology.orchestra.run.smithi132.stdout:checking libaio.h usability... yes 2023-05-10T04:21:35.604 INFO:teuthology.orchestra.run.smithi132.stdout:checking libaio.h presence... yes 2023-05-10T04:21:35.605 INFO:teuthology.orchestra.run.smithi132.stdout:checking for libaio.h... yes 2023-05-10T04:21:35.647 INFO:teuthology.orchestra.run.smithi132.stdout:checking liburing.h usability... no 2023-05-10T04:21:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:checking liburing.h presence... no 2023-05-10T04:21:35.669 INFO:teuthology.orchestra.run.smithi132.stdout:checking for liburing.h... no 2023-05-10T04:21:35.710 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/capability.h usability... no 2023-05-10T04:21:35.732 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/capability.h presence... no 2023-05-10T04:21:35.732 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/capability.h... no 2023-05-10T04:21:35.774 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/fiemap.h usability... yes 2023-05-10T04:21:35.788 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/fiemap.h presence... yes 2023-05-10T04:21:35.789 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/fiemap.h... yes 2023-05-10T04:21:35.847 INFO:teuthology.orchestra.run.smithi132.stdout:checking for fallocate... yes 2023-05-10T04:21:35.904 INFO:teuthology.orchestra.run.smithi132.stdout:checking for open_by_handle_at... yes 2023-05-10T04:21:35.949 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/prctl.h usability... yes 2023-05-10T04:21:35.965 INFO:teuthology.orchestra.run.smithi132.stdout:checking sys/prctl.h presence... yes 2023-05-10T04:21:35.965 INFO:teuthology.orchestra.run.smithi132.stdout:checking for sys/prctl.h... yes 2023-05-10T04:21:36.009 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/fs.h usability... yes 2023-05-10T04:21:36.025 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/fs.h presence... yes 2023-05-10T04:21:36.025 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/fs.h... yes 2023-05-10T04:21:36.065 INFO:teuthology.orchestra.run.smithi132.stdout:checking btrfsutil.h usability... no 2023-05-10T04:21:36.088 INFO:teuthology.orchestra.run.smithi132.stdout:checking btrfsutil.h presence... no 2023-05-10T04:21:36.088 INFO:teuthology.orchestra.run.smithi132.stdout:checking for btrfsutil.h... no 2023-05-10T04:21:36.147 INFO:teuthology.orchestra.run.smithi132.stdout:checking for copy_file_range... yes 2023-05-10T04:21:36.208 INFO:teuthology.orchestra.run.smithi132.stdout:checking for SEEK_DATA... yes 2023-05-10T04:21:36.285 INFO:teuthology.orchestra.run.smithi132.stdout:checking for BMV_OF_SHARED... yes 2023-05-10T04:21:36.347 INFO:teuthology.orchestra.run.smithi132.stdout:checking for nftw... yes 2023-05-10T04:21:36.407 INFO:teuthology.orchestra.run.smithi132.stdout:checking for RLIMIT_NOFILE... yes 2023-05-10T04:21:36.442 INFO:teuthology.orchestra.run.smithi132.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-10T04:21:36.500 INFO:teuthology.orchestra.run.smithi132.stdout:checking for renameat2... yes 2023-05-10T04:21:36.559 INFO:teuthology.orchestra.run.smithi132.stdout:checking for reallocarray... yes 2023-05-10T04:21:36.589 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct mount_attr... no 2023-05-10T04:21:36.660 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-10T04:21:36.729 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-10T04:21:36.797 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-10T04:21:36.866 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-10T04:21:36.934 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-10T04:21:37.002 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-10T04:21:37.071 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-10T04:21:37.122 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/btrfs.h usability... yes 2023-05-10T04:21:37.138 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/btrfs.h presence... yes 2023-05-10T04:21:37.138 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/btrfs.h... yes 2023-05-10T04:21:37.194 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/btrfs_tree.h usability... yes 2023-05-10T04:21:37.210 INFO:teuthology.orchestra.run.smithi132.stdout:checking linux/btrfs_tree.h presence... yes 2023-05-10T04:21:37.211 INFO:teuthology.orchestra.run.smithi132.stdout:checking for linux/btrfs_tree.h... yes 2023-05-10T04:21:37.278 INFO:teuthology.orchestra.run.smithi132.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... no 2023-05-10T04:21:37.305 INFO:teuthology.orchestra.run.smithi132.stdout:configure: creating ./config.status 2023-05-10T04:21:38.131 INFO:teuthology.orchestra.run.smithi132.stdout:config.status: creating include/builddefs 2023-05-10T04:21:38.158 INFO:teuthology.orchestra.run.smithi132.stdout:config.status: creating include/config.h 2023-05-10T04:21:38.178 INFO:teuthology.orchestra.run.smithi132.stdout:config.status: executing libtool commands 2023-05-10T04:21:38.251 INFO:teuthology.orchestra.run.smithi132.stdout:Building include 2023-05-10T04:21:38.258 INFO:teuthology.orchestra.run.smithi132.stdout:Building lib 2023-05-10T04:21:38.264 INFO:teuthology.orchestra.run.smithi132.stdout: [LTDEP] 2023-05-10T04:21:38.467 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dataascii.lo 2023-05-10T04:21:38.656 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] databin.lo 2023-05-10T04:21:38.877 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] datapid.lo 2023-05-10T04:21:39.054 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] file_lock.lo 2023-05-10T04:21:39.278 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] forker.lo 2023-05-10T04:21:39.486 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] pattern.lo 2023-05-10T04:21:39.680 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] open_flags.lo 2023-05-10T04:21:39.895 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] random_range.lo 2023-05-10T04:21:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] string_to_tokens.lo 2023-05-10T04:21:40.362 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] str_to_bytes.lo 2023-05-10T04:21:40.566 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] tlibio.lo 2023-05-10T04:21:40.871 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] write_log.lo 2023-05-10T04:21:41.186 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] random.lo 2023-05-10T04:21:41.373 INFO:teuthology.orchestra.run.smithi132.stdout: [LD] 2023-05-10T04:21:41.488 INFO:teuthology.orchestra.run.smithi132.stdout:Building ltp 2023-05-10T04:21:41.494 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2023-05-10T04:21:41.680 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] doio 2023-05-10T04:21:42.401 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fsstress 2023-05-10T04:21:43.752 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fsx 2023-05-10T04:21:44.683 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] growfiles 2023-05-10T04:21:45.265 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] iogen 2023-05-10T04:21:45.700 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-stress 2023-05-10T04:21:46.194 INFO:teuthology.orchestra.run.smithi132.stdout:Building src 2023-05-10T04:21:46.203 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2023-05-10T04:21:48.587 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2023-05-10T04:21:48.634 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2023-05-10T04:21:48.649 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2023-05-10T04:21:48.982 INFO:teuthology.orchestra.run.smithi132.stdout: [DEP] 2023-05-10T04:21:49.020 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dirstress 2023-05-10T04:21:49.344 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fill 2023-05-10T04:21:49.584 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fill2 2023-05-10T04:21:49.897 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] getpagesize 2023-05-10T04:21:50.115 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] holes 2023-05-10T04:21:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] lstat64 2023-05-10T04:21:50.666 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] nametest 2023-05-10T04:21:50.990 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] permname 2023-05-10T04:21:51.274 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] randholes 2023-05-10T04:21:51.606 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] runas 2023-05-10T04:21:51.866 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] truncfile 2023-05-10T04:21:52.132 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] usemem 2023-05-10T04:21:52.365 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mmapcat 2023-05-10T04:21:52.598 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] append_reader 2023-05-10T04:21:52.832 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] append_writer 2023-05-10T04:21:53.068 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dirperf 2023-05-10T04:21:53.371 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] metaperf 2023-05-10T04:21:53.706 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] devzero 2023-05-10T04:21:53.967 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] feature 2023-05-10T04:21:54.269 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] alloc 2023-05-10T04:21:54.565 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fault 2023-05-10T04:21:54.817 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fstest 2023-05-10T04:21:55.137 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_access_root 2023-05-10T04:21:55.377 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] godown 2023-05-10T04:21:55.635 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] resvtest 2023-05-10T04:21:55.906 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] writemod 2023-05-10T04:21:56.134 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] writev_on_pagefault 2023-05-10T04:21:56.377 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] makeextents 2023-05-10T04:21:56.642 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] itrash 2023-05-10T04:21:56.881 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] rename 2023-05-10T04:21:57.103 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] multi_open_unlink 2023-05-10T04:21:57.351 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] unwritten_sync 2023-05-10T04:21:57.619 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] genhashnames 2023-05-10T04:21:57.888 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_holes 2023-05-10T04:21:58.118 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_writev 2023-05-10T04:21:58.350 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_truncate_cmtime 2023-05-10T04:21:58.593 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dirhash_collide 2023-05-10T04:21:58.857 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_rename_overwrite 2023-05-10T04:21:59.084 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] holetest 2023-05-10T04:21:59.383 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_truncate_self 2023-05-10T04:21:59.606 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] af_unix 2023-05-10T04:21:59.843 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_stale_pmd 2023-05-10T04:22:00.092 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_cow_race 2023-05-10T04:22:00.340 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_fallocate 2023-05-10T04:22:00.575 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fsync-err 2023-05-10T04:22:00.843 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_write_ro 2023-05-10T04:22:01.076 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-10T04:22:01.319 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-10T04:22:01.560 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_ofd_locks 2023-05-10T04:22:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_collision 2023-05-10T04:22:02.123 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mmap-write-concurrent 2023-05-10T04:22:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_get_file_time 2023-05-10T04:22:02.608 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_create_short_dirs 2023-05-10T04:22:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_create_long_dirs 2023-05-10T04:22:02.953 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:22:02.957 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:22:03.106 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_enospc 2023-05-10T04:22:03.376 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_writev_overlap 2023-05-10T04:22:03.630 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] checkpoint_journal 2023-05-10T04:22:03.869 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mmap-rw-fault 2023-05-10T04:22:04.130 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] allocstale 2023-05-10T04:22:04.385 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_cow_memory_failure 2023-05-10T04:22:04.640 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fake-dump-rootino 2023-05-10T04:22:04.873 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dio-buf-fault 2023-05-10T04:22:05.113 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] xfsctl 2023-05-10T04:22:05.387 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] bstat 2023-05-10T04:22:05.677 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mtab 2023-05-10T04:22:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] getdevicesize 2023-05-10T04:22:06.172 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] preallo_rw_pattern_reader 2023-05-10T04:22:06.417 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] preallo_rw_pattern_writer 2023-05-10T04:22:06.663 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] ftrunc 2023-05-10T04:22:06.894 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] trunc 2023-05-10T04:22:07.141 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fs_perms 2023-05-10T04:22:07.390 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] testx 2023-05-10T04:22:07.604 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] looptest 2023-05-10T04:22:07.881 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] locktest 2023-05-10T04:22:08.267 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] unwritten_mmap 2023-05-10T04:22:08.517 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] bulkstat_unlink_test 2023-05-10T04:22:08.802 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] deduperace 2023-05-10T04:22:09.079 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] bulkstat_unlink_test_modified 2023-05-10T04:22:09.363 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_dir_offset 2023-05-10T04:22:09.596 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_futimens 2023-05-10T04:22:09.820 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_immutable 2023-05-10T04:22:10.497 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] stale_handle 2023-05-10T04:22:10.753 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] pwrite_mmap_blocked 2023-05-10T04:22:10.992 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_dir_offset2 2023-05-10T04:22:11.268 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] seek_sanity_test 2023-05-10T04:22:11.759 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] seek_copy_test 2023-05-10T04:22:12.019 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_readdir_1 2023-05-10T04:22:12.255 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_readdir_2 2023-05-10T04:22:12.491 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fsync-tester 2023-05-10T04:22:12.820 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] nsexec 2023-05-10T04:22:13.080 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] cloner 2023-05-10T04:22:13.342 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] renameat2 2023-05-10T04:22:13.596 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_getcwd 2023-05-10T04:22:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] e4compact 2023-05-10T04:22:14.126 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] test-nextquota 2023-05-10T04:22:14.381 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] punch-alternating 2023-05-10T04:22:14.643 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-10T04:22:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] listxattr 2023-05-10T04:22:15.129 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dio-interleaved 2023-05-10T04:22:15.375 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_dir_type 2023-05-10T04:22:15.615 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] dio-invalidate-cache 2023-05-10T04:22:15.902 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] stat_test 2023-05-10T04:22:16.277 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_encrypted_d_revalidate 2023-05-10T04:22:16.527 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] attr_replace_test 2023-05-10T04:22:16.777 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] swapon 2023-05-10T04:22:17.027 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mkswap 2023-05-10T04:22:17.263 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_attr_corruption 2023-05-10T04:22:17.497 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_open_tmpfiles 2023-05-10T04:22:17.764 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fscrypt-crypt-util 2023-05-10T04:22:18.462 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] bulkstat_null_ocount 2023-05-10T04:22:18.710 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] splice-test 2023-05-10T04:22:18.975 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] chprojid_fail 2023-05-10T04:22:19.224 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] detached_mounts_propagation 2023-05-10T04:22:19.495 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] ext4_resize 2023-05-10T04:22:19.728 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_readdir_3 2023-05-10T04:22:20.006 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] splice2pipe 2023-05-10T04:22:20.254 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] uuid_ioctl 2023-05-10T04:22:20.495 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fiemap-tester 2023-05-10T04:22:20.849 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_stripealign 2023-05-10T04:22:21.087 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] open_by_handle 2023-05-10T04:22:21.424 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] t_mmap_dio 2023-05-10T04:22:21.672 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] xfsfind 2023-05-10T04:22:21.955 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] fssum 2023-05-10T04:22:22.466 INFO:teuthology.orchestra.run.smithi132.stdout:Building log-writes 2023-05-10T04:22:22.475 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] replay-log 2023-05-10T04:22:22.871 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2023-05-10T04:22:22.878 INFO:teuthology.orchestra.run.smithi132.stdout:Building aio-dio-regress 2023-05-10T04:22:22.888 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-10T04:22:23.152 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-fcntl-race 2023-05-10T04:22:23.402 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-subblock-eof-read 2023-05-10T04:22:23.635 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-append-write-read-race 2023-05-10T04:22:23.897 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-invalidate-readahead 2023-05-10T04:22:24.151 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-write-verify 2023-05-10T04:22:24.429 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-10T04:22:24.652 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-last-ref-held-by-io 2023-05-10T04:22:24.913 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-cycle-write 2023-05-10T04:22:25.185 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-extend-stat 2023-05-10T04:22:25.440 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-10T04:22:25.662 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-hole-filling-race 2023-05-10T04:22:25.901 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-invalidate-failure 2023-05-10T04:22:26.148 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aiodio_sparse2 2023-05-10T04:22:26.450 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aiocp 2023-05-10T04:22:26.760 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-cow-race 2023-05-10T04:22:27.002 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] aio-dio-eof-race 2023-05-10T04:22:27.273 INFO:teuthology.orchestra.run.smithi132.stdout:Building vfs 2023-05-10T04:22:27.282 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] vfstest 2023-05-10T04:22:29.243 INFO:teuthology.orchestra.run.smithi132.stdout: [CC] mount-idmapped 2023-05-10T04:22:29.706 INFO:teuthology.orchestra.run.smithi132.stdout:Building m4 2023-05-10T04:22:29.713 INFO:teuthology.orchestra.run.smithi132.stdout:Building common 2023-05-10T04:22:29.720 INFO:teuthology.orchestra.run.smithi132.stdout:Building tests 2023-05-10T04:22:29.729 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2023-05-10T04:22:29.738 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/perf/group.list 2023-05-10T04:22:29.765 INFO:teuthology.orchestra.run.smithi132.stdout:Building ext4 2023-05-10T04:22:29.775 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/ext4/group.list 2023-05-10T04:22:29.859 INFO:teuthology.orchestra.run.smithi132.stdout:Building ocfs2 2023-05-10T04:22:29.869 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/ocfs2/group.list 2023-05-10T04:22:29.899 INFO:teuthology.orchestra.run.smithi132.stdout:Building overlay 2023-05-10T04:22:29.908 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/overlay/group.list 2023-05-10T04:22:29.994 INFO:teuthology.orchestra.run.smithi132.stdout:Building cifs 2023-05-10T04:22:30.004 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/cifs/group.list 2023-05-10T04:22:30.033 INFO:teuthology.orchestra.run.smithi132.stdout:Building generic 2023-05-10T04:22:30.044 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/generic/group.list 2023-05-10T04:22:30.268 INFO:teuthology.orchestra.run.smithi132.stdout:Building shared 2023-05-10T04:22:30.276 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/shared/group.list 2023-05-10T04:22:30.315 INFO:teuthology.orchestra.run.smithi132.stdout:Building nfs 2023-05-10T04:22:30.324 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/nfs/group.list 2023-05-10T04:22:30.358 INFO:teuthology.orchestra.run.smithi132.stdout:Building f2fs 2023-05-10T04:22:30.367 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/f2fs/group.list 2023-05-10T04:22:30.406 INFO:teuthology.orchestra.run.smithi132.stdout:Building udf 2023-05-10T04:22:30.415 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/udf/group.list 2023-05-10T04:22:30.442 INFO:teuthology.orchestra.run.smithi132.stdout:Building ceph 2023-05-10T04:22:30.451 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/ceph/group.list 2023-05-10T04:22:30.484 INFO:teuthology.orchestra.run.smithi132.stdout:Building xfs 2023-05-10T04:22:30.496 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/xfs/group.list 2023-05-10T04:22:30.723 INFO:teuthology.orchestra.run.smithi132.stdout:Building btrfs 2023-05-10T04:22:30.733 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/btrfs/group.list 2023-05-10T04:22:30.864 INFO:teuthology.orchestra.run.smithi132.stdout:Building tmpfs 2023-05-10T04:22:30.873 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/tmpfs/group.list 2023-05-10T04:22:30.904 INFO:teuthology.orchestra.run.smithi132.stdout:Building selftest 2023-05-10T04:22:30.913 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/selftest/group.list 2023-05-10T04:22:30.944 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo make install) 2023-05-10T04:22:31.029 INFO:teuthology.orchestra.run.smithi132.stdout:Building include 2023-05-10T04:22:31.036 INFO:teuthology.orchestra.run.smithi132.stdout:Building lib 2023-05-10T04:22:31.043 INFO:teuthology.orchestra.run.smithi132.stdout:Building ltp 2023-05-10T04:22:31.051 INFO:teuthology.orchestra.run.smithi132.stdout:Building src 2023-05-10T04:22:31.108 INFO:teuthology.orchestra.run.smithi132.stdout:Building log-writes 2023-05-10T04:22:31.115 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2023-05-10T04:22:31.122 INFO:teuthology.orchestra.run.smithi132.stdout:Building aio-dio-regress 2023-05-10T04:22:31.129 INFO:teuthology.orchestra.run.smithi132.stdout:Building vfs 2023-05-10T04:22:31.137 INFO:teuthology.orchestra.run.smithi132.stdout:Building m4 2023-05-10T04:22:31.143 INFO:teuthology.orchestra.run.smithi132.stdout:Building common 2023-05-10T04:22:31.150 INFO:teuthology.orchestra.run.smithi132.stdout:Building tests 2023-05-10T04:22:31.159 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2023-05-10T04:22:31.168 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/perf/group.list 2023-05-10T04:22:31.195 INFO:teuthology.orchestra.run.smithi132.stdout:Building ext4 2023-05-10T04:22:31.204 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/ext4/group.list 2023-05-10T04:22:31.288 INFO:teuthology.orchestra.run.smithi132.stdout:Building ocfs2 2023-05-10T04:22:31.297 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/ocfs2/group.list 2023-05-10T04:22:31.328 INFO:teuthology.orchestra.run.smithi132.stdout:Building overlay 2023-05-10T04:22:31.337 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/overlay/group.list 2023-05-10T04:22:31.424 INFO:teuthology.orchestra.run.smithi132.stdout:Building cifs 2023-05-10T04:22:31.433 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/cifs/group.list 2023-05-10T04:22:31.461 INFO:teuthology.orchestra.run.smithi132.stdout:Building generic 2023-05-10T04:22:31.473 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/generic/group.list 2023-05-10T04:22:31.692 INFO:teuthology.orchestra.run.smithi132.stdout:Building shared 2023-05-10T04:22:31.701 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/shared/group.list 2023-05-10T04:22:31.741 INFO:teuthology.orchestra.run.smithi132.stdout:Building nfs 2023-05-10T04:22:31.750 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/nfs/group.list 2023-05-10T04:22:31.783 INFO:teuthology.orchestra.run.smithi132.stdout:Building f2fs 2023-05-10T04:22:31.792 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/f2fs/group.list 2023-05-10T04:22:31.833 INFO:teuthology.orchestra.run.smithi132.stdout:Building udf 2023-05-10T04:22:31.843 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/udf/group.list 2023-05-10T04:22:31.868 INFO:teuthology.orchestra.run.smithi132.stdout:Building ceph 2023-05-10T04:22:31.877 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/ceph/group.list 2023-05-10T04:22:31.912 INFO:teuthology.orchestra.run.smithi132.stdout:Building xfs 2023-05-10T04:22:31.921 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/xfs/group.list 2023-05-10T04:22:32.141 INFO:teuthology.orchestra.run.smithi132.stdout:Building btrfs 2023-05-10T04:22:32.151 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/btrfs/group.list 2023-05-10T04:22:32.279 INFO:teuthology.orchestra.run.smithi132.stdout:Building tmpfs 2023-05-10T04:22:32.288 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/tmpfs/group.list 2023-05-10T04:22:32.320 INFO:teuthology.orchestra.run.smithi132.stdout:Building selftest 2023-05-10T04:22:32.328 INFO:teuthology.orchestra.run.smithi132.stdout: [GROUP] /tmp/tmp.I82EepBFpzxfstests-dev/tests/selftest/group.list 2023-05-10T04:22:32.356 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-05-10T04:22:32.358 INFO:teuthology.orchestra.run.smithi132.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-10T04:22:32.358 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-05-10T04:22:32.361 INFO:teuthology.orchestra.run.smithi132.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-10T04:22:32.362 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-05-10T04:22:32.365 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-10T04:22:32.386 INFO:teuthology.orchestra.run.smithi132.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-10T04:22:32.551 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-10T04:22:32.573 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-05-10T04:22:32.602 INFO:teuthology.orchestra.run.smithi132.stdout:Building log-writes 2023-05-10T04:22:32.608 INFO:teuthology.orchestra.run.smithi132.stdout:Building perf 2023-05-10T04:22:32.615 INFO:teuthology.orchestra.run.smithi132.stdout:Building aio-dio-regress 2023-05-10T04:22:32.622 INFO:teuthology.orchestra.run.smithi132.stdout:Building vfs 2023-05-10T04:22:32.627 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake -C log-writes install 2023-05-10T04:22:32.630 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-10T04:22:32.652 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-10T04:22:32.673 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake -C perf install 2023-05-10T04:22:32.676 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-10T04:22:32.697 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 ResultData.py fio-insert-and-compare.py FioResultDecoder.py FioCompare.py generate-schema.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-10T04:22:32.754 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-05-10T04:22:32.757 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-10T04:22:32.778 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 aio-dio-append-write-fallocate-race aio-dio-fcntl-race aio-dio-subblock-eof-read aio-dio-append-write-read-race aio-dio-invalidate-readahead aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-last-ref-held-by-io aio-dio-cycle-write aio-dio-extend-stat aio-io-setup-with-nonwritable-context-pointer aio-dio-hole-filling-race aio-dio-invalidate-failure aiodio_sparse2 aiocp aio-dio-cow-race aio-dio-eof-race /var/lib/xfstests/src/aio-dio-regress 2023-05-10T04:22:32.914 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake -C vfs install 2023-05-10T04:22:32.916 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-10T04:22:32.938 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-10T04:22:32.968 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-10T04:22:32.989 INFO:teuthology.orchestra.run.smithi132.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-10T04:22:33.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:22:33.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:22:35.780 INFO:teuthology.orchestra.run.smithi132.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-10T04:22:35.986 INFO:teuthology.orchestra.run.smithi132.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-10T04:22:36.039 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-05-10T04:22:36.041 INFO:teuthology.orchestra.run.smithi132.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-10T04:22:36.041 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-05-10T04:22:36.044 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-10T04:22:36.065 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-10T04:22:36.408 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-05-10T04:22:36.410 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/btrfs/ install 2023-05-10T04:22:36.414 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-10T04:22:36.435 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-10T04:22:38.492 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-10T04:22:38.514 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 069.out 092.out 077.out 140.out 258.out 108.out 121.out 204.out 106.out 021.out 233.out 194.out 234.out 249.out 109.out 033.out 082.out 252.out 270.out 040.out 176.out 202.out 137.out 034.out 125.out 014.out 181.out 152.out 142.out 024.out 027.out 192.out 148.out 282.out 267.out 178.out 052.out 228.out 183.out 157.out 273.out 251.out 110.out 043.out 065.out 209.out 087.out 206.out 195.out 274.out 215.out 115.out 015.out 275.out 250.out 191.out 281.out 051.out 244.out 219.out 119.out 019.out 128.out 232.out 248.out 162.out 147.out 197.out 196.out 242.out 004.out 047.out 220.out 120.out 020.out 102.out 263.out 171.out 261.out 045.out 217.out 117.out 017.out 072.out 068.out 048.out 062.out 038.out 084.out 129.out 066.out 029.out 229.out 103.out 254.out 111.out 011.out 243.out 134.out 170.out 260.out 095.out 143.out 133.out 286.out 161.out 246.out 216.out 116.out 016.out 155.out 118.out 067.out 099.out 010.out 238.out 138.out 189.out 184.out 160.out 190.out 291.out 081.out 071.out 061.out 037.out 200.out 100.out 025.out 139.out 269.out 208.out 039.out 222.out 035.out 169.out 098.out 290.out 080.out 070.out 060.out 207.out 107.out 009.out 167.out 003.out 211.out 158.out 182.out 146.out 188.out 104.out 177.out 086.out 279.out 225.out 174.out 156.out 135.out 165.out 124.out 172.out 058.out 262.out 036.out 042.out 193.out 097.out 271.out 283.out 083.out 199.out 278.out 236.out 053.out 276.out 164.out 239.out 241.out 089.out 256.out 001.out 141.out 214.out 114.out 074.out 056.out 041.out 277.out 175.out 186.out 240.out 223.out 150.out 123.out 179.out 144.out 032.out 057.out 205.out 136.out 005.out 096.out 198.out 008.out 280.out 050.out 105.out 257.out 187.out 091.out 046.out 153.out 088.out 285.out 044.out 201.out 101.out 266.out 237.out 151.out 231.out 227.out 075.out 163.out 131.out 213.out 113.out 013.out 031.out 272.out 078.out 173.out 259.out 210.out 132.out 093.out 235.out 127.out 230.out 166.out 130.out 023.out 073.out 030.out 203.out 063.out 055.out 245.out 145.out 159.out 122.out 265.out 022.out 006.out 284.out 299.out 224.out 154.out 076.out 149.out 064.out 185.out 264.out 218.out 018.out 168.out 007.out 079.out 054.out 059.out 049.out 226.out 126.out 026.out 180.out 268.out 253.out 255.out 090.out 221.out 085.out 212.out 112.out 094.out 012.out 247.out 028.out 002.out /var/lib/xfstests/tests/btrfs 2023-05-10T04:22:40.571 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/ceph/ install 2023-05-10T04:22:40.574 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-10T04:22:40.596 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-10T04:22:40.645 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-10T04:22:40.667 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/ceph 2023-05-10T04:22:40.717 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/cifs/ install 2023-05-10T04:22:40.719 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-10T04:22:40.740 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-10T04:22:40.762 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-10T04:22:40.783 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-10T04:22:40.805 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/ext4/ install 2023-05-10T04:22:40.808 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-10T04:22:40.829 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-10T04:22:41.322 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-10T04:22:41.343 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out.nodelalloc 001.out.default 001.out.nozero 001.cfg 032.out 039.out 305.out 005.out 008.out 035.out 036.out 308.out 050.out 040.out 306.out 007.out 021.out 046.out 012.out 009.out 033.out 045.out 034.out 056.out 047.out 018.out 023.out 302.out 020.out 002.out 014.out 024.out 013.out 031.out 015.out 304.out 004.out 048.out 038.out 052.out 303.out 029.out 011.out 027.out 042.out 044.out 055.out 030.out 058.out 003.out 017.out 043.out 053.out 016.out 059.out 037.out 301.out 010.out 022.out 006.out 057.out 025.out 026.out 271.out 051.out 041.out 307.out 019.out 028.out 054.out 049.out /var/lib/xfstests/tests/ext4 2023-05-10T04:22:41.860 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/f2fs/ install 2023-05-10T04:22:41.862 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-10T04:22:41.884 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-10T04:22:41.913 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-10T04:22:41.934 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-10T04:22:41.964 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/generic/ install 2023-05-10T04:22:41.969 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-10T04:22:41.991 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-10T04:22:47.149 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-10T04:22:47.171 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 050.out.xfsquota 035.out.nfs 035.out.default 050.out.nojournal 050.out.default 050.cfg 035.cfg 208.out 433.out 670.out 040.out 104.out 575.out 537.out 683.out 497.out 337.out 702.out 460.out 149.out 088.out 366.out 202.out 137.out 034.out 110.out 389.out 403.out 593.out 571.out 243.out 592.out 282.out 472.out 468.out 628.out 528.out 607.out 428.out 659.out 407.out 228.out 128.out 171.out 028.out 620.out 273.out 555.out 492.out 609.out 707.out 693.out 595.out 506.out 268.out 632.out 532.out 591.out 281.out 471.out 619.out 255.out 013.out 419.out 319.out 177.out 523.out 119.out 019.out 727.out 372.out 645.out 673.out 190.out 686.out 312.out 718.out 143.out 716.out 161.out 516.out 518.out 538.out 655.out 216.out 116.out 016.out 155.out 338.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 457.out 333.out 258.out 362.out 379.out 691.out 039.out 173.out 498.out 665.out 098.out 711.out 290.out 480.out 706.out 060.out 406.out 306.out 106.out 642.out 447.out 217.out 120.out 191.out 411.out 481.out 211.out 158.out 014.out 182.out 370.out 188.out 030.out 099.out 585.out 724.out 624.out 524.out 174.out 156.out 324.out 224.out 313.out 355.out 124.out 672.out 278.out 063.out 058.out 384.out 296.out 042.out 193.out 271.out 465.out 473.out 335.out 247.out 509.out 568.out 309.out 441.out 440.out 475.out 548.out 356.out 341.out 094.out 241.out 600.out 089.out 714.out 614.out 514.out 414.out 314.out 416.out 214.out 381.out 342.out 041.out 664.out 340.out 358.out 572.out 586.out 521.out 240.out 549.out 095.out 633.out 434.out 140.out 708.out 533.out 508.out 408.out 599.out 476.out 087.out 199.out 458.out 233.out 639.out 721.out 540.out 397.out 053.out 279.out 276.out 448.out 164.out 376.out 589.out 587.out 339.out 294.out 352.out 484.out 489.out 139.out 317.out 399.out 220.out 552.out 695.out 017.out 677.out 175.out 315.out 295.out 580.out 075.out 186.out 452.out 679.out 292.out 252.out 077.out 167.out 688.out 206.out 348.out 394.out 651.out 184.out 466.out 697.out 495.out 725.out 109.out 482.out 625.out 283.out 525.out 488.out 496.out 325.out 551.out 225.out 322.out 636.out 125.out 715.out 192.out 544.out 515.out 650.out 152.out 658.out 563.out 393.out 578.out 451.out 015.out 392.out 682.out 684.out 550.out 052.out 652.out 534.out 351.out 583.out 450.out 463.out 251.out 267.out 176.out 069.out 644.out 065.out 487.out 615.out 395.out 676.out 415.out 344.out 215.out 115.out 444.out 027.out 250.out 391.out 674.out 464.out 705.out 536.out 577.out 439.out 244.out 336.out 144.out 505.out 405.out 057.out 205.out 136.out 598.out 363.out 036.out 198.out 723.out 008.out 390.out 680.out 605.out 305.out 105.out 005.out 367.out 291.out 719.out 323.out 685.out 562.out 382.out 570.out 388.out 527.out 237.out 151.out 227.out 163.out 044.out 332.out 661.out 582.out 232.out 478.out 584.out 462.out 597.out 412.out 132.out 179.out 037.out 293.out 499.out 638.out 353.out 020.out 660.out 561.out 141.out 076.out 668.out 648.out 387.out 594.out 438.out 265.out 289.out 574.out 006.out 690.out 284.out 519.out 567.out 299.out 474.out 456.out 461.out 477.out 307.out 647.out 493.out 107.out 007.out 380.out 526.out 479.out 426.out 150.out 326.out 082.out 226.out 413.out 126.out 025.out 121.out 026.out 021.out 485.out 694.out 347.out 275.out 090.out 361.out 564.out 302.out 432.out 002.out 558.out 162.out 147.out 288.out 197.out 033.out 396.out 051.out 350.out 547.out 047.out 024.out 360.out 543.out 261.out 045.out 692.out 443.out 726.out 378.out 346.out 048.out 062.out 626.out 529.out 231.out 343.out 662.out 425.out 329.out 165.out 334.out 103.out 003.out 129.out 423.out 371.out 234.out 183.out 671.out 486.out 223.out 123.out 262.out 669.out 023.out 459.out 616.out 032.out 266.out 146.out 398.out 696.out 427.out 590.out 280.out 470.out 455.out 187.out 091.out 046.out 374.out 631.out 328.out 260.out 654.out 359.out 531.out 649.out 301.out 101.out 635.out 623.out 385.out 331.out 556.out 713.out 613.out 513.out 622.out 131.out 213.out 634.out 031.out 565.out 630.out 675.out 272.out 530.out 510.out 627.out 573.out 576.out 430.out 310.out 569.out 454.out 259.out 210.out 449.out 327.out 330.out 067.out 093.out 604.out 287.out 127.out 699.out 166.out 130.out 219.out 073.out 603.out 503.out 303.out 203.out 354.out 157.out 386.out 349.out 055.out 245.out 709.out 522.out 422.out 222.out 159.out 539.out 249.out 122.out 689.out 022.out 681.out 424.out 321.out 066.out 490.out 435.out 375.out 134.out 154.out 566.out 618.out 501.out 418.out 318.out 542.out 218.out 118.out 018.out 377.out 172.out 168.out 079.out 469.out 054.out 059.out 049.out 442.out 657.out 621.out 180.out 270.out 253.out 421.out 712.out 612.out 667.out 512.out 494.out 221.out 212.out 112.out 256.out 012.out 029.out 195.out 554.out 148.out 185.out 596.out 720.out 248.out 196.out 520.out 242.out 420.out 285.out 320.out 629.out 230.out 602.out 502.out 402.out 102.out 717.out 617.out 517.out 429.out 417.out 365.out 092.out 117.out 357.out 072.out 068.out 229.out 038.out 084.out 056.out 369.out 611.out 511.out 311.out 368.out 637.out 111.out 011.out 257.out 194.out 170.out 606.out 133.out 286.out 043.out 437.out 545.out 559.out 710.out 610.out 687.out 410.out 701.out 601.out 401.out 201.out 010.out 001.out 096.out 114.out 113.out 074.out 581.out 145.out 641.out 491.out 081.out 071.out 083.out 653.out 700.out 064.out 400.out 300.out 200.out 100.out 646.out 541.out 445.out 269.out 546.out 656.out 698.out 553.out 178.out 298.out 446.out 080.out 070.out 608.out 507.out 409.out 308.out 209.out 108.out 009.out 643.out 004.out 557.out 453.out 666.out 236.out 078.out 364.out 097.out 383.out 085.out 704.out 588.out 504.out 404.out 304.out 204.out 535.out 345.out 246.out 467.out 086.out 254.out 207.out 142.out 235.out 436.out 703.out 135.out 264.out 431.out 678.out 373.out 316.out 169.out 640.out 579.out 297.out 153.out 560.out 663.out /var/lib/xfstests/tests/generic 2023-05-10T04:22:52.390 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/nfs/ install 2023-05-10T04:22:52.393 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-10T04:22:52.414 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-10T04:22:52.436 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-10T04:22:52.457 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-10T04:22:52.479 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/ocfs2/ install 2023-05-10T04:22:52.482 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-10T04:22:52.503 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-10T04:22:52.525 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-10T04:22:52.547 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-10T04:22:52.569 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/overlay/ install 2023-05-10T04:22:52.572 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-10T04:22:52.593 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-10T04:22:53.284 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-10T04:22:53.306 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 019.out 034.out 018.out 024.out 077.out 069.out 020.out 102.out 014.out 013.out 031.out 015.out 117.out 017.out 072.out 068.out 063.out 048.out 062.out 038.out 026.out 042.out 052.out 110.out 067.out 029.out 111.out 055.out 112.out 073.out 078.out 030.out 058.out 003.out 045.out 023.out 043.out 053.out 109.out 036.out 116.out 016.out 065.out 010.out 001.out 022.out 106.out 007.out 006.out 115.out 057.out 113.out 114.out 074.out 046.out 071.out 061.out 025.out 051.out 011.out 041.out 047.out 100.out 064.out 107.out 104.out 028.out 076.out 054.out 059.out 008.out 049.out 032.out 039.out 021.out 005.out 002.out 035.out 108.out 070.out 060.out 050.out 027.out 105.out 009.out 004.out 037.out 044.out 012.out 101.out 103.out 033.out 066.out 040.out 056.out 075.out /var/lib/xfstests/tests/overlay 2023-05-10T04:22:54.002 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/perf/ install 2023-05-10T04:22:54.005 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-10T04:22:54.026 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-10T04:22:54.048 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-10T04:22:54.069 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-10T04:22:54.091 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/selftest/ install 2023-05-10T04:22:54.093 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-10T04:22:54.115 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-10T04:22:54.171 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-10T04:22:54.192 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 006.out 003.out 005.out 001.out 004.out 002.out /var/lib/xfstests/tests/selftest 2023-05-10T04:22:54.249 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/shared/ install 2023-05-10T04:22:54.252 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-10T04:22:54.273 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-10T04:22:54.309 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-10T04:22:54.330 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 032.out 298.out 002.out /var/lib/xfstests/tests/shared 2023-05-10T04:22:54.366 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/tmpfs/ install 2023-05-10T04:22:54.369 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-10T04:22:54.391 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-10T04:22:54.412 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-10T04:22:54.433 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-10T04:22:54.455 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/udf/ install 2023-05-10T04:22:54.458 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-10T04:22:54.479 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-10T04:22:54.501 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-10T04:22:54.523 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-10T04:22:54.545 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.I82EepBFpzxfstests-dev/tests/xfs/ install 2023-05-10T04:22:54.551 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-10T04:22:54.573 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-10T04:22:59.453 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-10T04:22:59.475 INFO:teuthology.orchestra.run.smithi132.stdout:../../install-sh -o root -g root -m 644 096.out.internal 033.out.crc 096.out.external 033.out.default 071.out.64 216.out.classic 216.out.64mblog 071.out.32 216.cfg 033.cfg 040.out 304.out 349.out 457.out 537.out 295.out 497.out 337.out 385.out 082.out 270.out 460.out 149.out 759.out 502.out 088.out 366.out 202.out 137.out 746.out 110.out 468.out 018.out 593.out 571.out 567.out 592.out 282.out 267.out 728.out 178.out 799.out 528.out 769.out 428.out 507.out 407.out 228.out 128.out 171.out 183.out 247.out 273.out 474.out 109.out 595.out 506.out 732.out 268.out 035.out 113.out 532.out 591.out 281.out 471.out 723.out 519.out 319.out 467.out 523.out 119.out 775.out 727.out 372.out 503.out 526.out 329.out 165.out 229.out 103.out 129.out 371.out 234.out 738.out 078.out 718.out 143.out 716.out 161.out 516.out 416.out 116.out 043.out 155.out 338.out 067.out 238.out 500.out 138.out 189.out 263.out 277.out 181.out 160.out 483.out 274.out 722.out 061.out 239.out 047.out 772.out 258.out 379.out 322.out 039.out 173.out 222.out 742.out 098.out 426.out 290.out 480.out 060.out 406.out 306.out 141.out 106.out 006.out 167.out 191.out 017.out 542.out 211.out 783.out 485.out 442.out 099.out 177.out 174.out 156.out 771.out 324.out 224.out 313.out 124.out 758.out 278.out 058.out 741.out 384.out 773.out 042.out 193.out 392.out 768.out 399.out 473.out 770.out 709.out 755.out 364.out 209.out 441.out 440.out 157.out 740.out 356.out 197.out 341.out 187.out 094.out 241.out 501.out 089.out 540.out 365.out 514.out 414.out 314.out 214.out 381.out 056.out 041.out 340.out 793.out 358.out 572.out 568.out 586.out 240.out 549.out 092.out 439.out 434.out 140.out 708.out 265.out 508.out 408.out 308.out 208.out 737.out 204.out 535.out 104.out 733.out 544.out 059.out 249.out 335.out 142.out 235.out 575.out 253.out 715.out 533.out 264.out 431.out 784.out 433.out 316.out 169.out 579.out 297.out 393.out 333.out 476.out 087.out 199.out 739.out 068.out 233.out 752.out 736.out 443.out 086.out 053.out 749.out 279.out 276.out 711.out 164.out 589.out 587.out 339.out 577.out 294.out 352.out 458.out 498.out 489.out 139.out 774.out 790.out 552.out 781.out 357.out 065.out 186.out 452.out 069.out 252.out 585.out 751.out 724.out 206.out 190.out 794.out 348.out 184.out 435.out 466.out 248.out 725.out 785.out 482.out 750.out 525.out 496.out 325.out 176.out 225.out 125.out 789.out 192.out 296.out 152.out 563.out 246.out 551.out 436.out 792.out 075.out 472.out 578.out 463.out 550.out 052.out 534.out 351.out 430.out 583.out 305.out 451.out 425.out 450.out 744.out 251.out 444.out 487.out 762.out 465.out 395.out 515.out 415.out 389.out 315.out 215.out 115.out 015.out 027.out 250.out 344.out 046.out 051.out 536.out 254.out 030.out 244.out 336.out 028.out 150.out 144.out 505.out 342.out 136.out 005.out 036.out 198.out 008.out 390.out 405.out 588.out 205.out 105.out 367.out 291.out 437.out 719.out 323.out 363.out 562.out 382.out 570.out 388.out 527.out 158.out 766.out 019.out 237.out 151.out 760.out 227.out 163.out 332.out 796.out 232.out 478.out 584.out 462.out 220.out 412.out 132.out 179.out 037.out 293.out 492.out 499.out 112.out 748.out 020.out 786.out 063.out 561.out 076.out 044.out 014.out 362.out 387.out 594.out 438.out 721.out 289.out 574.out 284.out 548.out 299.out 419.out 521.out 581.out 461.out 477.out 307.out 726.out 107.out 007.out 448.out 262.out 380.out 093.out 479.out 547.out 326.out 226.out 345.out 126.out 025.out 121.out 447.out 761.out 580.out 013.out 347.out 275.out 090.out 361.out 564.out 788.out 066.out 455.out 432.out 747.out 558.out 162.out 147.out 288.out 050.out 396.out 576.out 350.out 354.out 298.out 301.out 360.out 543.out 261.out 734.out 045.out 292.out 255.out 729.out 378.out 346.out 048.out 062.out 529.out 231.out 343.out 486.out 223.out 123.out 023.out 459.out 032.out 798.out 146.out 398.out 168.out 427.out 590.out 280.out 470.out 484.out 491.out 767.out 016.out 488.out 731.out 782.out 374.out 285.out 127.out 328.out 260.out 359.out 531.out 376.out 101.out 266.out 331.out 791.out 743.out 556.out 713.out 024.out 513.out 131.out 213.out 730.out 095.out 031.out 565.out 182.out 272.out 530.out 754.out 573.out 454.out 259.out 449.out 327.out 330.out 777.out 493.out 010.out 287.out 230.out 166.out 130.out 219.out 073.out 370.out 135.out 303.out 203.out 003.out 355.out 386.out 560.out 055.out 245.out 243.out 522.out 787.out 745.out 422.out 394.out 159.out 539.out 524.out 122.out 022.out 424.out 779.out 490.out 795.out 353.out 423.out 134.out 154.out 764.out 271.out 518.out 418.out 318.out 077.out 218.out 118.out 757.out 377.out 172.out 034.out 079.out 469.out 054.out 049.out 765.out 021.out 002.out 456.out 180.out 421.out 712.out 403.out 321.out 057.out 512.out 494.out 221.out 312.out 212.out 538.out 256.out 012.out 195.out 283.out 554.out 397.out 185.out 373.out 720.out 481.out 196.out 520.out 242.out 026.out 420.out 188.out 320.out 555.out 120.out 153.out 402.out 302.out 102.out 717.out 517.out 429.out 417.out 317.out 217.out 117.out 475.out 072.out 778.out 097.out 038.out 084.out 369.out 511.out 148.out 411.out 029.out 311.out 368.out 111.out 011.out 257.out 194.out 170.out 133.out 286.out 756.out 175.out 545.out 714.out 559.out 710.out 510.out 413.out 410.out 310.out 210.out 401.out 201.out 001.out 495.out 114.out 753.out 074.out 145.out 797.out 464.out 091.out 081.out 083.out 800.out 064.out 400.out 300.out 200.out 100.out 375.out 541.out 445.out 269.out 546.out 780.out 553.out 763.out 446.out 080.out 070.out 509.out 409.out 309.out 207.out 108.out 009.out 391.out 004.out 557.out 453.out 236.out 566.out 582.out 735.out 383.out 085.out 334.out 504.out 404.out 776.out /var/lib/xfstests/tests/xfs 2023-05-10T04:23:03.211 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:23:03.216 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:23:04.414 INFO:teuthology.orchestra.run.smithi132.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-10T04:23:04.435 INFO:teuthology.orchestra.run.smithi132.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-10T04:23:04.456 INFO:teuthology.orchestra.run.smithi132.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-10T04:23:04.478 INFO:teuthology.orchestra.run.smithi132.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-10T04:23:04.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-10T04:23:04.504 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec ls tests/generic) 2023-05-10T04:23:04.544 INFO:teuthology.orchestra.run.smithi132.stdout:001 2023-05-10T04:23:04.545 INFO:teuthology.orchestra.run.smithi132.stdout:001.out 2023-05-10T04:23:04.545 INFO:teuthology.orchestra.run.smithi132.stdout:002 2023-05-10T04:23:04.545 INFO:teuthology.orchestra.run.smithi132.stdout:002.out 2023-05-10T04:23:04.545 INFO:teuthology.orchestra.run.smithi132.stdout:003 2023-05-10T04:23:04.545 INFO:teuthology.orchestra.run.smithi132.stdout:003.out 2023-05-10T04:23:04.546 INFO:teuthology.orchestra.run.smithi132.stdout:004 2023-05-10T04:23:04.546 INFO:teuthology.orchestra.run.smithi132.stdout:004.out 2023-05-10T04:23:04.546 INFO:teuthology.orchestra.run.smithi132.stdout:005 2023-05-10T04:23:04.546 INFO:teuthology.orchestra.run.smithi132.stdout:005.out 2023-05-10T04:23:04.546 INFO:teuthology.orchestra.run.smithi132.stdout:006 2023-05-10T04:23:04.546 INFO:teuthology.orchestra.run.smithi132.stdout:006.out 2023-05-10T04:23:04.546 INFO:teuthology.orchestra.run.smithi132.stdout:007 2023-05-10T04:23:04.546 INFO:teuthology.orchestra.run.smithi132.stdout:007.out 2023-05-10T04:23:04.547 INFO:teuthology.orchestra.run.smithi132.stdout:008 2023-05-10T04:23:04.547 INFO:teuthology.orchestra.run.smithi132.stdout:008.out 2023-05-10T04:23:04.547 INFO:teuthology.orchestra.run.smithi132.stdout:009 2023-05-10T04:23:04.547 INFO:teuthology.orchestra.run.smithi132.stdout:009.out 2023-05-10T04:23:04.547 INFO:teuthology.orchestra.run.smithi132.stdout:010 2023-05-10T04:23:04.547 INFO:teuthology.orchestra.run.smithi132.stdout:010.out 2023-05-10T04:23:04.547 INFO:teuthology.orchestra.run.smithi132.stdout:011 2023-05-10T04:23:04.548 INFO:teuthology.orchestra.run.smithi132.stdout:011.out 2023-05-10T04:23:04.548 INFO:teuthology.orchestra.run.smithi132.stdout:012 2023-05-10T04:23:04.548 INFO:teuthology.orchestra.run.smithi132.stdout:012.out 2023-05-10T04:23:04.548 INFO:teuthology.orchestra.run.smithi132.stdout:013 2023-05-10T04:23:04.548 INFO:teuthology.orchestra.run.smithi132.stdout:013.out 2023-05-10T04:23:04.548 INFO:teuthology.orchestra.run.smithi132.stdout:014 2023-05-10T04:23:04.548 INFO:teuthology.orchestra.run.smithi132.stdout:014.out 2023-05-10T04:23:04.549 INFO:teuthology.orchestra.run.smithi132.stdout:015 2023-05-10T04:23:04.549 INFO:teuthology.orchestra.run.smithi132.stdout:015.out 2023-05-10T04:23:04.549 INFO:teuthology.orchestra.run.smithi132.stdout:016 2023-05-10T04:23:04.549 INFO:teuthology.orchestra.run.smithi132.stdout:016.out 2023-05-10T04:23:04.549 INFO:teuthology.orchestra.run.smithi132.stdout:017 2023-05-10T04:23:04.549 INFO:teuthology.orchestra.run.smithi132.stdout:017.out 2023-05-10T04:23:04.549 INFO:teuthology.orchestra.run.smithi132.stdout:018 2023-05-10T04:23:04.549 INFO:teuthology.orchestra.run.smithi132.stdout:018.out 2023-05-10T04:23:04.550 INFO:teuthology.orchestra.run.smithi132.stdout:019 2023-05-10T04:23:04.550 INFO:teuthology.orchestra.run.smithi132.stdout:019.out 2023-05-10T04:23:04.550 INFO:teuthology.orchestra.run.smithi132.stdout:020 2023-05-10T04:23:04.550 INFO:teuthology.orchestra.run.smithi132.stdout:020.out 2023-05-10T04:23:04.550 INFO:teuthology.orchestra.run.smithi132.stdout:021 2023-05-10T04:23:04.550 INFO:teuthology.orchestra.run.smithi132.stdout:021.out 2023-05-10T04:23:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:022 2023-05-10T04:23:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:022.out 2023-05-10T04:23:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:023 2023-05-10T04:23:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:023.out 2023-05-10T04:23:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:024 2023-05-10T04:23:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:024.out 2023-05-10T04:23:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:025 2023-05-10T04:23:04.551 INFO:teuthology.orchestra.run.smithi132.stdout:025.out 2023-05-10T04:23:04.552 INFO:teuthology.orchestra.run.smithi132.stdout:026 2023-05-10T04:23:04.552 INFO:teuthology.orchestra.run.smithi132.stdout:026.out 2023-05-10T04:23:04.552 INFO:teuthology.orchestra.run.smithi132.stdout:027 2023-05-10T04:23:04.552 INFO:teuthology.orchestra.run.smithi132.stdout:027.out 2023-05-10T04:23:04.552 INFO:teuthology.orchestra.run.smithi132.stdout:028 2023-05-10T04:23:04.552 INFO:teuthology.orchestra.run.smithi132.stdout:028.out 2023-05-10T04:23:04.552 INFO:teuthology.orchestra.run.smithi132.stdout:029 2023-05-10T04:23:04.552 INFO:teuthology.orchestra.run.smithi132.stdout:029.out 2023-05-10T04:23:04.553 INFO:teuthology.orchestra.run.smithi132.stdout:030 2023-05-10T04:23:04.553 INFO:teuthology.orchestra.run.smithi132.stdout:030.out 2023-05-10T04:23:04.553 INFO:teuthology.orchestra.run.smithi132.stdout:031 2023-05-10T04:23:04.553 INFO:teuthology.orchestra.run.smithi132.stdout:031.out 2023-05-10T04:23:04.553 INFO:teuthology.orchestra.run.smithi132.stdout:032 2023-05-10T04:23:04.553 INFO:teuthology.orchestra.run.smithi132.stdout:032.out 2023-05-10T04:23:04.553 INFO:teuthology.orchestra.run.smithi132.stdout:033 2023-05-10T04:23:04.554 INFO:teuthology.orchestra.run.smithi132.stdout:033.out 2023-05-10T04:23:04.554 INFO:teuthology.orchestra.run.smithi132.stdout:034 2023-05-10T04:23:04.554 INFO:teuthology.orchestra.run.smithi132.stdout:034.out 2023-05-10T04:23:04.554 INFO:teuthology.orchestra.run.smithi132.stdout:035 2023-05-10T04:23:04.554 INFO:teuthology.orchestra.run.smithi132.stdout:035.cfg 2023-05-10T04:23:04.554 INFO:teuthology.orchestra.run.smithi132.stdout:035.out.default 2023-05-10T04:23:04.554 INFO:teuthology.orchestra.run.smithi132.stdout:035.out.nfs 2023-05-10T04:23:04.555 INFO:teuthology.orchestra.run.smithi132.stdout:036 2023-05-10T04:23:04.555 INFO:teuthology.orchestra.run.smithi132.stdout:036.out 2023-05-10T04:23:04.555 INFO:teuthology.orchestra.run.smithi132.stdout:037 2023-05-10T04:23:04.555 INFO:teuthology.orchestra.run.smithi132.stdout:037.out 2023-05-10T04:23:04.555 INFO:teuthology.orchestra.run.smithi132.stdout:038 2023-05-10T04:23:04.555 INFO:teuthology.orchestra.run.smithi132.stdout:038.out 2023-05-10T04:23:04.555 INFO:teuthology.orchestra.run.smithi132.stdout:039 2023-05-10T04:23:04.556 INFO:teuthology.orchestra.run.smithi132.stdout:039.out 2023-05-10T04:23:04.556 INFO:teuthology.orchestra.run.smithi132.stdout:040 2023-05-10T04:23:04.556 INFO:teuthology.orchestra.run.smithi132.stdout:040.out 2023-05-10T04:23:04.556 INFO:teuthology.orchestra.run.smithi132.stdout:041 2023-05-10T04:23:04.556 INFO:teuthology.orchestra.run.smithi132.stdout:041.out 2023-05-10T04:23:04.556 INFO:teuthology.orchestra.run.smithi132.stdout:042 2023-05-10T04:23:04.556 INFO:teuthology.orchestra.run.smithi132.stdout:042.out 2023-05-10T04:23:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:043 2023-05-10T04:23:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:043.out 2023-05-10T04:23:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:044 2023-05-10T04:23:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:044.out 2023-05-10T04:23:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:045 2023-05-10T04:23:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:045.out 2023-05-10T04:23:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:046 2023-05-10T04:23:04.557 INFO:teuthology.orchestra.run.smithi132.stdout:046.out 2023-05-10T04:23:04.558 INFO:teuthology.orchestra.run.smithi132.stdout:047 2023-05-10T04:23:04.558 INFO:teuthology.orchestra.run.smithi132.stdout:047.out 2023-05-10T04:23:04.558 INFO:teuthology.orchestra.run.smithi132.stdout:048 2023-05-10T04:23:04.558 INFO:teuthology.orchestra.run.smithi132.stdout:048.out 2023-05-10T04:23:04.558 INFO:teuthology.orchestra.run.smithi132.stdout:049 2023-05-10T04:23:04.558 INFO:teuthology.orchestra.run.smithi132.stdout:049.out 2023-05-10T04:23:04.558 INFO:teuthology.orchestra.run.smithi132.stdout:050 2023-05-10T04:23:04.558 INFO:teuthology.orchestra.run.smithi132.stdout:050.cfg 2023-05-10T04:23:04.559 INFO:teuthology.orchestra.run.smithi132.stdout:050.out.default 2023-05-10T04:23:04.559 INFO:teuthology.orchestra.run.smithi132.stdout:050.out.nojournal 2023-05-10T04:23:04.559 INFO:teuthology.orchestra.run.smithi132.stdout:050.out.xfsquota 2023-05-10T04:23:04.559 INFO:teuthology.orchestra.run.smithi132.stdout:051 2023-05-10T04:23:04.559 INFO:teuthology.orchestra.run.smithi132.stdout:051.out 2023-05-10T04:23:04.559 INFO:teuthology.orchestra.run.smithi132.stdout:052 2023-05-10T04:23:04.559 INFO:teuthology.orchestra.run.smithi132.stdout:052.out 2023-05-10T04:23:04.559 INFO:teuthology.orchestra.run.smithi132.stdout:053 2023-05-10T04:23:04.560 INFO:teuthology.orchestra.run.smithi132.stdout:053.out 2023-05-10T04:23:04.560 INFO:teuthology.orchestra.run.smithi132.stdout:054 2023-05-10T04:23:04.560 INFO:teuthology.orchestra.run.smithi132.stdout:054.out 2023-05-10T04:23:04.560 INFO:teuthology.orchestra.run.smithi132.stdout:055 2023-05-10T04:23:04.560 INFO:teuthology.orchestra.run.smithi132.stdout:055.out 2023-05-10T04:23:04.560 INFO:teuthology.orchestra.run.smithi132.stdout:056 2023-05-10T04:23:04.560 INFO:teuthology.orchestra.run.smithi132.stdout:056.out 2023-05-10T04:23:04.561 INFO:teuthology.orchestra.run.smithi132.stdout:057 2023-05-10T04:23:04.561 INFO:teuthology.orchestra.run.smithi132.stdout:057.out 2023-05-10T04:23:04.561 INFO:teuthology.orchestra.run.smithi132.stdout:058 2023-05-10T04:23:04.561 INFO:teuthology.orchestra.run.smithi132.stdout:058.out 2023-05-10T04:23:04.561 INFO:teuthology.orchestra.run.smithi132.stdout:059 2023-05-10T04:23:04.561 INFO:teuthology.orchestra.run.smithi132.stdout:059.out 2023-05-10T04:23:04.561 INFO:teuthology.orchestra.run.smithi132.stdout:060 2023-05-10T04:23:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:060.out 2023-05-10T04:23:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:061 2023-05-10T04:23:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:061.out 2023-05-10T04:23:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:062 2023-05-10T04:23:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:062.out 2023-05-10T04:23:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:063 2023-05-10T04:23:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:063.out 2023-05-10T04:23:04.562 INFO:teuthology.orchestra.run.smithi132.stdout:064 2023-05-10T04:23:04.563 INFO:teuthology.orchestra.run.smithi132.stdout:064.out 2023-05-10T04:23:04.563 INFO:teuthology.orchestra.run.smithi132.stdout:065 2023-05-10T04:23:04.563 INFO:teuthology.orchestra.run.smithi132.stdout:065.out 2023-05-10T04:23:04.563 INFO:teuthology.orchestra.run.smithi132.stdout:066 2023-05-10T04:23:04.563 INFO:teuthology.orchestra.run.smithi132.stdout:066.out 2023-05-10T04:23:04.563 INFO:teuthology.orchestra.run.smithi132.stdout:067 2023-05-10T04:23:04.563 INFO:teuthology.orchestra.run.smithi132.stdout:067.out 2023-05-10T04:23:04.563 INFO:teuthology.orchestra.run.smithi132.stdout:068 2023-05-10T04:23:04.564 INFO:teuthology.orchestra.run.smithi132.stdout:068.out 2023-05-10T04:23:04.564 INFO:teuthology.orchestra.run.smithi132.stdout:069 2023-05-10T04:23:04.564 INFO:teuthology.orchestra.run.smithi132.stdout:069.out 2023-05-10T04:23:04.564 INFO:teuthology.orchestra.run.smithi132.stdout:070 2023-05-10T04:23:04.564 INFO:teuthology.orchestra.run.smithi132.stdout:070.out 2023-05-10T04:23:04.564 INFO:teuthology.orchestra.run.smithi132.stdout:071 2023-05-10T04:23:04.564 INFO:teuthology.orchestra.run.smithi132.stdout:071.out 2023-05-10T04:23:04.565 INFO:teuthology.orchestra.run.smithi132.stdout:072 2023-05-10T04:23:04.565 INFO:teuthology.orchestra.run.smithi132.stdout:072.out 2023-05-10T04:23:04.565 INFO:teuthology.orchestra.run.smithi132.stdout:073 2023-05-10T04:23:04.565 INFO:teuthology.orchestra.run.smithi132.stdout:073.out 2023-05-10T04:23:04.565 INFO:teuthology.orchestra.run.smithi132.stdout:074 2023-05-10T04:23:04.565 INFO:teuthology.orchestra.run.smithi132.stdout:074.out 2023-05-10T04:23:04.565 INFO:teuthology.orchestra.run.smithi132.stdout:075 2023-05-10T04:23:04.565 INFO:teuthology.orchestra.run.smithi132.stdout:075.out 2023-05-10T04:23:04.566 INFO:teuthology.orchestra.run.smithi132.stdout:076 2023-05-10T04:23:04.566 INFO:teuthology.orchestra.run.smithi132.stdout:076.out 2023-05-10T04:23:04.566 INFO:teuthology.orchestra.run.smithi132.stdout:077 2023-05-10T04:23:04.566 INFO:teuthology.orchestra.run.smithi132.stdout:077.out 2023-05-10T04:23:04.566 INFO:teuthology.orchestra.run.smithi132.stdout:078 2023-05-10T04:23:04.566 INFO:teuthology.orchestra.run.smithi132.stdout:078.out 2023-05-10T04:23:04.566 INFO:teuthology.orchestra.run.smithi132.stdout:079 2023-05-10T04:23:04.567 INFO:teuthology.orchestra.run.smithi132.stdout:079.out 2023-05-10T04:23:04.567 INFO:teuthology.orchestra.run.smithi132.stdout:080 2023-05-10T04:23:04.567 INFO:teuthology.orchestra.run.smithi132.stdout:080.out 2023-05-10T04:23:04.567 INFO:teuthology.orchestra.run.smithi132.stdout:081 2023-05-10T04:23:04.567 INFO:teuthology.orchestra.run.smithi132.stdout:081.out 2023-05-10T04:23:04.567 INFO:teuthology.orchestra.run.smithi132.stdout:082 2023-05-10T04:23:04.567 INFO:teuthology.orchestra.run.smithi132.stdout:082.out 2023-05-10T04:23:04.567 INFO:teuthology.orchestra.run.smithi132.stdout:083 2023-05-10T04:23:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:083.out 2023-05-10T04:23:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:084 2023-05-10T04:23:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:084.out 2023-05-10T04:23:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:085 2023-05-10T04:23:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:085.out 2023-05-10T04:23:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:086 2023-05-10T04:23:04.568 INFO:teuthology.orchestra.run.smithi132.stdout:086.out 2023-05-10T04:23:04.569 INFO:teuthology.orchestra.run.smithi132.stdout:087 2023-05-10T04:23:04.569 INFO:teuthology.orchestra.run.smithi132.stdout:087.out 2023-05-10T04:23:04.569 INFO:teuthology.orchestra.run.smithi132.stdout:088 2023-05-10T04:23:04.569 INFO:teuthology.orchestra.run.smithi132.stdout:088.out 2023-05-10T04:23:04.569 INFO:teuthology.orchestra.run.smithi132.stdout:089 2023-05-10T04:23:04.569 INFO:teuthology.orchestra.run.smithi132.stdout:089.out 2023-05-10T04:23:04.569 INFO:teuthology.orchestra.run.smithi132.stdout:090 2023-05-10T04:23:04.569 INFO:teuthology.orchestra.run.smithi132.stdout:090.out 2023-05-10T04:23:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:091 2023-05-10T04:23:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:091.out 2023-05-10T04:23:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:092 2023-05-10T04:23:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:092.out 2023-05-10T04:23:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:093 2023-05-10T04:23:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:093.out 2023-05-10T04:23:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:094 2023-05-10T04:23:04.570 INFO:teuthology.orchestra.run.smithi132.stdout:094.out 2023-05-10T04:23:04.571 INFO:teuthology.orchestra.run.smithi132.stdout:095 2023-05-10T04:23:04.571 INFO:teuthology.orchestra.run.smithi132.stdout:095.out 2023-05-10T04:23:04.571 INFO:teuthology.orchestra.run.smithi132.stdout:096 2023-05-10T04:23:04.571 INFO:teuthology.orchestra.run.smithi132.stdout:096.out 2023-05-10T04:23:04.571 INFO:teuthology.orchestra.run.smithi132.stdout:097 2023-05-10T04:23:04.571 INFO:teuthology.orchestra.run.smithi132.stdout:097.out 2023-05-10T04:23:04.571 INFO:teuthology.orchestra.run.smithi132.stdout:098 2023-05-10T04:23:04.571 INFO:teuthology.orchestra.run.smithi132.stdout:098.out 2023-05-10T04:23:04.572 INFO:teuthology.orchestra.run.smithi132.stdout:099 2023-05-10T04:23:04.572 INFO:teuthology.orchestra.run.smithi132.stdout:099.out 2023-05-10T04:23:04.572 INFO:teuthology.orchestra.run.smithi132.stdout:100 2023-05-10T04:23:04.572 INFO:teuthology.orchestra.run.smithi132.stdout:100.out 2023-05-10T04:23:04.572 INFO:teuthology.orchestra.run.smithi132.stdout:101 2023-05-10T04:23:04.572 INFO:teuthology.orchestra.run.smithi132.stdout:101.out 2023-05-10T04:23:04.572 INFO:teuthology.orchestra.run.smithi132.stdout:102 2023-05-10T04:23:04.572 INFO:teuthology.orchestra.run.smithi132.stdout:102.out 2023-05-10T04:23:04.573 INFO:teuthology.orchestra.run.smithi132.stdout:103 2023-05-10T04:23:04.573 INFO:teuthology.orchestra.run.smithi132.stdout:103.out 2023-05-10T04:23:04.573 INFO:teuthology.orchestra.run.smithi132.stdout:104 2023-05-10T04:23:04.573 INFO:teuthology.orchestra.run.smithi132.stdout:104.out 2023-05-10T04:23:04.573 INFO:teuthology.orchestra.run.smithi132.stdout:105 2023-05-10T04:23:04.573 INFO:teuthology.orchestra.run.smithi132.stdout:105.out 2023-05-10T04:23:04.573 INFO:teuthology.orchestra.run.smithi132.stdout:106 2023-05-10T04:23:04.573 INFO:teuthology.orchestra.run.smithi132.stdout:106.out 2023-05-10T04:23:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:107 2023-05-10T04:23:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:107.out 2023-05-10T04:23:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:108 2023-05-10T04:23:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:108.out 2023-05-10T04:23:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:109 2023-05-10T04:23:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:109.out 2023-05-10T04:23:04.574 INFO:teuthology.orchestra.run.smithi132.stdout:110 2023-05-10T04:23:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:110.out 2023-05-10T04:23:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:111 2023-05-10T04:23:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:111.out 2023-05-10T04:23:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:112 2023-05-10T04:23:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:112.out 2023-05-10T04:23:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:113 2023-05-10T04:23:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:113.out 2023-05-10T04:23:04.575 INFO:teuthology.orchestra.run.smithi132.stdout:114 2023-05-10T04:23:04.576 INFO:teuthology.orchestra.run.smithi132.stdout:114.out 2023-05-10T04:23:04.576 INFO:teuthology.orchestra.run.smithi132.stdout:115 2023-05-10T04:23:04.576 INFO:teuthology.orchestra.run.smithi132.stdout:115.out 2023-05-10T04:23:04.576 INFO:teuthology.orchestra.run.smithi132.stdout:116 2023-05-10T04:23:04.576 INFO:teuthology.orchestra.run.smithi132.stdout:116.out 2023-05-10T04:23:04.576 INFO:teuthology.orchestra.run.smithi132.stdout:117 2023-05-10T04:23:04.576 INFO:teuthology.orchestra.run.smithi132.stdout:117.out 2023-05-10T04:23:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:118 2023-05-10T04:23:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:118.out 2023-05-10T04:23:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:119 2023-05-10T04:23:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:119.out 2023-05-10T04:23:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:120 2023-05-10T04:23:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:120.out 2023-05-10T04:23:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:121 2023-05-10T04:23:04.577 INFO:teuthology.orchestra.run.smithi132.stdout:121.out 2023-05-10T04:23:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:122 2023-05-10T04:23:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:122.out 2023-05-10T04:23:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:123 2023-05-10T04:23:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:123.out 2023-05-10T04:23:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:124 2023-05-10T04:23:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:124.out 2023-05-10T04:23:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:125 2023-05-10T04:23:04.578 INFO:teuthology.orchestra.run.smithi132.stdout:125.out 2023-05-10T04:23:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:126 2023-05-10T04:23:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:126.out 2023-05-10T04:23:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:127 2023-05-10T04:23:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:127.out 2023-05-10T04:23:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:128 2023-05-10T04:23:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:128.out 2023-05-10T04:23:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:129 2023-05-10T04:23:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:129.out 2023-05-10T04:23:04.580 INFO:teuthology.orchestra.run.smithi132.stdout:130 2023-05-10T04:23:04.580 INFO:teuthology.orchestra.run.smithi132.stdout:130.out 2023-05-10T04:23:04.580 INFO:teuthology.orchestra.run.smithi132.stdout:131 2023-05-10T04:23:04.580 INFO:teuthology.orchestra.run.smithi132.stdout:131.out 2023-05-10T04:23:04.580 INFO:teuthology.orchestra.run.smithi132.stdout:132 2023-05-10T04:23:04.580 INFO:teuthology.orchestra.run.smithi132.stdout:132.out 2023-05-10T04:23:04.580 INFO:teuthology.orchestra.run.smithi132.stdout:133 2023-05-10T04:23:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:133.out 2023-05-10T04:23:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:134 2023-05-10T04:23:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:134.out 2023-05-10T04:23:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:135 2023-05-10T04:23:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:135.out 2023-05-10T04:23:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:136 2023-05-10T04:23:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:136.out 2023-05-10T04:23:04.581 INFO:teuthology.orchestra.run.smithi132.stdout:137 2023-05-10T04:23:04.582 INFO:teuthology.orchestra.run.smithi132.stdout:137.out 2023-05-10T04:23:04.582 INFO:teuthology.orchestra.run.smithi132.stdout:138 2023-05-10T04:23:04.582 INFO:teuthology.orchestra.run.smithi132.stdout:138.out 2023-05-10T04:23:04.582 INFO:teuthology.orchestra.run.smithi132.stdout:139 2023-05-10T04:23:04.582 INFO:teuthology.orchestra.run.smithi132.stdout:139.out 2023-05-10T04:23:04.582 INFO:teuthology.orchestra.run.smithi132.stdout:140 2023-05-10T04:23:04.582 INFO:teuthology.orchestra.run.smithi132.stdout:140.out 2023-05-10T04:23:04.582 INFO:teuthology.orchestra.run.smithi132.stdout:141 2023-05-10T04:23:04.583 INFO:teuthology.orchestra.run.smithi132.stdout:141.out 2023-05-10T04:23:04.583 INFO:teuthology.orchestra.run.smithi132.stdout:142 2023-05-10T04:23:04.583 INFO:teuthology.orchestra.run.smithi132.stdout:142.out 2023-05-10T04:23:04.583 INFO:teuthology.orchestra.run.smithi132.stdout:143 2023-05-10T04:23:04.583 INFO:teuthology.orchestra.run.smithi132.stdout:143.out 2023-05-10T04:23:04.583 INFO:teuthology.orchestra.run.smithi132.stdout:144 2023-05-10T04:23:04.583 INFO:teuthology.orchestra.run.smithi132.stdout:144.out 2023-05-10T04:23:04.583 INFO:teuthology.orchestra.run.smithi132.stdout:145 2023-05-10T04:23:04.584 INFO:teuthology.orchestra.run.smithi132.stdout:145.out 2023-05-10T04:23:04.584 INFO:teuthology.orchestra.run.smithi132.stdout:146 2023-05-10T04:23:04.584 INFO:teuthology.orchestra.run.smithi132.stdout:146.out 2023-05-10T04:23:04.584 INFO:teuthology.orchestra.run.smithi132.stdout:147 2023-05-10T04:23:04.584 INFO:teuthology.orchestra.run.smithi132.stdout:147.out 2023-05-10T04:23:04.584 INFO:teuthology.orchestra.run.smithi132.stdout:148 2023-05-10T04:23:04.584 INFO:teuthology.orchestra.run.smithi132.stdout:148.out 2023-05-10T04:23:04.585 INFO:teuthology.orchestra.run.smithi132.stdout:149 2023-05-10T04:23:04.585 INFO:teuthology.orchestra.run.smithi132.stdout:149.out 2023-05-10T04:23:04.585 INFO:teuthology.orchestra.run.smithi132.stdout:150 2023-05-10T04:23:04.585 INFO:teuthology.orchestra.run.smithi132.stdout:150.out 2023-05-10T04:23:04.585 INFO:teuthology.orchestra.run.smithi132.stdout:151 2023-05-10T04:23:04.585 INFO:teuthology.orchestra.run.smithi132.stdout:151.out 2023-05-10T04:23:04.585 INFO:teuthology.orchestra.run.smithi132.stdout:152 2023-05-10T04:23:04.585 INFO:teuthology.orchestra.run.smithi132.stdout:152.out 2023-05-10T04:23:04.586 INFO:teuthology.orchestra.run.smithi132.stdout:153 2023-05-10T04:23:04.586 INFO:teuthology.orchestra.run.smithi132.stdout:153.out 2023-05-10T04:23:04.586 INFO:teuthology.orchestra.run.smithi132.stdout:154 2023-05-10T04:23:04.586 INFO:teuthology.orchestra.run.smithi132.stdout:154.out 2023-05-10T04:23:04.586 INFO:teuthology.orchestra.run.smithi132.stdout:155 2023-05-10T04:23:04.586 INFO:teuthology.orchestra.run.smithi132.stdout:155.out 2023-05-10T04:23:04.586 INFO:teuthology.orchestra.run.smithi132.stdout:156 2023-05-10T04:23:04.586 INFO:teuthology.orchestra.run.smithi132.stdout:156.out 2023-05-10T04:23:04.587 INFO:teuthology.orchestra.run.smithi132.stdout:157 2023-05-10T04:23:04.587 INFO:teuthology.orchestra.run.smithi132.stdout:157.out 2023-05-10T04:23:04.587 INFO:teuthology.orchestra.run.smithi132.stdout:158 2023-05-10T04:23:04.587 INFO:teuthology.orchestra.run.smithi132.stdout:158.out 2023-05-10T04:23:04.587 INFO:teuthology.orchestra.run.smithi132.stdout:159 2023-05-10T04:23:04.587 INFO:teuthology.orchestra.run.smithi132.stdout:159.out 2023-05-10T04:23:04.587 INFO:teuthology.orchestra.run.smithi132.stdout:160 2023-05-10T04:23:04.587 INFO:teuthology.orchestra.run.smithi132.stdout:160.out 2023-05-10T04:23:04.588 INFO:teuthology.orchestra.run.smithi132.stdout:161 2023-05-10T04:23:04.588 INFO:teuthology.orchestra.run.smithi132.stdout:161.out 2023-05-10T04:23:04.588 INFO:teuthology.orchestra.run.smithi132.stdout:162 2023-05-10T04:23:04.588 INFO:teuthology.orchestra.run.smithi132.stdout:162.out 2023-05-10T04:23:04.588 INFO:teuthology.orchestra.run.smithi132.stdout:163 2023-05-10T04:23:04.588 INFO:teuthology.orchestra.run.smithi132.stdout:163.out 2023-05-10T04:23:04.588 INFO:teuthology.orchestra.run.smithi132.stdout:164 2023-05-10T04:23:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:164.out 2023-05-10T04:23:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:165 2023-05-10T04:23:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:165.out 2023-05-10T04:23:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:166 2023-05-10T04:23:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:166.out 2023-05-10T04:23:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:167 2023-05-10T04:23:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:167.out 2023-05-10T04:23:04.589 INFO:teuthology.orchestra.run.smithi132.stdout:168 2023-05-10T04:23:04.590 INFO:teuthology.orchestra.run.smithi132.stdout:168.out 2023-05-10T04:23:04.590 INFO:teuthology.orchestra.run.smithi132.stdout:169 2023-05-10T04:23:04.590 INFO:teuthology.orchestra.run.smithi132.stdout:169.out 2023-05-10T04:23:04.590 INFO:teuthology.orchestra.run.smithi132.stdout:170 2023-05-10T04:23:04.590 INFO:teuthology.orchestra.run.smithi132.stdout:170.out 2023-05-10T04:23:04.590 INFO:teuthology.orchestra.run.smithi132.stdout:171 2023-05-10T04:23:04.590 INFO:teuthology.orchestra.run.smithi132.stdout:171.out 2023-05-10T04:23:04.590 INFO:teuthology.orchestra.run.smithi132.stdout:172 2023-05-10T04:23:04.591 INFO:teuthology.orchestra.run.smithi132.stdout:172.out 2023-05-10T04:23:04.591 INFO:teuthology.orchestra.run.smithi132.stdout:173 2023-05-10T04:23:04.591 INFO:teuthology.orchestra.run.smithi132.stdout:173.out 2023-05-10T04:23:04.591 INFO:teuthology.orchestra.run.smithi132.stdout:174 2023-05-10T04:23:04.591 INFO:teuthology.orchestra.run.smithi132.stdout:174.out 2023-05-10T04:23:04.591 INFO:teuthology.orchestra.run.smithi132.stdout:175 2023-05-10T04:23:04.591 INFO:teuthology.orchestra.run.smithi132.stdout:175.out 2023-05-10T04:23:04.591 INFO:teuthology.orchestra.run.smithi132.stdout:176 2023-05-10T04:23:04.592 INFO:teuthology.orchestra.run.smithi132.stdout:176.out 2023-05-10T04:23:04.592 INFO:teuthology.orchestra.run.smithi132.stdout:177 2023-05-10T04:23:04.592 INFO:teuthology.orchestra.run.smithi132.stdout:177.out 2023-05-10T04:23:04.592 INFO:teuthology.orchestra.run.smithi132.stdout:178 2023-05-10T04:23:04.592 INFO:teuthology.orchestra.run.smithi132.stdout:178.out 2023-05-10T04:23:04.592 INFO:teuthology.orchestra.run.smithi132.stdout:179 2023-05-10T04:23:04.592 INFO:teuthology.orchestra.run.smithi132.stdout:179.out 2023-05-10T04:23:04.593 INFO:teuthology.orchestra.run.smithi132.stdout:180 2023-05-10T04:23:04.593 INFO:teuthology.orchestra.run.smithi132.stdout:180.out 2023-05-10T04:23:04.593 INFO:teuthology.orchestra.run.smithi132.stdout:181 2023-05-10T04:23:04.593 INFO:teuthology.orchestra.run.smithi132.stdout:181.out 2023-05-10T04:23:04.593 INFO:teuthology.orchestra.run.smithi132.stdout:182 2023-05-10T04:23:04.593 INFO:teuthology.orchestra.run.smithi132.stdout:182.out 2023-05-10T04:23:04.593 INFO:teuthology.orchestra.run.smithi132.stdout:183 2023-05-10T04:23:04.593 INFO:teuthology.orchestra.run.smithi132.stdout:183.out 2023-05-10T04:23:04.594 INFO:teuthology.orchestra.run.smithi132.stdout:184 2023-05-10T04:23:04.594 INFO:teuthology.orchestra.run.smithi132.stdout:184.out 2023-05-10T04:23:04.594 INFO:teuthology.orchestra.run.smithi132.stdout:185 2023-05-10T04:23:04.594 INFO:teuthology.orchestra.run.smithi132.stdout:185.out 2023-05-10T04:23:04.594 INFO:teuthology.orchestra.run.smithi132.stdout:186 2023-05-10T04:23:04.594 INFO:teuthology.orchestra.run.smithi132.stdout:186.out 2023-05-10T04:23:04.594 INFO:teuthology.orchestra.run.smithi132.stdout:187 2023-05-10T04:23:04.594 INFO:teuthology.orchestra.run.smithi132.stdout:187.out 2023-05-10T04:23:04.595 INFO:teuthology.orchestra.run.smithi132.stdout:188 2023-05-10T04:23:04.595 INFO:teuthology.orchestra.run.smithi132.stdout:188.out 2023-05-10T04:23:04.595 INFO:teuthology.orchestra.run.smithi132.stdout:189 2023-05-10T04:23:04.595 INFO:teuthology.orchestra.run.smithi132.stdout:189.out 2023-05-10T04:23:04.595 INFO:teuthology.orchestra.run.smithi132.stdout:190 2023-05-10T04:23:04.595 INFO:teuthology.orchestra.run.smithi132.stdout:190.out 2023-05-10T04:23:04.595 INFO:teuthology.orchestra.run.smithi132.stdout:191 2023-05-10T04:23:04.595 INFO:teuthology.orchestra.run.smithi132.stdout:191.out 2023-05-10T04:23:04.596 INFO:teuthology.orchestra.run.smithi132.stdout:192 2023-05-10T04:23:04.596 INFO:teuthology.orchestra.run.smithi132.stdout:192.out 2023-05-10T04:23:04.596 INFO:teuthology.orchestra.run.smithi132.stdout:193 2023-05-10T04:23:04.596 INFO:teuthology.orchestra.run.smithi132.stdout:193.out 2023-05-10T04:23:04.596 INFO:teuthology.orchestra.run.smithi132.stdout:194 2023-05-10T04:23:04.596 INFO:teuthology.orchestra.run.smithi132.stdout:194.out 2023-05-10T04:23:04.596 INFO:teuthology.orchestra.run.smithi132.stdout:195 2023-05-10T04:23:04.597 INFO:teuthology.orchestra.run.smithi132.stdout:195.out 2023-05-10T04:23:04.597 INFO:teuthology.orchestra.run.smithi132.stdout:196 2023-05-10T04:23:04.597 INFO:teuthology.orchestra.run.smithi132.stdout:196.out 2023-05-10T04:23:04.597 INFO:teuthology.orchestra.run.smithi132.stdout:197 2023-05-10T04:23:04.597 INFO:teuthology.orchestra.run.smithi132.stdout:197.out 2023-05-10T04:23:04.597 INFO:teuthology.orchestra.run.smithi132.stdout:198 2023-05-10T04:23:04.597 INFO:teuthology.orchestra.run.smithi132.stdout:198.out 2023-05-10T04:23:04.597 INFO:teuthology.orchestra.run.smithi132.stdout:199 2023-05-10T04:23:04.598 INFO:teuthology.orchestra.run.smithi132.stdout:199.out 2023-05-10T04:23:04.598 INFO:teuthology.orchestra.run.smithi132.stdout:200 2023-05-10T04:23:04.598 INFO:teuthology.orchestra.run.smithi132.stdout:200.out 2023-05-10T04:23:04.598 INFO:teuthology.orchestra.run.smithi132.stdout:201 2023-05-10T04:23:04.598 INFO:teuthology.orchestra.run.smithi132.stdout:201.out 2023-05-10T04:23:04.598 INFO:teuthology.orchestra.run.smithi132.stdout:202 2023-05-10T04:23:04.598 INFO:teuthology.orchestra.run.smithi132.stdout:202.out 2023-05-10T04:23:04.598 INFO:teuthology.orchestra.run.smithi132.stdout:203 2023-05-10T04:23:04.599 INFO:teuthology.orchestra.run.smithi132.stdout:203.out 2023-05-10T04:23:04.599 INFO:teuthology.orchestra.run.smithi132.stdout:204 2023-05-10T04:23:04.599 INFO:teuthology.orchestra.run.smithi132.stdout:204.out 2023-05-10T04:23:04.599 INFO:teuthology.orchestra.run.smithi132.stdout:205 2023-05-10T04:23:04.599 INFO:teuthology.orchestra.run.smithi132.stdout:205.out 2023-05-10T04:23:04.599 INFO:teuthology.orchestra.run.smithi132.stdout:206 2023-05-10T04:23:04.599 INFO:teuthology.orchestra.run.smithi132.stdout:206.out 2023-05-10T04:23:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:207 2023-05-10T04:23:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:207.out 2023-05-10T04:23:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:208 2023-05-10T04:23:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:208.out 2023-05-10T04:23:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:209 2023-05-10T04:23:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:209.out 2023-05-10T04:23:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:210 2023-05-10T04:23:04.600 INFO:teuthology.orchestra.run.smithi132.stdout:210.out 2023-05-10T04:23:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:211 2023-05-10T04:23:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:211.out 2023-05-10T04:23:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:212 2023-05-10T04:23:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:212.out 2023-05-10T04:23:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:213 2023-05-10T04:23:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:213.out 2023-05-10T04:23:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:214 2023-05-10T04:23:04.601 INFO:teuthology.orchestra.run.smithi132.stdout:214.out 2023-05-10T04:23:04.602 INFO:teuthology.orchestra.run.smithi132.stdout:215 2023-05-10T04:23:04.602 INFO:teuthology.orchestra.run.smithi132.stdout:215.out 2023-05-10T04:23:04.602 INFO:teuthology.orchestra.run.smithi132.stdout:216 2023-05-10T04:23:04.602 INFO:teuthology.orchestra.run.smithi132.stdout:216.out 2023-05-10T04:23:04.602 INFO:teuthology.orchestra.run.smithi132.stdout:217 2023-05-10T04:23:04.602 INFO:teuthology.orchestra.run.smithi132.stdout:217.out 2023-05-10T04:23:04.602 INFO:teuthology.orchestra.run.smithi132.stdout:218 2023-05-10T04:23:04.602 INFO:teuthology.orchestra.run.smithi132.stdout:218.out 2023-05-10T04:23:04.603 INFO:teuthology.orchestra.run.smithi132.stdout:219 2023-05-10T04:23:04.603 INFO:teuthology.orchestra.run.smithi132.stdout:219.out 2023-05-10T04:23:04.603 INFO:teuthology.orchestra.run.smithi132.stdout:220 2023-05-10T04:23:04.603 INFO:teuthology.orchestra.run.smithi132.stdout:220.out 2023-05-10T04:23:04.603 INFO:teuthology.orchestra.run.smithi132.stdout:221 2023-05-10T04:23:04.603 INFO:teuthology.orchestra.run.smithi132.stdout:221.out 2023-05-10T04:23:04.603 INFO:teuthology.orchestra.run.smithi132.stdout:222 2023-05-10T04:23:04.603 INFO:teuthology.orchestra.run.smithi132.stdout:222.out 2023-05-10T04:23:04.604 INFO:teuthology.orchestra.run.smithi132.stdout:223 2023-05-10T04:23:04.604 INFO:teuthology.orchestra.run.smithi132.stdout:223.out 2023-05-10T04:23:04.604 INFO:teuthology.orchestra.run.smithi132.stdout:224 2023-05-10T04:23:04.604 INFO:teuthology.orchestra.run.smithi132.stdout:224.out 2023-05-10T04:23:04.604 INFO:teuthology.orchestra.run.smithi132.stdout:225 2023-05-10T04:23:04.604 INFO:teuthology.orchestra.run.smithi132.stdout:225.out 2023-05-10T04:23:04.604 INFO:teuthology.orchestra.run.smithi132.stdout:226 2023-05-10T04:23:04.604 INFO:teuthology.orchestra.run.smithi132.stdout:226.out 2023-05-10T04:23:04.605 INFO:teuthology.orchestra.run.smithi132.stdout:227 2023-05-10T04:23:04.605 INFO:teuthology.orchestra.run.smithi132.stdout:227.out 2023-05-10T04:23:04.605 INFO:teuthology.orchestra.run.smithi132.stdout:228 2023-05-10T04:23:04.605 INFO:teuthology.orchestra.run.smithi132.stdout:228.out 2023-05-10T04:23:04.605 INFO:teuthology.orchestra.run.smithi132.stdout:229 2023-05-10T04:23:04.605 INFO:teuthology.orchestra.run.smithi132.stdout:229.out 2023-05-10T04:23:04.605 INFO:teuthology.orchestra.run.smithi132.stdout:230 2023-05-10T04:23:04.606 INFO:teuthology.orchestra.run.smithi132.stdout:230.out 2023-05-10T04:23:04.606 INFO:teuthology.orchestra.run.smithi132.stdout:231 2023-05-10T04:23:04.606 INFO:teuthology.orchestra.run.smithi132.stdout:231.out 2023-05-10T04:23:04.606 INFO:teuthology.orchestra.run.smithi132.stdout:232 2023-05-10T04:23:04.606 INFO:teuthology.orchestra.run.smithi132.stdout:232.out 2023-05-10T04:23:04.606 INFO:teuthology.orchestra.run.smithi132.stdout:233 2023-05-10T04:23:04.606 INFO:teuthology.orchestra.run.smithi132.stdout:233.out 2023-05-10T04:23:04.606 INFO:teuthology.orchestra.run.smithi132.stdout:234 2023-05-10T04:23:04.607 INFO:teuthology.orchestra.run.smithi132.stdout:234.out 2023-05-10T04:23:04.607 INFO:teuthology.orchestra.run.smithi132.stdout:235 2023-05-10T04:23:04.607 INFO:teuthology.orchestra.run.smithi132.stdout:235.out 2023-05-10T04:23:04.607 INFO:teuthology.orchestra.run.smithi132.stdout:236 2023-05-10T04:23:04.607 INFO:teuthology.orchestra.run.smithi132.stdout:236.out 2023-05-10T04:23:04.607 INFO:teuthology.orchestra.run.smithi132.stdout:237 2023-05-10T04:23:04.607 INFO:teuthology.orchestra.run.smithi132.stdout:237.out 2023-05-10T04:23:04.608 INFO:teuthology.orchestra.run.smithi132.stdout:238 2023-05-10T04:23:04.608 INFO:teuthology.orchestra.run.smithi132.stdout:238.out 2023-05-10T04:23:04.608 INFO:teuthology.orchestra.run.smithi132.stdout:239 2023-05-10T04:23:04.608 INFO:teuthology.orchestra.run.smithi132.stdout:239.out 2023-05-10T04:23:04.608 INFO:teuthology.orchestra.run.smithi132.stdout:240 2023-05-10T04:23:04.608 INFO:teuthology.orchestra.run.smithi132.stdout:240.out 2023-05-10T04:23:04.608 INFO:teuthology.orchestra.run.smithi132.stdout:241 2023-05-10T04:23:04.609 INFO:teuthology.orchestra.run.smithi132.stdout:241.out 2023-05-10T04:23:04.609 INFO:teuthology.orchestra.run.smithi132.stdout:242 2023-05-10T04:23:04.609 INFO:teuthology.orchestra.run.smithi132.stdout:242.out 2023-05-10T04:23:04.609 INFO:teuthology.orchestra.run.smithi132.stdout:243 2023-05-10T04:23:04.609 INFO:teuthology.orchestra.run.smithi132.stdout:243.out 2023-05-10T04:23:04.609 INFO:teuthology.orchestra.run.smithi132.stdout:244 2023-05-10T04:23:04.609 INFO:teuthology.orchestra.run.smithi132.stdout:244.out 2023-05-10T04:23:04.609 INFO:teuthology.orchestra.run.smithi132.stdout:245 2023-05-10T04:23:04.610 INFO:teuthology.orchestra.run.smithi132.stdout:245.out 2023-05-10T04:23:04.610 INFO:teuthology.orchestra.run.smithi132.stdout:246 2023-05-10T04:23:04.610 INFO:teuthology.orchestra.run.smithi132.stdout:246.out 2023-05-10T04:23:04.610 INFO:teuthology.orchestra.run.smithi132.stdout:247 2023-05-10T04:23:04.610 INFO:teuthology.orchestra.run.smithi132.stdout:247.out 2023-05-10T04:23:04.610 INFO:teuthology.orchestra.run.smithi132.stdout:248 2023-05-10T04:23:04.610 INFO:teuthology.orchestra.run.smithi132.stdout:248.out 2023-05-10T04:23:04.610 INFO:teuthology.orchestra.run.smithi132.stdout:249 2023-05-10T04:23:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:249.out 2023-05-10T04:23:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:250 2023-05-10T04:23:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:250.out 2023-05-10T04:23:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:251 2023-05-10T04:23:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:251.out 2023-05-10T04:23:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:252 2023-05-10T04:23:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:252.out 2023-05-10T04:23:04.611 INFO:teuthology.orchestra.run.smithi132.stdout:253 2023-05-10T04:23:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:253.out 2023-05-10T04:23:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:254 2023-05-10T04:23:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:254.out 2023-05-10T04:23:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:255 2023-05-10T04:23:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:255.out 2023-05-10T04:23:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:256 2023-05-10T04:23:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:256.out 2023-05-10T04:23:04.612 INFO:teuthology.orchestra.run.smithi132.stdout:257 2023-05-10T04:23:04.613 INFO:teuthology.orchestra.run.smithi132.stdout:257.out 2023-05-10T04:23:04.613 INFO:teuthology.orchestra.run.smithi132.stdout:258 2023-05-10T04:23:04.613 INFO:teuthology.orchestra.run.smithi132.stdout:258.out 2023-05-10T04:23:04.613 INFO:teuthology.orchestra.run.smithi132.stdout:259 2023-05-10T04:23:04.613 INFO:teuthology.orchestra.run.smithi132.stdout:259.out 2023-05-10T04:23:04.613 INFO:teuthology.orchestra.run.smithi132.stdout:260 2023-05-10T04:23:04.613 INFO:teuthology.orchestra.run.smithi132.stdout:260.out 2023-05-10T04:23:04.613 INFO:teuthology.orchestra.run.smithi132.stdout:261 2023-05-10T04:23:04.614 INFO:teuthology.orchestra.run.smithi132.stdout:261.out 2023-05-10T04:23:04.614 INFO:teuthology.orchestra.run.smithi132.stdout:262 2023-05-10T04:23:04.614 INFO:teuthology.orchestra.run.smithi132.stdout:262.out 2023-05-10T04:23:04.614 INFO:teuthology.orchestra.run.smithi132.stdout:263 2023-05-10T04:23:04.614 INFO:teuthology.orchestra.run.smithi132.stdout:263.out 2023-05-10T04:23:04.614 INFO:teuthology.orchestra.run.smithi132.stdout:264 2023-05-10T04:23:04.614 INFO:teuthology.orchestra.run.smithi132.stdout:264.out 2023-05-10T04:23:04.615 INFO:teuthology.orchestra.run.smithi132.stdout:265 2023-05-10T04:23:04.615 INFO:teuthology.orchestra.run.smithi132.stdout:265.out 2023-05-10T04:23:04.615 INFO:teuthology.orchestra.run.smithi132.stdout:266 2023-05-10T04:23:04.615 INFO:teuthology.orchestra.run.smithi132.stdout:266.out 2023-05-10T04:23:04.615 INFO:teuthology.orchestra.run.smithi132.stdout:267 2023-05-10T04:23:04.615 INFO:teuthology.orchestra.run.smithi132.stdout:267.out 2023-05-10T04:23:04.615 INFO:teuthology.orchestra.run.smithi132.stdout:268 2023-05-10T04:23:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:268.out 2023-05-10T04:23:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:269 2023-05-10T04:23:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:269.out 2023-05-10T04:23:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:270 2023-05-10T04:23:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:270.out 2023-05-10T04:23:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:271 2023-05-10T04:23:04.616 INFO:teuthology.orchestra.run.smithi132.stdout:271.out 2023-05-10T04:23:04.617 INFO:teuthology.orchestra.run.smithi132.stdout:272 2023-05-10T04:23:04.617 INFO:teuthology.orchestra.run.smithi132.stdout:272.out 2023-05-10T04:23:04.617 INFO:teuthology.orchestra.run.smithi132.stdout:273 2023-05-10T04:23:04.617 INFO:teuthology.orchestra.run.smithi132.stdout:273.out 2023-05-10T04:23:04.617 INFO:teuthology.orchestra.run.smithi132.stdout:274 2023-05-10T04:23:04.617 INFO:teuthology.orchestra.run.smithi132.stdout:274.out 2023-05-10T04:23:04.617 INFO:teuthology.orchestra.run.smithi132.stdout:275 2023-05-10T04:23:04.618 INFO:teuthology.orchestra.run.smithi132.stdout:275.out 2023-05-10T04:23:04.618 INFO:teuthology.orchestra.run.smithi132.stdout:276 2023-05-10T04:23:04.618 INFO:teuthology.orchestra.run.smithi132.stdout:276.out 2023-05-10T04:23:04.618 INFO:teuthology.orchestra.run.smithi132.stdout:277 2023-05-10T04:23:04.618 INFO:teuthology.orchestra.run.smithi132.stdout:277.out 2023-05-10T04:23:04.618 INFO:teuthology.orchestra.run.smithi132.stdout:278 2023-05-10T04:23:04.619 INFO:teuthology.orchestra.run.smithi132.stdout:278.out 2023-05-10T04:23:04.619 INFO:teuthology.orchestra.run.smithi132.stdout:279 2023-05-10T04:23:04.619 INFO:teuthology.orchestra.run.smithi132.stdout:279.out 2023-05-10T04:23:04.619 INFO:teuthology.orchestra.run.smithi132.stdout:280 2023-05-10T04:23:04.619 INFO:teuthology.orchestra.run.smithi132.stdout:280.out 2023-05-10T04:23:04.619 INFO:teuthology.orchestra.run.smithi132.stdout:281 2023-05-10T04:23:04.619 INFO:teuthology.orchestra.run.smithi132.stdout:281.out 2023-05-10T04:23:04.619 INFO:teuthology.orchestra.run.smithi132.stdout:282 2023-05-10T04:23:04.620 INFO:teuthology.orchestra.run.smithi132.stdout:282.out 2023-05-10T04:23:04.620 INFO:teuthology.orchestra.run.smithi132.stdout:283 2023-05-10T04:23:04.620 INFO:teuthology.orchestra.run.smithi132.stdout:283.out 2023-05-10T04:23:04.620 INFO:teuthology.orchestra.run.smithi132.stdout:284 2023-05-10T04:23:04.620 INFO:teuthology.orchestra.run.smithi132.stdout:284.out 2023-05-10T04:23:04.620 INFO:teuthology.orchestra.run.smithi132.stdout:285 2023-05-10T04:23:04.620 INFO:teuthology.orchestra.run.smithi132.stdout:285.out 2023-05-10T04:23:04.621 INFO:teuthology.orchestra.run.smithi132.stdout:286 2023-05-10T04:23:04.621 INFO:teuthology.orchestra.run.smithi132.stdout:286.out 2023-05-10T04:23:04.621 INFO:teuthology.orchestra.run.smithi132.stdout:287 2023-05-10T04:23:04.621 INFO:teuthology.orchestra.run.smithi132.stdout:287.out 2023-05-10T04:23:04.621 INFO:teuthology.orchestra.run.smithi132.stdout:288 2023-05-10T04:23:04.621 INFO:teuthology.orchestra.run.smithi132.stdout:288.out 2023-05-10T04:23:04.621 INFO:teuthology.orchestra.run.smithi132.stdout:289 2023-05-10T04:23:04.621 INFO:teuthology.orchestra.run.smithi132.stdout:289.out 2023-05-10T04:23:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:290 2023-05-10T04:23:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:290.out 2023-05-10T04:23:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:291 2023-05-10T04:23:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:291.out 2023-05-10T04:23:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:292 2023-05-10T04:23:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:292.out 2023-05-10T04:23:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:293 2023-05-10T04:23:04.622 INFO:teuthology.orchestra.run.smithi132.stdout:293.out 2023-05-10T04:23:04.623 INFO:teuthology.orchestra.run.smithi132.stdout:294 2023-05-10T04:23:04.623 INFO:teuthology.orchestra.run.smithi132.stdout:294.out 2023-05-10T04:23:04.623 INFO:teuthology.orchestra.run.smithi132.stdout:295 2023-05-10T04:23:04.623 INFO:teuthology.orchestra.run.smithi132.stdout:295.out 2023-05-10T04:23:04.623 INFO:teuthology.orchestra.run.smithi132.stdout:296 2023-05-10T04:23:04.623 INFO:teuthology.orchestra.run.smithi132.stdout:296.out 2023-05-10T04:23:04.623 INFO:teuthology.orchestra.run.smithi132.stdout:297 2023-05-10T04:23:04.624 INFO:teuthology.orchestra.run.smithi132.stdout:297.out 2023-05-10T04:23:04.624 INFO:teuthology.orchestra.run.smithi132.stdout:298 2023-05-10T04:23:04.624 INFO:teuthology.orchestra.run.smithi132.stdout:298.out 2023-05-10T04:23:04.624 INFO:teuthology.orchestra.run.smithi132.stdout:299 2023-05-10T04:23:04.624 INFO:teuthology.orchestra.run.smithi132.stdout:299.out 2023-05-10T04:23:04.624 INFO:teuthology.orchestra.run.smithi132.stdout:300 2023-05-10T04:23:04.624 INFO:teuthology.orchestra.run.smithi132.stdout:300.out 2023-05-10T04:23:04.625 INFO:teuthology.orchestra.run.smithi132.stdout:301 2023-05-10T04:23:04.625 INFO:teuthology.orchestra.run.smithi132.stdout:301.out 2023-05-10T04:23:04.625 INFO:teuthology.orchestra.run.smithi132.stdout:302 2023-05-10T04:23:04.625 INFO:teuthology.orchestra.run.smithi132.stdout:302.out 2023-05-10T04:23:04.625 INFO:teuthology.orchestra.run.smithi132.stdout:303 2023-05-10T04:23:04.625 INFO:teuthology.orchestra.run.smithi132.stdout:303.out 2023-05-10T04:23:04.625 INFO:teuthology.orchestra.run.smithi132.stdout:304 2023-05-10T04:23:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:304.out 2023-05-10T04:23:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:305 2023-05-10T04:23:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:305.out 2023-05-10T04:23:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:306 2023-05-10T04:23:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:306.out 2023-05-10T04:23:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:307 2023-05-10T04:23:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:307.out 2023-05-10T04:23:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:308 2023-05-10T04:23:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:308.out 2023-05-10T04:23:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:309 2023-05-10T04:23:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:309.out 2023-05-10T04:23:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:310 2023-05-10T04:23:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:310.out 2023-05-10T04:23:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:311 2023-05-10T04:23:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:311.out 2023-05-10T04:23:04.627 INFO:teuthology.orchestra.run.smithi132.stdout:312 2023-05-10T04:23:04.628 INFO:teuthology.orchestra.run.smithi132.stdout:312.out 2023-05-10T04:23:04.628 INFO:teuthology.orchestra.run.smithi132.stdout:313 2023-05-10T04:23:04.628 INFO:teuthology.orchestra.run.smithi132.stdout:313.out 2023-05-10T04:23:04.628 INFO:teuthology.orchestra.run.smithi132.stdout:314 2023-05-10T04:23:04.628 INFO:teuthology.orchestra.run.smithi132.stdout:314.out 2023-05-10T04:23:04.628 INFO:teuthology.orchestra.run.smithi132.stdout:315 2023-05-10T04:23:04.628 INFO:teuthology.orchestra.run.smithi132.stdout:315.out 2023-05-10T04:23:04.628 INFO:teuthology.orchestra.run.smithi132.stdout:316 2023-05-10T04:23:04.629 INFO:teuthology.orchestra.run.smithi132.stdout:316.out 2023-05-10T04:23:04.629 INFO:teuthology.orchestra.run.smithi132.stdout:317 2023-05-10T04:23:04.629 INFO:teuthology.orchestra.run.smithi132.stdout:317.out 2023-05-10T04:23:04.629 INFO:teuthology.orchestra.run.smithi132.stdout:318 2023-05-10T04:23:04.629 INFO:teuthology.orchestra.run.smithi132.stdout:318.out 2023-05-10T04:23:04.629 INFO:teuthology.orchestra.run.smithi132.stdout:319 2023-05-10T04:23:04.629 INFO:teuthology.orchestra.run.smithi132.stdout:319.out 2023-05-10T04:23:04.629 INFO:teuthology.orchestra.run.smithi132.stdout:320 2023-05-10T04:23:04.630 INFO:teuthology.orchestra.run.smithi132.stdout:320.out 2023-05-10T04:23:04.630 INFO:teuthology.orchestra.run.smithi132.stdout:321 2023-05-10T04:23:04.630 INFO:teuthology.orchestra.run.smithi132.stdout:321.out 2023-05-10T04:23:04.630 INFO:teuthology.orchestra.run.smithi132.stdout:322 2023-05-10T04:23:04.630 INFO:teuthology.orchestra.run.smithi132.stdout:322.out 2023-05-10T04:23:04.630 INFO:teuthology.orchestra.run.smithi132.stdout:323 2023-05-10T04:23:04.630 INFO:teuthology.orchestra.run.smithi132.stdout:323.out 2023-05-10T04:23:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:324 2023-05-10T04:23:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:324.out 2023-05-10T04:23:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:325 2023-05-10T04:23:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:325.out 2023-05-10T04:23:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:326 2023-05-10T04:23:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:326.out 2023-05-10T04:23:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:327 2023-05-10T04:23:04.631 INFO:teuthology.orchestra.run.smithi132.stdout:327.out 2023-05-10T04:23:04.632 INFO:teuthology.orchestra.run.smithi132.stdout:328 2023-05-10T04:23:04.632 INFO:teuthology.orchestra.run.smithi132.stdout:328.out 2023-05-10T04:23:04.632 INFO:teuthology.orchestra.run.smithi132.stdout:329 2023-05-10T04:23:04.632 INFO:teuthology.orchestra.run.smithi132.stdout:329.out 2023-05-10T04:23:04.632 INFO:teuthology.orchestra.run.smithi132.stdout:330 2023-05-10T04:23:04.632 INFO:teuthology.orchestra.run.smithi132.stdout:330.out 2023-05-10T04:23:04.632 INFO:teuthology.orchestra.run.smithi132.stdout:331 2023-05-10T04:23:04.633 INFO:teuthology.orchestra.run.smithi132.stdout:331.out 2023-05-10T04:23:04.633 INFO:teuthology.orchestra.run.smithi132.stdout:332 2023-05-10T04:23:04.633 INFO:teuthology.orchestra.run.smithi132.stdout:332.out 2023-05-10T04:23:04.633 INFO:teuthology.orchestra.run.smithi132.stdout:333 2023-05-10T04:23:04.633 INFO:teuthology.orchestra.run.smithi132.stdout:333.out 2023-05-10T04:23:04.633 INFO:teuthology.orchestra.run.smithi132.stdout:334 2023-05-10T04:23:04.633 INFO:teuthology.orchestra.run.smithi132.stdout:334.out 2023-05-10T04:23:04.633 INFO:teuthology.orchestra.run.smithi132.stdout:335 2023-05-10T04:23:04.634 INFO:teuthology.orchestra.run.smithi132.stdout:335.out 2023-05-10T04:23:04.634 INFO:teuthology.orchestra.run.smithi132.stdout:336 2023-05-10T04:23:04.634 INFO:teuthology.orchestra.run.smithi132.stdout:336.out 2023-05-10T04:23:04.634 INFO:teuthology.orchestra.run.smithi132.stdout:337 2023-05-10T04:23:04.634 INFO:teuthology.orchestra.run.smithi132.stdout:337.out 2023-05-10T04:23:04.634 INFO:teuthology.orchestra.run.smithi132.stdout:338 2023-05-10T04:23:04.634 INFO:teuthology.orchestra.run.smithi132.stdout:338.out 2023-05-10T04:23:04.634 INFO:teuthology.orchestra.run.smithi132.stdout:339 2023-05-10T04:23:04.635 INFO:teuthology.orchestra.run.smithi132.stdout:339.out 2023-05-10T04:23:04.635 INFO:teuthology.orchestra.run.smithi132.stdout:340 2023-05-10T04:23:04.635 INFO:teuthology.orchestra.run.smithi132.stdout:340.out 2023-05-10T04:23:04.635 INFO:teuthology.orchestra.run.smithi132.stdout:341 2023-05-10T04:23:04.635 INFO:teuthology.orchestra.run.smithi132.stdout:341.out 2023-05-10T04:23:04.635 INFO:teuthology.orchestra.run.smithi132.stdout:342 2023-05-10T04:23:04.635 INFO:teuthology.orchestra.run.smithi132.stdout:342.out 2023-05-10T04:23:04.635 INFO:teuthology.orchestra.run.smithi132.stdout:343 2023-05-10T04:23:04.636 INFO:teuthology.orchestra.run.smithi132.stdout:343.out 2023-05-10T04:23:04.636 INFO:teuthology.orchestra.run.smithi132.stdout:344 2023-05-10T04:23:04.636 INFO:teuthology.orchestra.run.smithi132.stdout:344.out 2023-05-10T04:23:04.636 INFO:teuthology.orchestra.run.smithi132.stdout:345 2023-05-10T04:23:04.636 INFO:teuthology.orchestra.run.smithi132.stdout:345.out 2023-05-10T04:23:04.636 INFO:teuthology.orchestra.run.smithi132.stdout:346 2023-05-10T04:23:04.636 INFO:teuthology.orchestra.run.smithi132.stdout:346.out 2023-05-10T04:23:04.636 INFO:teuthology.orchestra.run.smithi132.stdout:347 2023-05-10T04:23:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:347.out 2023-05-10T04:23:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:348 2023-05-10T04:23:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:348.out 2023-05-10T04:23:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:349 2023-05-10T04:23:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:349.out 2023-05-10T04:23:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:350 2023-05-10T04:23:04.637 INFO:teuthology.orchestra.run.smithi132.stdout:350.out 2023-05-10T04:23:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:351 2023-05-10T04:23:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:351.out 2023-05-10T04:23:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:352 2023-05-10T04:23:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:352.out 2023-05-10T04:23:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:353 2023-05-10T04:23:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:353.out 2023-05-10T04:23:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:354 2023-05-10T04:23:04.638 INFO:teuthology.orchestra.run.smithi132.stdout:354.out 2023-05-10T04:23:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:355 2023-05-10T04:23:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:355.out 2023-05-10T04:23:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:356 2023-05-10T04:23:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:356.out 2023-05-10T04:23:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:357 2023-05-10T04:23:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:357.out 2023-05-10T04:23:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:358 2023-05-10T04:23:04.639 INFO:teuthology.orchestra.run.smithi132.stdout:358.out 2023-05-10T04:23:04.640 INFO:teuthology.orchestra.run.smithi132.stdout:359 2023-05-10T04:23:04.640 INFO:teuthology.orchestra.run.smithi132.stdout:359.out 2023-05-10T04:23:04.640 INFO:teuthology.orchestra.run.smithi132.stdout:360 2023-05-10T04:23:04.640 INFO:teuthology.orchestra.run.smithi132.stdout:360.out 2023-05-10T04:23:04.640 INFO:teuthology.orchestra.run.smithi132.stdout:361 2023-05-10T04:23:04.640 INFO:teuthology.orchestra.run.smithi132.stdout:361.out 2023-05-10T04:23:04.640 INFO:teuthology.orchestra.run.smithi132.stdout:362 2023-05-10T04:23:04.641 INFO:teuthology.orchestra.run.smithi132.stdout:362.out 2023-05-10T04:23:04.641 INFO:teuthology.orchestra.run.smithi132.stdout:363 2023-05-10T04:23:04.641 INFO:teuthology.orchestra.run.smithi132.stdout:363.out 2023-05-10T04:23:04.641 INFO:teuthology.orchestra.run.smithi132.stdout:364 2023-05-10T04:23:04.641 INFO:teuthology.orchestra.run.smithi132.stdout:364.out 2023-05-10T04:23:04.641 INFO:teuthology.orchestra.run.smithi132.stdout:365 2023-05-10T04:23:04.641 INFO:teuthology.orchestra.run.smithi132.stdout:365.out 2023-05-10T04:23:04.641 INFO:teuthology.orchestra.run.smithi132.stdout:366 2023-05-10T04:23:04.642 INFO:teuthology.orchestra.run.smithi132.stdout:366.out 2023-05-10T04:23:04.642 INFO:teuthology.orchestra.run.smithi132.stdout:367 2023-05-10T04:23:04.642 INFO:teuthology.orchestra.run.smithi132.stdout:367.out 2023-05-10T04:23:04.642 INFO:teuthology.orchestra.run.smithi132.stdout:368 2023-05-10T04:23:04.642 INFO:teuthology.orchestra.run.smithi132.stdout:368.out 2023-05-10T04:23:04.642 INFO:teuthology.orchestra.run.smithi132.stdout:369 2023-05-10T04:23:04.642 INFO:teuthology.orchestra.run.smithi132.stdout:369.out 2023-05-10T04:23:04.642 INFO:teuthology.orchestra.run.smithi132.stdout:370 2023-05-10T04:23:04.643 INFO:teuthology.orchestra.run.smithi132.stdout:370.out 2023-05-10T04:23:04.643 INFO:teuthology.orchestra.run.smithi132.stdout:371 2023-05-10T04:23:04.643 INFO:teuthology.orchestra.run.smithi132.stdout:371.out 2023-05-10T04:23:04.643 INFO:teuthology.orchestra.run.smithi132.stdout:372 2023-05-10T04:23:04.643 INFO:teuthology.orchestra.run.smithi132.stdout:372.out 2023-05-10T04:23:04.643 INFO:teuthology.orchestra.run.smithi132.stdout:373 2023-05-10T04:23:04.643 INFO:teuthology.orchestra.run.smithi132.stdout:373.out 2023-05-10T04:23:04.644 INFO:teuthology.orchestra.run.smithi132.stdout:374 2023-05-10T04:23:04.644 INFO:teuthology.orchestra.run.smithi132.stdout:374.out 2023-05-10T04:23:04.644 INFO:teuthology.orchestra.run.smithi132.stdout:375 2023-05-10T04:23:04.644 INFO:teuthology.orchestra.run.smithi132.stdout:375.out 2023-05-10T04:23:04.644 INFO:teuthology.orchestra.run.smithi132.stdout:376 2023-05-10T04:23:04.644 INFO:teuthology.orchestra.run.smithi132.stdout:376.out 2023-05-10T04:23:04.645 INFO:teuthology.orchestra.run.smithi132.stdout:377 2023-05-10T04:23:04.645 INFO:teuthology.orchestra.run.smithi132.stdout:377.out 2023-05-10T04:23:04.645 INFO:teuthology.orchestra.run.smithi132.stdout:378 2023-05-10T04:23:04.645 INFO:teuthology.orchestra.run.smithi132.stdout:378.out 2023-05-10T04:23:04.645 INFO:teuthology.orchestra.run.smithi132.stdout:379 2023-05-10T04:23:04.645 INFO:teuthology.orchestra.run.smithi132.stdout:379.out 2023-05-10T04:23:04.645 INFO:teuthology.orchestra.run.smithi132.stdout:380 2023-05-10T04:23:04.646 INFO:teuthology.orchestra.run.smithi132.stdout:380.out 2023-05-10T04:23:04.646 INFO:teuthology.orchestra.run.smithi132.stdout:381 2023-05-10T04:23:04.646 INFO:teuthology.orchestra.run.smithi132.stdout:381.out 2023-05-10T04:23:04.646 INFO:teuthology.orchestra.run.smithi132.stdout:382 2023-05-10T04:23:04.646 INFO:teuthology.orchestra.run.smithi132.stdout:382.out 2023-05-10T04:23:04.646 INFO:teuthology.orchestra.run.smithi132.stdout:383 2023-05-10T04:23:04.646 INFO:teuthology.orchestra.run.smithi132.stdout:383.out 2023-05-10T04:23:04.646 INFO:teuthology.orchestra.run.smithi132.stdout:384 2023-05-10T04:23:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:384.out 2023-05-10T04:23:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:385 2023-05-10T04:23:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:385.out 2023-05-10T04:23:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:386 2023-05-10T04:23:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:386.out 2023-05-10T04:23:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:387 2023-05-10T04:23:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:387.out 2023-05-10T04:23:04.647 INFO:teuthology.orchestra.run.smithi132.stdout:388 2023-05-10T04:23:04.648 INFO:teuthology.orchestra.run.smithi132.stdout:388.out 2023-05-10T04:23:04.648 INFO:teuthology.orchestra.run.smithi132.stdout:389 2023-05-10T04:23:04.648 INFO:teuthology.orchestra.run.smithi132.stdout:389.out 2023-05-10T04:23:04.648 INFO:teuthology.orchestra.run.smithi132.stdout:390 2023-05-10T04:23:04.648 INFO:teuthology.orchestra.run.smithi132.stdout:390.out 2023-05-10T04:23:04.648 INFO:teuthology.orchestra.run.smithi132.stdout:391 2023-05-10T04:23:04.648 INFO:teuthology.orchestra.run.smithi132.stdout:391.out 2023-05-10T04:23:04.648 INFO:teuthology.orchestra.run.smithi132.stdout:392 2023-05-10T04:23:04.649 INFO:teuthology.orchestra.run.smithi132.stdout:392.out 2023-05-10T04:23:04.649 INFO:teuthology.orchestra.run.smithi132.stdout:393 2023-05-10T04:23:04.649 INFO:teuthology.orchestra.run.smithi132.stdout:393.out 2023-05-10T04:23:04.649 INFO:teuthology.orchestra.run.smithi132.stdout:394 2023-05-10T04:23:04.649 INFO:teuthology.orchestra.run.smithi132.stdout:394.out 2023-05-10T04:23:04.649 INFO:teuthology.orchestra.run.smithi132.stdout:395 2023-05-10T04:23:04.649 INFO:teuthology.orchestra.run.smithi132.stdout:395.out 2023-05-10T04:23:04.649 INFO:teuthology.orchestra.run.smithi132.stdout:396 2023-05-10T04:23:04.650 INFO:teuthology.orchestra.run.smithi132.stdout:396.out 2023-05-10T04:23:04.650 INFO:teuthology.orchestra.run.smithi132.stdout:397 2023-05-10T04:23:04.650 INFO:teuthology.orchestra.run.smithi132.stdout:397.out 2023-05-10T04:23:04.650 INFO:teuthology.orchestra.run.smithi132.stdout:398 2023-05-10T04:23:04.650 INFO:teuthology.orchestra.run.smithi132.stdout:398.out 2023-05-10T04:23:04.650 INFO:teuthology.orchestra.run.smithi132.stdout:399 2023-05-10T04:23:04.650 INFO:teuthology.orchestra.run.smithi132.stdout:399.out 2023-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi132.stdout:400 2023-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi132.stdout:400.out 2023-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi132.stdout:401 2023-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi132.stdout:401.out 2023-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi132.stdout:402 2023-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi132.stdout:402.out 2023-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi132.stdout:403 2023-05-10T04:23:04.651 INFO:teuthology.orchestra.run.smithi132.stdout:403.out 2023-05-10T04:23:04.652 INFO:teuthology.orchestra.run.smithi132.stdout:404 2023-05-10T04:23:04.652 INFO:teuthology.orchestra.run.smithi132.stdout:404.out 2023-05-10T04:23:04.652 INFO:teuthology.orchestra.run.smithi132.stdout:405 2023-05-10T04:23:04.652 INFO:teuthology.orchestra.run.smithi132.stdout:405.out 2023-05-10T04:23:04.652 INFO:teuthology.orchestra.run.smithi132.stdout:406 2023-05-10T04:23:04.652 INFO:teuthology.orchestra.run.smithi132.stdout:406.out 2023-05-10T04:23:04.652 INFO:teuthology.orchestra.run.smithi132.stdout:407 2023-05-10T04:23:04.652 INFO:teuthology.orchestra.run.smithi132.stdout:407.out 2023-05-10T04:23:04.653 INFO:teuthology.orchestra.run.smithi132.stdout:408 2023-05-10T04:23:04.653 INFO:teuthology.orchestra.run.smithi132.stdout:408.out 2023-05-10T04:23:04.653 INFO:teuthology.orchestra.run.smithi132.stdout:409 2023-05-10T04:23:04.653 INFO:teuthology.orchestra.run.smithi132.stdout:409.out 2023-05-10T04:23:04.653 INFO:teuthology.orchestra.run.smithi132.stdout:410 2023-05-10T04:23:04.653 INFO:teuthology.orchestra.run.smithi132.stdout:410.out 2023-05-10T04:23:04.653 INFO:teuthology.orchestra.run.smithi132.stdout:411 2023-05-10T04:23:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:411.out 2023-05-10T04:23:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:412 2023-05-10T04:23:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:412.out 2023-05-10T04:23:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:413 2023-05-10T04:23:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:413.out 2023-05-10T04:23:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:414 2023-05-10T04:23:04.654 INFO:teuthology.orchestra.run.smithi132.stdout:414.out 2023-05-10T04:23:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:415 2023-05-10T04:23:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:415.out 2023-05-10T04:23:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:416 2023-05-10T04:23:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:416.out 2023-05-10T04:23:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:417 2023-05-10T04:23:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:417.out 2023-05-10T04:23:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:418 2023-05-10T04:23:04.655 INFO:teuthology.orchestra.run.smithi132.stdout:418.out 2023-05-10T04:23:04.656 INFO:teuthology.orchestra.run.smithi132.stdout:419 2023-05-10T04:23:04.656 INFO:teuthology.orchestra.run.smithi132.stdout:419.out 2023-05-10T04:23:04.656 INFO:teuthology.orchestra.run.smithi132.stdout:420 2023-05-10T04:23:04.656 INFO:teuthology.orchestra.run.smithi132.stdout:420.out 2023-05-10T04:23:04.656 INFO:teuthology.orchestra.run.smithi132.stdout:421 2023-05-10T04:23:04.656 INFO:teuthology.orchestra.run.smithi132.stdout:421.out 2023-05-10T04:23:04.656 INFO:teuthology.orchestra.run.smithi132.stdout:422 2023-05-10T04:23:04.656 INFO:teuthology.orchestra.run.smithi132.stdout:422.out 2023-05-10T04:23:04.657 INFO:teuthology.orchestra.run.smithi132.stdout:423 2023-05-10T04:23:04.657 INFO:teuthology.orchestra.run.smithi132.stdout:423.out 2023-05-10T04:23:04.657 INFO:teuthology.orchestra.run.smithi132.stdout:424 2023-05-10T04:23:04.657 INFO:teuthology.orchestra.run.smithi132.stdout:424.out 2023-05-10T04:23:04.657 INFO:teuthology.orchestra.run.smithi132.stdout:425 2023-05-10T04:23:04.657 INFO:teuthology.orchestra.run.smithi132.stdout:425.out 2023-05-10T04:23:04.657 INFO:teuthology.orchestra.run.smithi132.stdout:426 2023-05-10T04:23:04.657 INFO:teuthology.orchestra.run.smithi132.stdout:426.out 2023-05-10T04:23:04.658 INFO:teuthology.orchestra.run.smithi132.stdout:427 2023-05-10T04:23:04.658 INFO:teuthology.orchestra.run.smithi132.stdout:427.out 2023-05-10T04:23:04.658 INFO:teuthology.orchestra.run.smithi132.stdout:428 2023-05-10T04:23:04.658 INFO:teuthology.orchestra.run.smithi132.stdout:428.out 2023-05-10T04:23:04.658 INFO:teuthology.orchestra.run.smithi132.stdout:429 2023-05-10T04:23:04.658 INFO:teuthology.orchestra.run.smithi132.stdout:429.out 2023-05-10T04:23:04.658 INFO:teuthology.orchestra.run.smithi132.stdout:430 2023-05-10T04:23:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:430.out 2023-05-10T04:23:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:431 2023-05-10T04:23:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:431.out 2023-05-10T04:23:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:432 2023-05-10T04:23:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:432.out 2023-05-10T04:23:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:433 2023-05-10T04:23:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:433.out 2023-05-10T04:23:04.659 INFO:teuthology.orchestra.run.smithi132.stdout:434 2023-05-10T04:23:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:434.out 2023-05-10T04:23:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:435 2023-05-10T04:23:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:435.out 2023-05-10T04:23:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:436 2023-05-10T04:23:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:436.out 2023-05-10T04:23:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:437 2023-05-10T04:23:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:437.out 2023-05-10T04:23:04.660 INFO:teuthology.orchestra.run.smithi132.stdout:438 2023-05-10T04:23:04.661 INFO:teuthology.orchestra.run.smithi132.stdout:438.out 2023-05-10T04:23:04.661 INFO:teuthology.orchestra.run.smithi132.stdout:439 2023-05-10T04:23:04.661 INFO:teuthology.orchestra.run.smithi132.stdout:439.out 2023-05-10T04:23:04.661 INFO:teuthology.orchestra.run.smithi132.stdout:440 2023-05-10T04:23:04.661 INFO:teuthology.orchestra.run.smithi132.stdout:440.out 2023-05-10T04:23:04.661 INFO:teuthology.orchestra.run.smithi132.stdout:441 2023-05-10T04:23:04.661 INFO:teuthology.orchestra.run.smithi132.stdout:441.out 2023-05-10T04:23:04.661 INFO:teuthology.orchestra.run.smithi132.stdout:442 2023-05-10T04:23:04.662 INFO:teuthology.orchestra.run.smithi132.stdout:442.out 2023-05-10T04:23:04.662 INFO:teuthology.orchestra.run.smithi132.stdout:443 2023-05-10T04:23:04.662 INFO:teuthology.orchestra.run.smithi132.stdout:443.out 2023-05-10T04:23:04.662 INFO:teuthology.orchestra.run.smithi132.stdout:444 2023-05-10T04:23:04.662 INFO:teuthology.orchestra.run.smithi132.stdout:444.out 2023-05-10T04:23:04.662 INFO:teuthology.orchestra.run.smithi132.stdout:445 2023-05-10T04:23:04.662 INFO:teuthology.orchestra.run.smithi132.stdout:445.out 2023-05-10T04:23:04.662 INFO:teuthology.orchestra.run.smithi132.stdout:446 2023-05-10T04:23:04.663 INFO:teuthology.orchestra.run.smithi132.stdout:446.out 2023-05-10T04:23:04.663 INFO:teuthology.orchestra.run.smithi132.stdout:447 2023-05-10T04:23:04.663 INFO:teuthology.orchestra.run.smithi132.stdout:447.out 2023-05-10T04:23:04.663 INFO:teuthology.orchestra.run.smithi132.stdout:448 2023-05-10T04:23:04.663 INFO:teuthology.orchestra.run.smithi132.stdout:448.out 2023-05-10T04:23:04.663 INFO:teuthology.orchestra.run.smithi132.stdout:449 2023-05-10T04:23:04.663 INFO:teuthology.orchestra.run.smithi132.stdout:449.out 2023-05-10T04:23:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:450 2023-05-10T04:23:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:450.out 2023-05-10T04:23:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:451 2023-05-10T04:23:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:451.out 2023-05-10T04:23:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:452 2023-05-10T04:23:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:452.out 2023-05-10T04:23:04.664 INFO:teuthology.orchestra.run.smithi132.stdout:453 2023-05-10T04:23:04.665 INFO:teuthology.orchestra.run.smithi132.stdout:453.out 2023-05-10T04:23:04.665 INFO:teuthology.orchestra.run.smithi132.stdout:454 2023-05-10T04:23:04.665 INFO:teuthology.orchestra.run.smithi132.stdout:454.out 2023-05-10T04:23:04.665 INFO:teuthology.orchestra.run.smithi132.stdout:455 2023-05-10T04:23:04.665 INFO:teuthology.orchestra.run.smithi132.stdout:455.out 2023-05-10T04:23:04.665 INFO:teuthology.orchestra.run.smithi132.stdout:456 2023-05-10T04:23:04.665 INFO:teuthology.orchestra.run.smithi132.stdout:456.out 2023-05-10T04:23:04.665 INFO:teuthology.orchestra.run.smithi132.stdout:457 2023-05-10T04:23:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:457.out 2023-05-10T04:23:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:458 2023-05-10T04:23:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:458.out 2023-05-10T04:23:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:459 2023-05-10T04:23:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:459.out 2023-05-10T04:23:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:460 2023-05-10T04:23:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:460.out 2023-05-10T04:23:04.666 INFO:teuthology.orchestra.run.smithi132.stdout:461 2023-05-10T04:23:04.667 INFO:teuthology.orchestra.run.smithi132.stdout:461.out 2023-05-10T04:23:04.667 INFO:teuthology.orchestra.run.smithi132.stdout:462 2023-05-10T04:23:04.667 INFO:teuthology.orchestra.run.smithi132.stdout:462.out 2023-05-10T04:23:04.667 INFO:teuthology.orchestra.run.smithi132.stdout:463 2023-05-10T04:23:04.667 INFO:teuthology.orchestra.run.smithi132.stdout:463.out 2023-05-10T04:23:04.667 INFO:teuthology.orchestra.run.smithi132.stdout:464 2023-05-10T04:23:04.667 INFO:teuthology.orchestra.run.smithi132.stdout:464.out 2023-05-10T04:23:04.667 INFO:teuthology.orchestra.run.smithi132.stdout:465 2023-05-10T04:23:04.668 INFO:teuthology.orchestra.run.smithi132.stdout:465.out 2023-05-10T04:23:04.668 INFO:teuthology.orchestra.run.smithi132.stdout:466 2023-05-10T04:23:04.668 INFO:teuthology.orchestra.run.smithi132.stdout:466.out 2023-05-10T04:23:04.668 INFO:teuthology.orchestra.run.smithi132.stdout:467 2023-05-10T04:23:04.668 INFO:teuthology.orchestra.run.smithi132.stdout:467.out 2023-05-10T04:23:04.668 INFO:teuthology.orchestra.run.smithi132.stdout:468 2023-05-10T04:23:04.668 INFO:teuthology.orchestra.run.smithi132.stdout:468.out 2023-05-10T04:23:04.668 INFO:teuthology.orchestra.run.smithi132.stdout:469 2023-05-10T04:23:04.669 INFO:teuthology.orchestra.run.smithi132.stdout:469.out 2023-05-10T04:23:04.669 INFO:teuthology.orchestra.run.smithi132.stdout:470 2023-05-10T04:23:04.669 INFO:teuthology.orchestra.run.smithi132.stdout:470.out 2023-05-10T04:23:04.669 INFO:teuthology.orchestra.run.smithi132.stdout:471 2023-05-10T04:23:04.669 INFO:teuthology.orchestra.run.smithi132.stdout:471.out 2023-05-10T04:23:04.669 INFO:teuthology.orchestra.run.smithi132.stdout:472 2023-05-10T04:23:04.669 INFO:teuthology.orchestra.run.smithi132.stdout:472.out 2023-05-10T04:23:04.669 INFO:teuthology.orchestra.run.smithi132.stdout:473 2023-05-10T04:23:04.670 INFO:teuthology.orchestra.run.smithi132.stdout:473.out 2023-05-10T04:23:04.670 INFO:teuthology.orchestra.run.smithi132.stdout:474 2023-05-10T04:23:04.670 INFO:teuthology.orchestra.run.smithi132.stdout:474.out 2023-05-10T04:23:04.670 INFO:teuthology.orchestra.run.smithi132.stdout:475 2023-05-10T04:23:04.670 INFO:teuthology.orchestra.run.smithi132.stdout:475.out 2023-05-10T04:23:04.670 INFO:teuthology.orchestra.run.smithi132.stdout:476 2023-05-10T04:23:04.670 INFO:teuthology.orchestra.run.smithi132.stdout:476.out 2023-05-10T04:23:04.670 INFO:teuthology.orchestra.run.smithi132.stdout:477 2023-05-10T04:23:04.671 INFO:teuthology.orchestra.run.smithi132.stdout:477.out 2023-05-10T04:23:04.671 INFO:teuthology.orchestra.run.smithi132.stdout:478 2023-05-10T04:23:04.671 INFO:teuthology.orchestra.run.smithi132.stdout:478.out 2023-05-10T04:23:04.671 INFO:teuthology.orchestra.run.smithi132.stdout:479 2023-05-10T04:23:04.671 INFO:teuthology.orchestra.run.smithi132.stdout:479.out 2023-05-10T04:23:04.671 INFO:teuthology.orchestra.run.smithi132.stdout:480 2023-05-10T04:23:04.671 INFO:teuthology.orchestra.run.smithi132.stdout:480.out 2023-05-10T04:23:04.672 INFO:teuthology.orchestra.run.smithi132.stdout:481 2023-05-10T04:23:04.672 INFO:teuthology.orchestra.run.smithi132.stdout:481.out 2023-05-10T04:23:04.672 INFO:teuthology.orchestra.run.smithi132.stdout:482 2023-05-10T04:23:04.672 INFO:teuthology.orchestra.run.smithi132.stdout:482.out 2023-05-10T04:23:04.672 INFO:teuthology.orchestra.run.smithi132.stdout:483 2023-05-10T04:23:04.672 INFO:teuthology.orchestra.run.smithi132.stdout:483.out 2023-05-10T04:23:04.672 INFO:teuthology.orchestra.run.smithi132.stdout:484 2023-05-10T04:23:04.672 INFO:teuthology.orchestra.run.smithi132.stdout:484.out 2023-05-10T04:23:04.673 INFO:teuthology.orchestra.run.smithi132.stdout:485 2023-05-10T04:23:04.673 INFO:teuthology.orchestra.run.smithi132.stdout:485.out 2023-05-10T04:23:04.673 INFO:teuthology.orchestra.run.smithi132.stdout:486 2023-05-10T04:23:04.673 INFO:teuthology.orchestra.run.smithi132.stdout:486.out 2023-05-10T04:23:04.673 INFO:teuthology.orchestra.run.smithi132.stdout:487 2023-05-10T04:23:04.673 INFO:teuthology.orchestra.run.smithi132.stdout:487.out 2023-05-10T04:23:04.673 INFO:teuthology.orchestra.run.smithi132.stdout:488 2023-05-10T04:23:04.673 INFO:teuthology.orchestra.run.smithi132.stdout:488.out 2023-05-10T04:23:04.674 INFO:teuthology.orchestra.run.smithi132.stdout:489 2023-05-10T04:23:04.674 INFO:teuthology.orchestra.run.smithi132.stdout:489.out 2023-05-10T04:23:04.674 INFO:teuthology.orchestra.run.smithi132.stdout:490 2023-05-10T04:23:04.674 INFO:teuthology.orchestra.run.smithi132.stdout:490.out 2023-05-10T04:23:04.674 INFO:teuthology.orchestra.run.smithi132.stdout:491 2023-05-10T04:23:04.674 INFO:teuthology.orchestra.run.smithi132.stdout:491.out 2023-05-10T04:23:04.674 INFO:teuthology.orchestra.run.smithi132.stdout:492 2023-05-10T04:23:04.674 INFO:teuthology.orchestra.run.smithi132.stdout:492.out 2023-05-10T04:23:04.675 INFO:teuthology.orchestra.run.smithi132.stdout:493 2023-05-10T04:23:04.675 INFO:teuthology.orchestra.run.smithi132.stdout:493.out 2023-05-10T04:23:04.675 INFO:teuthology.orchestra.run.smithi132.stdout:494 2023-05-10T04:23:04.675 INFO:teuthology.orchestra.run.smithi132.stdout:494.out 2023-05-10T04:23:04.675 INFO:teuthology.orchestra.run.smithi132.stdout:495 2023-05-10T04:23:04.675 INFO:teuthology.orchestra.run.smithi132.stdout:495.out 2023-05-10T04:23:04.675 INFO:teuthology.orchestra.run.smithi132.stdout:496 2023-05-10T04:23:04.675 INFO:teuthology.orchestra.run.smithi132.stdout:496.out 2023-05-10T04:23:04.676 INFO:teuthology.orchestra.run.smithi132.stdout:497 2023-05-10T04:23:04.676 INFO:teuthology.orchestra.run.smithi132.stdout:497.out 2023-05-10T04:23:04.676 INFO:teuthology.orchestra.run.smithi132.stdout:498 2023-05-10T04:23:04.676 INFO:teuthology.orchestra.run.smithi132.stdout:498.out 2023-05-10T04:23:04.676 INFO:teuthology.orchestra.run.smithi132.stdout:499 2023-05-10T04:23:04.676 INFO:teuthology.orchestra.run.smithi132.stdout:499.out 2023-05-10T04:23:04.676 INFO:teuthology.orchestra.run.smithi132.stdout:500 2023-05-10T04:23:04.676 INFO:teuthology.orchestra.run.smithi132.stdout:500.out 2023-05-10T04:23:04.677 INFO:teuthology.orchestra.run.smithi132.stdout:501 2023-05-10T04:23:04.677 INFO:teuthology.orchestra.run.smithi132.stdout:501.out 2023-05-10T04:23:04.677 INFO:teuthology.orchestra.run.smithi132.stdout:502 2023-05-10T04:23:04.677 INFO:teuthology.orchestra.run.smithi132.stdout:502.out 2023-05-10T04:23:04.677 INFO:teuthology.orchestra.run.smithi132.stdout:503 2023-05-10T04:23:04.677 INFO:teuthology.orchestra.run.smithi132.stdout:503.out 2023-05-10T04:23:04.677 INFO:teuthology.orchestra.run.smithi132.stdout:504 2023-05-10T04:23:04.677 INFO:teuthology.orchestra.run.smithi132.stdout:504.out 2023-05-10T04:23:04.678 INFO:teuthology.orchestra.run.smithi132.stdout:505 2023-05-10T04:23:04.678 INFO:teuthology.orchestra.run.smithi132.stdout:505.out 2023-05-10T04:23:04.678 INFO:teuthology.orchestra.run.smithi132.stdout:506 2023-05-10T04:23:04.678 INFO:teuthology.orchestra.run.smithi132.stdout:506.out 2023-05-10T04:23:04.678 INFO:teuthology.orchestra.run.smithi132.stdout:507 2023-05-10T04:23:04.678 INFO:teuthology.orchestra.run.smithi132.stdout:507.out 2023-05-10T04:23:04.678 INFO:teuthology.orchestra.run.smithi132.stdout:508 2023-05-10T04:23:04.678 INFO:teuthology.orchestra.run.smithi132.stdout:508.out 2023-05-10T04:23:04.679 INFO:teuthology.orchestra.run.smithi132.stdout:509 2023-05-10T04:23:04.679 INFO:teuthology.orchestra.run.smithi132.stdout:509.out 2023-05-10T04:23:04.679 INFO:teuthology.orchestra.run.smithi132.stdout:510 2023-05-10T04:23:04.679 INFO:teuthology.orchestra.run.smithi132.stdout:510.out 2023-05-10T04:23:04.679 INFO:teuthology.orchestra.run.smithi132.stdout:511 2023-05-10T04:23:04.679 INFO:teuthology.orchestra.run.smithi132.stdout:511.out 2023-05-10T04:23:04.679 INFO:teuthology.orchestra.run.smithi132.stdout:512 2023-05-10T04:23:04.679 INFO:teuthology.orchestra.run.smithi132.stdout:512.out 2023-05-10T04:23:04.680 INFO:teuthology.orchestra.run.smithi132.stdout:513 2023-05-10T04:23:04.680 INFO:teuthology.orchestra.run.smithi132.stdout:513.out 2023-05-10T04:23:04.680 INFO:teuthology.orchestra.run.smithi132.stdout:514 2023-05-10T04:23:04.680 INFO:teuthology.orchestra.run.smithi132.stdout:514.out 2023-05-10T04:23:04.680 INFO:teuthology.orchestra.run.smithi132.stdout:515 2023-05-10T04:23:04.680 INFO:teuthology.orchestra.run.smithi132.stdout:515.out 2023-05-10T04:23:04.680 INFO:teuthology.orchestra.run.smithi132.stdout:516 2023-05-10T04:23:04.681 INFO:teuthology.orchestra.run.smithi132.stdout:516.out 2023-05-10T04:23:04.681 INFO:teuthology.orchestra.run.smithi132.stdout:517 2023-05-10T04:23:04.681 INFO:teuthology.orchestra.run.smithi132.stdout:517.out 2023-05-10T04:23:04.681 INFO:teuthology.orchestra.run.smithi132.stdout:518 2023-05-10T04:23:04.681 INFO:teuthology.orchestra.run.smithi132.stdout:518.out 2023-05-10T04:23:04.681 INFO:teuthology.orchestra.run.smithi132.stdout:519 2023-05-10T04:23:04.681 INFO:teuthology.orchestra.run.smithi132.stdout:519.out 2023-05-10T04:23:04.681 INFO:teuthology.orchestra.run.smithi132.stdout:520 2023-05-10T04:23:04.682 INFO:teuthology.orchestra.run.smithi132.stdout:520.out 2023-05-10T04:23:04.682 INFO:teuthology.orchestra.run.smithi132.stdout:521 2023-05-10T04:23:04.682 INFO:teuthology.orchestra.run.smithi132.stdout:521.out 2023-05-10T04:23:04.682 INFO:teuthology.orchestra.run.smithi132.stdout:522 2023-05-10T04:23:04.682 INFO:teuthology.orchestra.run.smithi132.stdout:522.out 2023-05-10T04:23:04.682 INFO:teuthology.orchestra.run.smithi132.stdout:523 2023-05-10T04:23:04.682 INFO:teuthology.orchestra.run.smithi132.stdout:523.out 2023-05-10T04:23:04.683 INFO:teuthology.orchestra.run.smithi132.stdout:524 2023-05-10T04:23:04.683 INFO:teuthology.orchestra.run.smithi132.stdout:524.out 2023-05-10T04:23:04.683 INFO:teuthology.orchestra.run.smithi132.stdout:525 2023-05-10T04:23:04.683 INFO:teuthology.orchestra.run.smithi132.stdout:525.out 2023-05-10T04:23:04.683 INFO:teuthology.orchestra.run.smithi132.stdout:526 2023-05-10T04:23:04.683 INFO:teuthology.orchestra.run.smithi132.stdout:526.out 2023-05-10T04:23:04.683 INFO:teuthology.orchestra.run.smithi132.stdout:527 2023-05-10T04:23:04.683 INFO:teuthology.orchestra.run.smithi132.stdout:527.out 2023-05-10T04:23:04.684 INFO:teuthology.orchestra.run.smithi132.stdout:528 2023-05-10T04:23:04.684 INFO:teuthology.orchestra.run.smithi132.stdout:528.out 2023-05-10T04:23:04.684 INFO:teuthology.orchestra.run.smithi132.stdout:529 2023-05-10T04:23:04.684 INFO:teuthology.orchestra.run.smithi132.stdout:529.out 2023-05-10T04:23:04.684 INFO:teuthology.orchestra.run.smithi132.stdout:530 2023-05-10T04:23:04.684 INFO:teuthology.orchestra.run.smithi132.stdout:530.out 2023-05-10T04:23:04.684 INFO:teuthology.orchestra.run.smithi132.stdout:531 2023-05-10T04:23:04.685 INFO:teuthology.orchestra.run.smithi132.stdout:531.out 2023-05-10T04:23:04.685 INFO:teuthology.orchestra.run.smithi132.stdout:532 2023-05-10T04:23:04.685 INFO:teuthology.orchestra.run.smithi132.stdout:532.out 2023-05-10T04:23:04.685 INFO:teuthology.orchestra.run.smithi132.stdout:533 2023-05-10T04:23:04.685 INFO:teuthology.orchestra.run.smithi132.stdout:533.out 2023-05-10T04:23:04.685 INFO:teuthology.orchestra.run.smithi132.stdout:534 2023-05-10T04:23:04.685 INFO:teuthology.orchestra.run.smithi132.stdout:534.out 2023-05-10T04:23:04.685 INFO:teuthology.orchestra.run.smithi132.stdout:535 2023-05-10T04:23:04.686 INFO:teuthology.orchestra.run.smithi132.stdout:535.out 2023-05-10T04:23:04.686 INFO:teuthology.orchestra.run.smithi132.stdout:536 2023-05-10T04:23:04.686 INFO:teuthology.orchestra.run.smithi132.stdout:536.out 2023-05-10T04:23:04.686 INFO:teuthology.orchestra.run.smithi132.stdout:537 2023-05-10T04:23:04.686 INFO:teuthology.orchestra.run.smithi132.stdout:537.out 2023-05-10T04:23:04.686 INFO:teuthology.orchestra.run.smithi132.stdout:538 2023-05-10T04:23:04.686 INFO:teuthology.orchestra.run.smithi132.stdout:538.out 2023-05-10T04:23:04.686 INFO:teuthology.orchestra.run.smithi132.stdout:539 2023-05-10T04:23:04.687 INFO:teuthology.orchestra.run.smithi132.stdout:539.out 2023-05-10T04:23:04.687 INFO:teuthology.orchestra.run.smithi132.stdout:540 2023-05-10T04:23:04.687 INFO:teuthology.orchestra.run.smithi132.stdout:540.out 2023-05-10T04:23:04.687 INFO:teuthology.orchestra.run.smithi132.stdout:541 2023-05-10T04:23:04.687 INFO:teuthology.orchestra.run.smithi132.stdout:541.out 2023-05-10T04:23:04.687 INFO:teuthology.orchestra.run.smithi132.stdout:542 2023-05-10T04:23:04.687 INFO:teuthology.orchestra.run.smithi132.stdout:542.out 2023-05-10T04:23:04.687 INFO:teuthology.orchestra.run.smithi132.stdout:543 2023-05-10T04:23:04.688 INFO:teuthology.orchestra.run.smithi132.stdout:543.out 2023-05-10T04:23:04.688 INFO:teuthology.orchestra.run.smithi132.stdout:544 2023-05-10T04:23:04.688 INFO:teuthology.orchestra.run.smithi132.stdout:544.out 2023-05-10T04:23:04.688 INFO:teuthology.orchestra.run.smithi132.stdout:545 2023-05-10T04:23:04.688 INFO:teuthology.orchestra.run.smithi132.stdout:545.out 2023-05-10T04:23:04.688 INFO:teuthology.orchestra.run.smithi132.stdout:546 2023-05-10T04:23:04.688 INFO:teuthology.orchestra.run.smithi132.stdout:546.out 2023-05-10T04:23:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:547 2023-05-10T04:23:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:547.out 2023-05-10T04:23:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:548 2023-05-10T04:23:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:548.out 2023-05-10T04:23:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:549 2023-05-10T04:23:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:549.out 2023-05-10T04:23:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:550 2023-05-10T04:23:04.689 INFO:teuthology.orchestra.run.smithi132.stdout:550.out 2023-05-10T04:23:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:551 2023-05-10T04:23:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:551.out 2023-05-10T04:23:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:552 2023-05-10T04:23:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:552.out 2023-05-10T04:23:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:553 2023-05-10T04:23:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:553.out 2023-05-10T04:23:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:554 2023-05-10T04:23:04.690 INFO:teuthology.orchestra.run.smithi132.stdout:554.out 2023-05-10T04:23:04.691 INFO:teuthology.orchestra.run.smithi132.stdout:555 2023-05-10T04:23:04.691 INFO:teuthology.orchestra.run.smithi132.stdout:555.out 2023-05-10T04:23:04.691 INFO:teuthology.orchestra.run.smithi132.stdout:556 2023-05-10T04:23:04.691 INFO:teuthology.orchestra.run.smithi132.stdout:556.out 2023-05-10T04:23:04.691 INFO:teuthology.orchestra.run.smithi132.stdout:557 2023-05-10T04:23:04.691 INFO:teuthology.orchestra.run.smithi132.stdout:557.out 2023-05-10T04:23:04.691 INFO:teuthology.orchestra.run.smithi132.stdout:558 2023-05-10T04:23:04.692 INFO:teuthology.orchestra.run.smithi132.stdout:558.out 2023-05-10T04:23:04.692 INFO:teuthology.orchestra.run.smithi132.stdout:559 2023-05-10T04:23:04.692 INFO:teuthology.orchestra.run.smithi132.stdout:559.out 2023-05-10T04:23:04.692 INFO:teuthology.orchestra.run.smithi132.stdout:560 2023-05-10T04:23:04.692 INFO:teuthology.orchestra.run.smithi132.stdout:560.out 2023-05-10T04:23:04.692 INFO:teuthology.orchestra.run.smithi132.stdout:561 2023-05-10T04:23:04.692 INFO:teuthology.orchestra.run.smithi132.stdout:561.out 2023-05-10T04:23:04.692 INFO:teuthology.orchestra.run.smithi132.stdout:562 2023-05-10T04:23:04.693 INFO:teuthology.orchestra.run.smithi132.stdout:562.out 2023-05-10T04:23:04.693 INFO:teuthology.orchestra.run.smithi132.stdout:563 2023-05-10T04:23:04.693 INFO:teuthology.orchestra.run.smithi132.stdout:563.out 2023-05-10T04:23:04.693 INFO:teuthology.orchestra.run.smithi132.stdout:564 2023-05-10T04:23:04.693 INFO:teuthology.orchestra.run.smithi132.stdout:564.out 2023-05-10T04:23:04.693 INFO:teuthology.orchestra.run.smithi132.stdout:565 2023-05-10T04:23:04.693 INFO:teuthology.orchestra.run.smithi132.stdout:565.out 2023-05-10T04:23:04.693 INFO:teuthology.orchestra.run.smithi132.stdout:566 2023-05-10T04:23:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:566.out 2023-05-10T04:23:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:567 2023-05-10T04:23:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:567.out 2023-05-10T04:23:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:568 2023-05-10T04:23:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:568.out 2023-05-10T04:23:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:569 2023-05-10T04:23:04.694 INFO:teuthology.orchestra.run.smithi132.stdout:569.out 2023-05-10T04:23:04.695 INFO:teuthology.orchestra.run.smithi132.stdout:570 2023-05-10T04:23:04.695 INFO:teuthology.orchestra.run.smithi132.stdout:570.out 2023-05-10T04:23:04.695 INFO:teuthology.orchestra.run.smithi132.stdout:571 2023-05-10T04:23:04.695 INFO:teuthology.orchestra.run.smithi132.stdout:571.out 2023-05-10T04:23:04.695 INFO:teuthology.orchestra.run.smithi132.stdout:572 2023-05-10T04:23:04.695 INFO:teuthology.orchestra.run.smithi132.stdout:572.out 2023-05-10T04:23:04.695 INFO:teuthology.orchestra.run.smithi132.stdout:573 2023-05-10T04:23:04.695 INFO:teuthology.orchestra.run.smithi132.stdout:573.out 2023-05-10T04:23:04.696 INFO:teuthology.orchestra.run.smithi132.stdout:574 2023-05-10T04:23:04.696 INFO:teuthology.orchestra.run.smithi132.stdout:574.out 2023-05-10T04:23:04.696 INFO:teuthology.orchestra.run.smithi132.stdout:575 2023-05-10T04:23:04.696 INFO:teuthology.orchestra.run.smithi132.stdout:575.out 2023-05-10T04:23:04.696 INFO:teuthology.orchestra.run.smithi132.stdout:576 2023-05-10T04:23:04.696 INFO:teuthology.orchestra.run.smithi132.stdout:576.out 2023-05-10T04:23:04.696 INFO:teuthology.orchestra.run.smithi132.stdout:577 2023-05-10T04:23:04.697 INFO:teuthology.orchestra.run.smithi132.stdout:577.out 2023-05-10T04:23:04.697 INFO:teuthology.orchestra.run.smithi132.stdout:578 2023-05-10T04:23:04.697 INFO:teuthology.orchestra.run.smithi132.stdout:578.out 2023-05-10T04:23:04.697 INFO:teuthology.orchestra.run.smithi132.stdout:579 2023-05-10T04:23:04.697 INFO:teuthology.orchestra.run.smithi132.stdout:579.out 2023-05-10T04:23:04.697 INFO:teuthology.orchestra.run.smithi132.stdout:580 2023-05-10T04:23:04.697 INFO:teuthology.orchestra.run.smithi132.stdout:580.out 2023-05-10T04:23:04.698 INFO:teuthology.orchestra.run.smithi132.stdout:581 2023-05-10T04:23:04.698 INFO:teuthology.orchestra.run.smithi132.stdout:581.out 2023-05-10T04:23:04.698 INFO:teuthology.orchestra.run.smithi132.stdout:582 2023-05-10T04:23:04.698 INFO:teuthology.orchestra.run.smithi132.stdout:582.out 2023-05-10T04:23:04.698 INFO:teuthology.orchestra.run.smithi132.stdout:583 2023-05-10T04:23:04.698 INFO:teuthology.orchestra.run.smithi132.stdout:583.out 2023-05-10T04:23:04.698 INFO:teuthology.orchestra.run.smithi132.stdout:584 2023-05-10T04:23:04.698 INFO:teuthology.orchestra.run.smithi132.stdout:584.out 2023-05-10T04:23:04.699 INFO:teuthology.orchestra.run.smithi132.stdout:585 2023-05-10T04:23:04.699 INFO:teuthology.orchestra.run.smithi132.stdout:585.out 2023-05-10T04:23:04.699 INFO:teuthology.orchestra.run.smithi132.stdout:586 2023-05-10T04:23:04.699 INFO:teuthology.orchestra.run.smithi132.stdout:586.out 2023-05-10T04:23:04.699 INFO:teuthology.orchestra.run.smithi132.stdout:587 2023-05-10T04:23:04.699 INFO:teuthology.orchestra.run.smithi132.stdout:587.out 2023-05-10T04:23:04.699 INFO:teuthology.orchestra.run.smithi132.stdout:588 2023-05-10T04:23:04.699 INFO:teuthology.orchestra.run.smithi132.stdout:588.out 2023-05-10T04:23:04.700 INFO:teuthology.orchestra.run.smithi132.stdout:589 2023-05-10T04:23:04.700 INFO:teuthology.orchestra.run.smithi132.stdout:589.out 2023-05-10T04:23:04.700 INFO:teuthology.orchestra.run.smithi132.stdout:590 2023-05-10T04:23:04.700 INFO:teuthology.orchestra.run.smithi132.stdout:590.out 2023-05-10T04:23:04.700 INFO:teuthology.orchestra.run.smithi132.stdout:591 2023-05-10T04:23:04.700 INFO:teuthology.orchestra.run.smithi132.stdout:591.out 2023-05-10T04:23:04.700 INFO:teuthology.orchestra.run.smithi132.stdout:592 2023-05-10T04:23:04.701 INFO:teuthology.orchestra.run.smithi132.stdout:592.out 2023-05-10T04:23:04.701 INFO:teuthology.orchestra.run.smithi132.stdout:593 2023-05-10T04:23:04.701 INFO:teuthology.orchestra.run.smithi132.stdout:593.out 2023-05-10T04:23:04.701 INFO:teuthology.orchestra.run.smithi132.stdout:594 2023-05-10T04:23:04.701 INFO:teuthology.orchestra.run.smithi132.stdout:594.out 2023-05-10T04:23:04.701 INFO:teuthology.orchestra.run.smithi132.stdout:595 2023-05-10T04:23:04.701 INFO:teuthology.orchestra.run.smithi132.stdout:595.out 2023-05-10T04:23:04.701 INFO:teuthology.orchestra.run.smithi132.stdout:596 2023-05-10T04:23:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:596.out 2023-05-10T04:23:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:597 2023-05-10T04:23:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:597.out 2023-05-10T04:23:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:598 2023-05-10T04:23:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:598.out 2023-05-10T04:23:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:599 2023-05-10T04:23:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:599.out 2023-05-10T04:23:04.702 INFO:teuthology.orchestra.run.smithi132.stdout:600 2023-05-10T04:23:04.703 INFO:teuthology.orchestra.run.smithi132.stdout:600.out 2023-05-10T04:23:04.703 INFO:teuthology.orchestra.run.smithi132.stdout:601 2023-05-10T04:23:04.703 INFO:teuthology.orchestra.run.smithi132.stdout:601.out 2023-05-10T04:23:04.703 INFO:teuthology.orchestra.run.smithi132.stdout:602 2023-05-10T04:23:04.703 INFO:teuthology.orchestra.run.smithi132.stdout:602.out 2023-05-10T04:23:04.703 INFO:teuthology.orchestra.run.smithi132.stdout:603 2023-05-10T04:23:04.703 INFO:teuthology.orchestra.run.smithi132.stdout:603.out 2023-05-10T04:23:04.703 INFO:teuthology.orchestra.run.smithi132.stdout:604 2023-05-10T04:23:04.704 INFO:teuthology.orchestra.run.smithi132.stdout:604.out 2023-05-10T04:23:04.704 INFO:teuthology.orchestra.run.smithi132.stdout:605 2023-05-10T04:23:04.704 INFO:teuthology.orchestra.run.smithi132.stdout:605.out 2023-05-10T04:23:04.704 INFO:teuthology.orchestra.run.smithi132.stdout:606 2023-05-10T04:23:04.704 INFO:teuthology.orchestra.run.smithi132.stdout:606.out 2023-05-10T04:23:04.704 INFO:teuthology.orchestra.run.smithi132.stdout:607 2023-05-10T04:23:04.704 INFO:teuthology.orchestra.run.smithi132.stdout:607.out 2023-05-10T04:23:04.704 INFO:teuthology.orchestra.run.smithi132.stdout:608 2023-05-10T04:23:04.705 INFO:teuthology.orchestra.run.smithi132.stdout:608.out 2023-05-10T04:23:04.705 INFO:teuthology.orchestra.run.smithi132.stdout:609 2023-05-10T04:23:04.705 INFO:teuthology.orchestra.run.smithi132.stdout:609.out 2023-05-10T04:23:04.705 INFO:teuthology.orchestra.run.smithi132.stdout:610 2023-05-10T04:23:04.705 INFO:teuthology.orchestra.run.smithi132.stdout:610.out 2023-05-10T04:23:04.705 INFO:teuthology.orchestra.run.smithi132.stdout:611 2023-05-10T04:23:04.705 INFO:teuthology.orchestra.run.smithi132.stdout:611.out 2023-05-10T04:23:04.705 INFO:teuthology.orchestra.run.smithi132.stdout:612 2023-05-10T04:23:04.706 INFO:teuthology.orchestra.run.smithi132.stdout:612.out 2023-05-10T04:23:04.706 INFO:teuthology.orchestra.run.smithi132.stdout:613 2023-05-10T04:23:04.706 INFO:teuthology.orchestra.run.smithi132.stdout:613.out 2023-05-10T04:23:04.706 INFO:teuthology.orchestra.run.smithi132.stdout:614 2023-05-10T04:23:04.706 INFO:teuthology.orchestra.run.smithi132.stdout:614.out 2023-05-10T04:23:04.706 INFO:teuthology.orchestra.run.smithi132.stdout:615 2023-05-10T04:23:04.706 INFO:teuthology.orchestra.run.smithi132.stdout:615.out 2023-05-10T04:23:04.706 INFO:teuthology.orchestra.run.smithi132.stdout:616 2023-05-10T04:23:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:616.out 2023-05-10T04:23:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:617 2023-05-10T04:23:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:617.out 2023-05-10T04:23:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:618 2023-05-10T04:23:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:618.out 2023-05-10T04:23:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:619 2023-05-10T04:23:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:619.out 2023-05-10T04:23:04.707 INFO:teuthology.orchestra.run.smithi132.stdout:620 2023-05-10T04:23:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:620.out 2023-05-10T04:23:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:621 2023-05-10T04:23:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:621.out 2023-05-10T04:23:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:622 2023-05-10T04:23:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:622.out 2023-05-10T04:23:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:623 2023-05-10T04:23:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:623.out 2023-05-10T04:23:04.708 INFO:teuthology.orchestra.run.smithi132.stdout:624 2023-05-10T04:23:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:624.out 2023-05-10T04:23:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:625 2023-05-10T04:23:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:625.out 2023-05-10T04:23:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:626 2023-05-10T04:23:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:626.out 2023-05-10T04:23:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:627 2023-05-10T04:23:04.709 INFO:teuthology.orchestra.run.smithi132.stdout:627.out 2023-05-10T04:23:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:628 2023-05-10T04:23:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:628.out 2023-05-10T04:23:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:629 2023-05-10T04:23:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:629.out 2023-05-10T04:23:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:630 2023-05-10T04:23:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:630.out 2023-05-10T04:23:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:631 2023-05-10T04:23:04.710 INFO:teuthology.orchestra.run.smithi132.stdout:631.out 2023-05-10T04:23:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:632 2023-05-10T04:23:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:632.out 2023-05-10T04:23:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:633 2023-05-10T04:23:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:633.out 2023-05-10T04:23:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:634 2023-05-10T04:23:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:634.out 2023-05-10T04:23:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:635 2023-05-10T04:23:04.711 INFO:teuthology.orchestra.run.smithi132.stdout:635.out 2023-05-10T04:23:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:636 2023-05-10T04:23:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:636.out 2023-05-10T04:23:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:637 2023-05-10T04:23:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:637.out 2023-05-10T04:23:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:638 2023-05-10T04:23:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:638.out 2023-05-10T04:23:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:639 2023-05-10T04:23:04.712 INFO:teuthology.orchestra.run.smithi132.stdout:639.out 2023-05-10T04:23:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:640 2023-05-10T04:23:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:640.out 2023-05-10T04:23:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:641 2023-05-10T04:23:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:641.out 2023-05-10T04:23:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:642 2023-05-10T04:23:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:642.out 2023-05-10T04:23:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:643 2023-05-10T04:23:04.713 INFO:teuthology.orchestra.run.smithi132.stdout:643.out 2023-05-10T04:23:04.714 INFO:teuthology.orchestra.run.smithi132.stdout:644 2023-05-10T04:23:04.714 INFO:teuthology.orchestra.run.smithi132.stdout:644.out 2023-05-10T04:23:04.714 INFO:teuthology.orchestra.run.smithi132.stdout:645 2023-05-10T04:23:04.714 INFO:teuthology.orchestra.run.smithi132.stdout:645.out 2023-05-10T04:23:04.714 INFO:teuthology.orchestra.run.smithi132.stdout:646 2023-05-10T04:23:04.714 INFO:teuthology.orchestra.run.smithi132.stdout:646.out 2023-05-10T04:23:04.714 INFO:teuthology.orchestra.run.smithi132.stdout:647 2023-05-10T04:23:04.714 INFO:teuthology.orchestra.run.smithi132.stdout:647.out 2023-05-10T04:23:04.715 INFO:teuthology.orchestra.run.smithi132.stdout:648 2023-05-10T04:23:04.715 INFO:teuthology.orchestra.run.smithi132.stdout:648.out 2023-05-10T04:23:04.715 INFO:teuthology.orchestra.run.smithi132.stdout:649 2023-05-10T04:23:04.715 INFO:teuthology.orchestra.run.smithi132.stdout:649.out 2023-05-10T04:23:04.715 INFO:teuthology.orchestra.run.smithi132.stdout:650 2023-05-10T04:23:04.715 INFO:teuthology.orchestra.run.smithi132.stdout:650.out 2023-05-10T04:23:04.715 INFO:teuthology.orchestra.run.smithi132.stdout:651 2023-05-10T04:23:04.715 INFO:teuthology.orchestra.run.smithi132.stdout:651.out 2023-05-10T04:23:04.716 INFO:teuthology.orchestra.run.smithi132.stdout:652 2023-05-10T04:23:04.716 INFO:teuthology.orchestra.run.smithi132.stdout:652.out 2023-05-10T04:23:04.716 INFO:teuthology.orchestra.run.smithi132.stdout:653 2023-05-10T04:23:04.716 INFO:teuthology.orchestra.run.smithi132.stdout:653.out 2023-05-10T04:23:04.716 INFO:teuthology.orchestra.run.smithi132.stdout:654 2023-05-10T04:23:04.716 INFO:teuthology.orchestra.run.smithi132.stdout:654.out 2023-05-10T04:23:04.716 INFO:teuthology.orchestra.run.smithi132.stdout:655 2023-05-10T04:23:04.717 INFO:teuthology.orchestra.run.smithi132.stdout:655.out 2023-05-10T04:23:04.717 INFO:teuthology.orchestra.run.smithi132.stdout:656 2023-05-10T04:23:04.717 INFO:teuthology.orchestra.run.smithi132.stdout:656.out 2023-05-10T04:23:04.717 INFO:teuthology.orchestra.run.smithi132.stdout:657 2023-05-10T04:23:04.717 INFO:teuthology.orchestra.run.smithi132.stdout:657.out 2023-05-10T04:23:04.717 INFO:teuthology.orchestra.run.smithi132.stdout:658 2023-05-10T04:23:04.717 INFO:teuthology.orchestra.run.smithi132.stdout:658.out 2023-05-10T04:23:04.717 INFO:teuthology.orchestra.run.smithi132.stdout:659 2023-05-10T04:23:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:659.out 2023-05-10T04:23:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:660 2023-05-10T04:23:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:660.out 2023-05-10T04:23:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:661 2023-05-10T04:23:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:661.out 2023-05-10T04:23:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:662 2023-05-10T04:23:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:662.out 2023-05-10T04:23:04.718 INFO:teuthology.orchestra.run.smithi132.stdout:663 2023-05-10T04:23:04.719 INFO:teuthology.orchestra.run.smithi132.stdout:663.out 2023-05-10T04:23:04.719 INFO:teuthology.orchestra.run.smithi132.stdout:664 2023-05-10T04:23:04.719 INFO:teuthology.orchestra.run.smithi132.stdout:664.out 2023-05-10T04:23:04.719 INFO:teuthology.orchestra.run.smithi132.stdout:665 2023-05-10T04:23:04.719 INFO:teuthology.orchestra.run.smithi132.stdout:665.out 2023-05-10T04:23:04.719 INFO:teuthology.orchestra.run.smithi132.stdout:666 2023-05-10T04:23:04.719 INFO:teuthology.orchestra.run.smithi132.stdout:666.out 2023-05-10T04:23:04.719 INFO:teuthology.orchestra.run.smithi132.stdout:667 2023-05-10T04:23:04.720 INFO:teuthology.orchestra.run.smithi132.stdout:667.out 2023-05-10T04:23:04.720 INFO:teuthology.orchestra.run.smithi132.stdout:668 2023-05-10T04:23:04.720 INFO:teuthology.orchestra.run.smithi132.stdout:668.out 2023-05-10T04:23:04.720 INFO:teuthology.orchestra.run.smithi132.stdout:669 2023-05-10T04:23:04.720 INFO:teuthology.orchestra.run.smithi132.stdout:669.out 2023-05-10T04:23:04.720 INFO:teuthology.orchestra.run.smithi132.stdout:670 2023-05-10T04:23:04.720 INFO:teuthology.orchestra.run.smithi132.stdout:670.out 2023-05-10T04:23:04.720 INFO:teuthology.orchestra.run.smithi132.stdout:671 2023-05-10T04:23:04.721 INFO:teuthology.orchestra.run.smithi132.stdout:671.out 2023-05-10T04:23:04.721 INFO:teuthology.orchestra.run.smithi132.stdout:672 2023-05-10T04:23:04.721 INFO:teuthology.orchestra.run.smithi132.stdout:672.out 2023-05-10T04:23:04.721 INFO:teuthology.orchestra.run.smithi132.stdout:673 2023-05-10T04:23:04.721 INFO:teuthology.orchestra.run.smithi132.stdout:673.out 2023-05-10T04:23:04.721 INFO:teuthology.orchestra.run.smithi132.stdout:674 2023-05-10T04:23:04.721 INFO:teuthology.orchestra.run.smithi132.stdout:674.out 2023-05-10T04:23:04.721 INFO:teuthology.orchestra.run.smithi132.stdout:675 2023-05-10T04:23:04.722 INFO:teuthology.orchestra.run.smithi132.stdout:675.out 2023-05-10T04:23:04.722 INFO:teuthology.orchestra.run.smithi132.stdout:676 2023-05-10T04:23:04.722 INFO:teuthology.orchestra.run.smithi132.stdout:676.out 2023-05-10T04:23:04.722 INFO:teuthology.orchestra.run.smithi132.stdout:677 2023-05-10T04:23:04.722 INFO:teuthology.orchestra.run.smithi132.stdout:677.out 2023-05-10T04:23:04.722 INFO:teuthology.orchestra.run.smithi132.stdout:678 2023-05-10T04:23:04.722 INFO:teuthology.orchestra.run.smithi132.stdout:678.out 2023-05-10T04:23:04.723 INFO:teuthology.orchestra.run.smithi132.stdout:679 2023-05-10T04:23:04.723 INFO:teuthology.orchestra.run.smithi132.stdout:679.out 2023-05-10T04:23:04.723 INFO:teuthology.orchestra.run.smithi132.stdout:680 2023-05-10T04:23:04.723 INFO:teuthology.orchestra.run.smithi132.stdout:680.out 2023-05-10T04:23:04.723 INFO:teuthology.orchestra.run.smithi132.stdout:681 2023-05-10T04:23:04.723 INFO:teuthology.orchestra.run.smithi132.stdout:681.out 2023-05-10T04:23:04.723 INFO:teuthology.orchestra.run.smithi132.stdout:682 2023-05-10T04:23:04.723 INFO:teuthology.orchestra.run.smithi132.stdout:682.out 2023-05-10T04:23:04.724 INFO:teuthology.orchestra.run.smithi132.stdout:683 2023-05-10T04:23:04.724 INFO:teuthology.orchestra.run.smithi132.stdout:683.out 2023-05-10T04:23:04.724 INFO:teuthology.orchestra.run.smithi132.stdout:684 2023-05-10T04:23:04.724 INFO:teuthology.orchestra.run.smithi132.stdout:684.out 2023-05-10T04:23:04.724 INFO:teuthology.orchestra.run.smithi132.stdout:685 2023-05-10T04:23:04.724 INFO:teuthology.orchestra.run.smithi132.stdout:685.out 2023-05-10T04:23:04.724 INFO:teuthology.orchestra.run.smithi132.stdout:686 2023-05-10T04:23:04.724 INFO:teuthology.orchestra.run.smithi132.stdout:686.out 2023-05-10T04:23:04.725 INFO:teuthology.orchestra.run.smithi132.stdout:687 2023-05-10T04:23:04.725 INFO:teuthology.orchestra.run.smithi132.stdout:687.out 2023-05-10T04:23:04.725 INFO:teuthology.orchestra.run.smithi132.stdout:688 2023-05-10T04:23:04.725 INFO:teuthology.orchestra.run.smithi132.stdout:688.out 2023-05-10T04:23:04.725 INFO:teuthology.orchestra.run.smithi132.stdout:689 2023-05-10T04:23:04.725 INFO:teuthology.orchestra.run.smithi132.stdout:689.out 2023-05-10T04:23:04.725 INFO:teuthology.orchestra.run.smithi132.stdout:690 2023-05-10T04:23:04.725 INFO:teuthology.orchestra.run.smithi132.stdout:690.out 2023-05-10T04:23:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:691 2023-05-10T04:23:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:691.out 2023-05-10T04:23:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:692 2023-05-10T04:23:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:692.out 2023-05-10T04:23:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:693 2023-05-10T04:23:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:693.out 2023-05-10T04:23:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:694 2023-05-10T04:23:04.726 INFO:teuthology.orchestra.run.smithi132.stdout:694.out 2023-05-10T04:23:04.727 INFO:teuthology.orchestra.run.smithi132.stdout:695 2023-05-10T04:23:04.727 INFO:teuthology.orchestra.run.smithi132.stdout:695.out 2023-05-10T04:23:04.727 INFO:teuthology.orchestra.run.smithi132.stdout:696 2023-05-10T04:23:04.727 INFO:teuthology.orchestra.run.smithi132.stdout:696.out 2023-05-10T04:23:04.727 INFO:teuthology.orchestra.run.smithi132.stdout:697 2023-05-10T04:23:04.727 INFO:teuthology.orchestra.run.smithi132.stdout:697.out 2023-05-10T04:23:04.727 INFO:teuthology.orchestra.run.smithi132.stdout:698 2023-05-10T04:23:04.727 INFO:teuthology.orchestra.run.smithi132.stdout:698.out 2023-05-10T04:23:04.728 INFO:teuthology.orchestra.run.smithi132.stdout:699 2023-05-10T04:23:04.728 INFO:teuthology.orchestra.run.smithi132.stdout:699.out 2023-05-10T04:23:04.728 INFO:teuthology.orchestra.run.smithi132.stdout:700 2023-05-10T04:23:04.728 INFO:teuthology.orchestra.run.smithi132.stdout:700.out 2023-05-10T04:23:04.728 INFO:teuthology.orchestra.run.smithi132.stdout:701 2023-05-10T04:23:04.728 INFO:teuthology.orchestra.run.smithi132.stdout:701.out 2023-05-10T04:23:04.728 INFO:teuthology.orchestra.run.smithi132.stdout:702 2023-05-10T04:23:04.728 INFO:teuthology.orchestra.run.smithi132.stdout:702.out 2023-05-10T04:23:04.729 INFO:teuthology.orchestra.run.smithi132.stdout:703 2023-05-10T04:23:04.729 INFO:teuthology.orchestra.run.smithi132.stdout:703.out 2023-05-10T04:23:04.729 INFO:teuthology.orchestra.run.smithi132.stdout:704 2023-05-10T04:23:04.729 INFO:teuthology.orchestra.run.smithi132.stdout:704.out 2023-05-10T04:23:04.729 INFO:teuthology.orchestra.run.smithi132.stdout:705 2023-05-10T04:23:04.729 INFO:teuthology.orchestra.run.smithi132.stdout:705.out 2023-05-10T04:23:04.729 INFO:teuthology.orchestra.run.smithi132.stdout:706 2023-05-10T04:23:04.730 INFO:teuthology.orchestra.run.smithi132.stdout:706.out 2023-05-10T04:23:04.730 INFO:teuthology.orchestra.run.smithi132.stdout:707 2023-05-10T04:23:04.730 INFO:teuthology.orchestra.run.smithi132.stdout:707.out 2023-05-10T04:23:04.730 INFO:teuthology.orchestra.run.smithi132.stdout:708 2023-05-10T04:23:04.730 INFO:teuthology.orchestra.run.smithi132.stdout:708.out 2023-05-10T04:23:04.730 INFO:teuthology.orchestra.run.smithi132.stdout:709 2023-05-10T04:23:04.730 INFO:teuthology.orchestra.run.smithi132.stdout:709.out 2023-05-10T04:23:04.730 INFO:teuthology.orchestra.run.smithi132.stdout:710 2023-05-10T04:23:04.731 INFO:teuthology.orchestra.run.smithi132.stdout:710.out 2023-05-10T04:23:04.731 INFO:teuthology.orchestra.run.smithi132.stdout:711 2023-05-10T04:23:04.731 INFO:teuthology.orchestra.run.smithi132.stdout:711.out 2023-05-10T04:23:04.731 INFO:teuthology.orchestra.run.smithi132.stdout:712 2023-05-10T04:23:04.731 INFO:teuthology.orchestra.run.smithi132.stdout:712.out 2023-05-10T04:23:04.731 INFO:teuthology.orchestra.run.smithi132.stdout:713 2023-05-10T04:23:04.731 INFO:teuthology.orchestra.run.smithi132.stdout:713.out 2023-05-10T04:23:04.731 INFO:teuthology.orchestra.run.smithi132.stdout:714 2023-05-10T04:23:04.732 INFO:teuthology.orchestra.run.smithi132.stdout:714.out 2023-05-10T04:23:04.732 INFO:teuthology.orchestra.run.smithi132.stdout:715 2023-05-10T04:23:04.732 INFO:teuthology.orchestra.run.smithi132.stdout:715.out 2023-05-10T04:23:04.732 INFO:teuthology.orchestra.run.smithi132.stdout:716 2023-05-10T04:23:04.732 INFO:teuthology.orchestra.run.smithi132.stdout:716.out 2023-05-10T04:23:04.732 INFO:teuthology.orchestra.run.smithi132.stdout:717 2023-05-10T04:23:04.732 INFO:teuthology.orchestra.run.smithi132.stdout:717.out 2023-05-10T04:23:04.732 INFO:teuthology.orchestra.run.smithi132.stdout:718 2023-05-10T04:23:04.733 INFO:teuthology.orchestra.run.smithi132.stdout:718.out 2023-05-10T04:23:04.733 INFO:teuthology.orchestra.run.smithi132.stdout:719 2023-05-10T04:23:04.733 INFO:teuthology.orchestra.run.smithi132.stdout:719.out 2023-05-10T04:23:04.733 INFO:teuthology.orchestra.run.smithi132.stdout:720 2023-05-10T04:23:04.733 INFO:teuthology.orchestra.run.smithi132.stdout:720.out 2023-05-10T04:23:04.733 INFO:teuthology.orchestra.run.smithi132.stdout:721 2023-05-10T04:23:04.733 INFO:teuthology.orchestra.run.smithi132.stdout:721.out 2023-05-10T04:23:04.733 INFO:teuthology.orchestra.run.smithi132.stdout:722 2023-05-10T04:23:04.734 INFO:teuthology.orchestra.run.smithi132.stdout:722.out 2023-05-10T04:23:04.734 INFO:teuthology.orchestra.run.smithi132.stdout:723 2023-05-10T04:23:04.734 INFO:teuthology.orchestra.run.smithi132.stdout:723.out 2023-05-10T04:23:04.734 INFO:teuthology.orchestra.run.smithi132.stdout:724 2023-05-10T04:23:04.734 INFO:teuthology.orchestra.run.smithi132.stdout:724.out 2023-05-10T04:23:04.734 INFO:teuthology.orchestra.run.smithi132.stdout:725 2023-05-10T04:23:04.734 INFO:teuthology.orchestra.run.smithi132.stdout:725.out 2023-05-10T04:23:04.735 INFO:teuthology.orchestra.run.smithi132.stdout:726 2023-05-10T04:23:04.735 INFO:teuthology.orchestra.run.smithi132.stdout:726.out 2023-05-10T04:23:04.735 INFO:teuthology.orchestra.run.smithi132.stdout:727 2023-05-10T04:23:04.735 INFO:teuthology.orchestra.run.smithi132.stdout:727.out 2023-05-10T04:23:04.735 INFO:teuthology.orchestra.run.smithi132.stdout:group.list 2023-05-10T04:23:04.735 INFO:teuthology.orchestra.run.smithi132.stdout:Makefile 2023-05-10T04:23:04.737 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-05-10T04:23:05.193 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:23:05.204 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:23:05.204 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:10.348 INFO:teuthology.orchestra.run.smithi132.stdout:generic/001 5s 2023-05-10T04:23:10.360 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/001 2023-05-10T04:23:10.360 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:23:10.365 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:10.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[146346]: fuse finished with error 0 and tester_r 0 2023-05-10T04:23:10.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:23:10.388 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-05-10T04:23:10.775 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:23:10.786 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:23:10.786 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:11.560 INFO:teuthology.orchestra.run.smithi132.stdout:generic/002 1s 2023-05-10T04:23:11.571 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/002 2023-05-10T04:23:11.572 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:23:11.576 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:11.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:23:11.598 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-05-10T04:23:12.024 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:23:12.037 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:23:12.037 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:12.313 INFO:teuthology.orchestra.run.smithi132.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:23:12.321 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/003 2023-05-10T04:23:12.321 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/003 2023-05-10T04:23:12.321 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:23:12.327 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:12.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:23:12.347 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-05-10T04:23:12.723 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:23:12.735 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:23:12.735 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:13.030 INFO:teuthology.orchestra.run.smithi132.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-10T04:23:13.038 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/004 2023-05-10T04:23:13.038 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/004 2023-05-10T04:23:13.038 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:23:13.043 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:13.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:23:13.064 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-05-10T04:23:13.445 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:23:13.456 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:23:13.456 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:14.440 INFO:teuthology.orchestra.run.smithi132.stdout:generic/005 1s 2023-05-10T04:23:14.451 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/005 2023-05-10T04:23:14.451 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:23:14.456 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:14.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:23:14.479 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-05-10T04:23:14.892 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:23:14.903 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:23:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:33.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:23:33.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:23:53.033 INFO:teuthology.orchestra.run.smithi132.stdout:generic/006 39s 2023-05-10T04:23:53.044 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/006 2023-05-10T04:23:53.045 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:23:53.050 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:23:53.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:23:53.072 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-05-10T04:23:53.688 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:23:53.714 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:23:53.715 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:24:03.528 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:24:03.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:24:34.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:24:34.861 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:25:05.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:25:05.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:25:24.508 INFO:teuthology.orchestra.run.smithi132.stdout:generic/007 91s 2023-05-10T04:25:24.519 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/007 2023-05-10T04:25:24.519 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:25:24.524 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:25:24.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:25:24.547 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-05-10T04:25:25.049 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:25:25.060 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:25:25.060 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:25:26.532 INFO:teuthology.orchestra.run.smithi132.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-10T04:25:26.540 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/008 2023-05-10T04:25:26.541 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/008 2023-05-10T04:25:26.541 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:25:26.546 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:25:26.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:25:26.568 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-05-10T04:25:26.954 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:25:26.965 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:25:26.965 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:25:28.475 INFO:teuthology.orchestra.run.smithi132.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-10T04:25:28.483 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/009 2023-05-10T04:25:28.483 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/009 2023-05-10T04:25:28.484 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:25:28.489 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:25:28.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:25:28.511 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-05-10T04:25:28.897 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:25:28.908 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:25:28.908 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:25:29.188 INFO:teuthology.orchestra.run.smithi132.stdout:generic/010 [not run] /tmp/tmp.I82EepBFpzxfstests-dev/src/dbtest not built 2023-05-10T04:25:29.196 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/010 2023-05-10T04:25:29.197 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/010 2023-05-10T04:25:29.197 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:25:29.202 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:25:29.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:25:29.224 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-05-10T04:25:29.606 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:25:29.617 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:25:29.618 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:25:35.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:25:35.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:26:05.272 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:26:05.277 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:26:16.801 INFO:teuthology.orchestra.run.smithi132.stdout:generic/011 47s 2023-05-10T04:26:16.812 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/011 2023-05-10T04:26:16.812 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:26:16.818 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:26:16.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:26:16.841 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-05-10T04:26:17.266 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:26:17.277 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:26:17.277 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:26:19.019 INFO:teuthology.orchestra.run.smithi132.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-10T04:26:19.027 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/012 2023-05-10T04:26:19.028 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/012 2023-05-10T04:26:19.028 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:26:19.033 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:26:19.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:26:19.062 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-05-10T04:26:19.473 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:26:19.484 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:26:19.485 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:26:37.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:26:37.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:27:08.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:27:08.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:27:40.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:27:40.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:28:11.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:28:11.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:28:13.496 INFO:teuthology.orchestra.run.smithi132.stdout:generic/013 114s 2023-05-10T04:28:14.635 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/013 2023-05-10T04:28:14.635 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:28:14.643 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:28:14.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:28:14.672 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-05-10T04:28:15.531 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:28:15.548 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:28:15.548 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:28:45.508 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:28:45.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:28:46.772 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-05-10T04:28:46.769+0000 7f53445f9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 192972) UID: 0 2023-05-10T04:28:46.801 INFO:tasks.ceph.mds.c.smithi132.stderr:2023-05-10T04:28:46.769+0000 7f1b76df9700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 192972) UID: 0 2023-05-10T04:31:37.326 INFO:teuthology.orchestra.run.smithi132.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-mds.c.log.1: 2023-05-10T04:31:37.326 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: stdin: file size changed while zipping 2023-05-10T04:32:13.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:32:13.589 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:32:44.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:32:44.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:33:06.022 INFO:teuthology.orchestra.run.smithi132.stdout:generic/014 291s 2023-05-10T04:33:06.054 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/014 2023-05-10T04:33:06.054 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:33:06.061 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:06.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:33:06.096 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-05-10T04:33:06.770 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:06.784 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:06.785 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:07.183 INFO:teuthology.orchestra.run.smithi132.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:33:07.194 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/015 2023-05-10T04:33:07.195 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/015 2023-05-10T04:33:07.195 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:33:07.201 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:07.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:33:07.234 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-05-10T04:33:07.805 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:07.822 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:07.822 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:10.466 INFO:teuthology.orchestra.run.smithi132.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-10T04:33:10.479 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/016 2023-05-10T04:33:10.479 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/016 2023-05-10T04:33:10.479 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:33:10.489 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:10.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:33:10.516 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-05-10T04:33:11.319 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:11.337 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:11.337 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:11.737 INFO:teuthology.orchestra.run.smithi132.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:33:11.749 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/017 2023-05-10T04:33:11.749 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/017 2023-05-10T04:33:11.750 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:33:11.756 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:11.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:33:11.782 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-05-10T04:33:12.358 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:12.375 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:12.376 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:12.793 INFO:teuthology.orchestra.run.smithi132.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:33:12.805 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/018 2023-05-10T04:33:12.805 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/018 2023-05-10T04:33:12.805 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:33:12.813 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:12.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:33:12.847 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-05-10T04:33:13.403 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:13.420 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:13.420 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:13.798 INFO:teuthology.orchestra.run.smithi132.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:33:13.813 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/019 2023-05-10T04:33:13.814 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/019 2023-05-10T04:33:13.814 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:33:13.822 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:13.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:33:13.852 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-05-10T04:33:14.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:33:14.299 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:33:14.453 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:14.473 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:14.473 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:35.700 INFO:teuthology.orchestra.run.smithi132.stdout:generic/020 - output mismatch (see /tmp/tmp.I82EepBFpzxfstests-dev/results//generic/020.out.bad) 2023-05-10T04:33:35.708 INFO:teuthology.orchestra.run.smithi132.stdout: --- tests/generic/020.out 2023-05-10 04:21:04.404581476 +0000 2023-05-10T04:33:35.709 INFO:teuthology.orchestra.run.smithi132.stdout: +++ /tmp/tmp.I82EepBFpzxfstests-dev/results//generic/020.out.bad 2023-05-10 04:33:35.690969276 +0000 2023-05-10T04:33:35.709 INFO:teuthology.orchestra.run.smithi132.stdout: @@ -39,27 +39,6 @@ 2023-05-10T04:33:35.709 INFO:teuthology.orchestra.run.smithi132.stdout: user.snrub="fish2\012" 2023-05-10T04:33:35.709 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:35.709 INFO:teuthology.orchestra.run.smithi132.stdout: *** add lots of attributes 2023-05-10T04:33:35.709 INFO:teuthology.orchestra.run.smithi132.stdout: -*** check 2023-05-10T04:33:35.709 INFO:teuthology.orchestra.run.smithi132.stdout: - *** MAX_ATTRS attribute(s) 2023-05-10T04:33:35.710 INFO:teuthology.orchestra.run.smithi132.stdout: -*** remove lots of attributes 2023-05-10T04:33:35.710 INFO:teuthology.orchestra.run.smithi132.stdout: - *** print attributes 2023-05-10T04:33:35.710 INFO:teuthology.orchestra.run.smithi132.stdout: -# file: 2023-05-10T04:33:35.710 INFO:teuthology.orchestra.run.smithi132.stdout: -user.snrub="fish2\012" 2023-05-10T04:33:35.710 INFO:teuthology.orchestra.run.smithi132.stdout: - 2023-05-10T04:33:35.710 INFO:teuthology.orchestra.run.smithi132.stdout: -*** really long value 2023-05-10T04:33:35.710 INFO:teuthology.orchestra.run.smithi132.stdout: -0000000 00 2023-05-10T04:33:35.711 INFO:teuthology.orchestra.run.smithi132.stdout: -* 2023-05-10T04:33:35.711 INFO:teuthology.orchestra.run.smithi132.stdout: -ATTRSIZE 2023-05-10T04:33:35.711 INFO:teuthology.orchestra.run.smithi132.stdout: -*** set/get/remove really long names (expect failure) 2023-05-10T04:33:35.711 INFO:teuthology.orchestra.run.smithi132.stdout: -attr_set: Invalid argument 2023-05-10T04:33:35.711 INFO:teuthology.orchestra.run.smithi132.stdout: -Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-10T04:33:35.711 INFO:teuthology.orchestra.run.smithi132.stdout: -attr_get: Invalid argument 2023-05-10T04:33:35.711 INFO:teuthology.orchestra.run.smithi132.stdout: -Could not get "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-10T04:33:35.712 INFO:teuthology.orchestra.run.smithi132.stdout: -attr_remove: Invalid argument 2023-05-10T04:33:35.712 INFO:teuthology.orchestra.run.smithi132.stdout: -Could not remove "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-05-10T04:33:35.712 INFO:teuthology.orchestra.run.smithi132.stdout: -*** check final 2023-05-10T04:33:35.712 INFO:teuthology.orchestra.run.smithi132.stdout: - *** print attributes 2023-05-10T04:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout: -# file: 2023-05-10T04:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout: -user.snrub="fish2\012" 2023-05-10T04:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout: - 2023-05-10T04:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout: -*** delete 2023-05-10T04:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout: +attr_set: No space left on device 2023-05-10T04:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout: +Could not set "attribute_2335" for /tmp/tmp.iExZIwHbrRtest/attribute_195686 2023-05-10T04:33:35.713 INFO:teuthology.orchestra.run.smithi132.stdout: +!!! failed to add "attribute_2335" 2023-05-10T04:33:35.717 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/020 2023-05-10T04:33:35.717 INFO:teuthology.orchestra.run.smithi132.stdout:Failures: generic/020 2023-05-10T04:33:35.717 INFO:teuthology.orchestra.run.smithi132.stdout:Failed 1 of 1 tests 2023-05-10T04:33:35.725 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:35.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-10T04:33:35.760 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-05-10T04:33:35.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-05-10T04:33:35.761 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-05-10T04:33:36.669 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:36.683 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:36.684 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:39.607 INFO:teuthology.orchestra.run.smithi132.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-10T04:33:39.619 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/021 2023-05-10T04:33:39.619 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/021 2023-05-10T04:33:39.619 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:33:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:39.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:33:39.671 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-05-10T04:33:40.501 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:40.648 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:40.648 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:43.168 INFO:teuthology.orchestra.run.smithi132.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-10T04:33:43.179 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/022 2023-05-10T04:33:43.180 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/022 2023-05-10T04:33:43.180 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:33:43.186 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:43.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:33:43.214 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-05-10T04:33:44.010 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:33:44.028 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:33:44.028 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:33:44.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:33:44.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:34:14.577 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:34:14.585 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:34:45.901 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:34:45.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:35:01.404 INFO:teuthology.orchestra.run.smithi132.stdout:generic/023 77s 2023-05-10T04:35:01.416 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/023 2023-05-10T04:35:01.416 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:01.422 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:01.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:01.681 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-05-10T04:35:02.097 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:02.108 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:02.108 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:02.420 INFO:teuthology.orchestra.run.smithi132.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-05-10T04:35:02.505 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/024 2023-05-10T04:35:02.505 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/024 2023-05-10T04:35:02.505 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:02.505 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:02.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:02.549 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-05-10T04:35:03.101 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:03.112 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:03.112 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:03.428 INFO:teuthology.orchestra.run.smithi132.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-05-10T04:35:03.436 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/025 2023-05-10T04:35:03.436 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/025 2023-05-10T04:35:03.437 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:03.441 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:03.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:03.495 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-05-10T04:35:04.104 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:04.115 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:04.115 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:04.473 INFO:teuthology.orchestra.run.smithi132.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-05-10T04:35:04.481 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/026 2023-05-10T04:35:04.482 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/026 2023-05-10T04:35:04.482 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:04.487 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:04.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:04.506 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-05-10T04:35:04.886 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:04.897 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:04.897 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:05.176 INFO:teuthology.orchestra.run.smithi132.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:05.184 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/027 2023-05-10T04:35:05.184 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/027 2023-05-10T04:35:05.184 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:05.189 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:05.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:05.210 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-05-10T04:35:05.588 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:05.599 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:05.599 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:10.904 INFO:teuthology.orchestra.run.smithi132.stdout:generic/028 5s 2023-05-10T04:35:10.915 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/028 2023-05-10T04:35:10.916 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:10.921 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:10.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:10.939 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-05-10T04:35:11.323 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:11.334 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:11.334 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:11.605 INFO:teuthology.orchestra.run.smithi132.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:11.613 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/029 2023-05-10T04:35:11.614 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/029 2023-05-10T04:35:11.614 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:11.619 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:11.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:11.639 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-05-10T04:35:12.016 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:12.027 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:12.027 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:12.300 INFO:teuthology.orchestra.run.smithi132.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:12.309 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/030 2023-05-10T04:35:12.309 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/030 2023-05-10T04:35:12.309 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:12.314 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:12.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:12.334 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-05-10T04:35:12.713 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:12.725 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:12.725 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:13.004 INFO:teuthology.orchestra.run.smithi132.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:13.012 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/031 2023-05-10T04:35:13.013 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/031 2023-05-10T04:35:13.013 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:13.018 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:13.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:13.038 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-05-10T04:35:13.420 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:13.431 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:13.431 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:13.707 INFO:teuthology.orchestra.run.smithi132.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:13.715 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/032 2023-05-10T04:35:13.716 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/032 2023-05-10T04:35:13.716 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:13.721 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:13.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:13.740 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-05-10T04:35:14.122 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:14.133 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:14.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:14.409 INFO:teuthology.orchestra.run.smithi132.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:14.417 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/033 2023-05-10T04:35:14.418 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/033 2023-05-10T04:35:14.418 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:14.423 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:14.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:14.442 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-05-10T04:35:14.824 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:14.835 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:14.835 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:15.977 INFO:teuthology.orchestra.run.smithi132.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:15.986 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/034 2023-05-10T04:35:15.986 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/034 2023-05-10T04:35:15.986 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:15.992 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:16.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:16.014 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-05-10T04:35:16.018 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:35:16.062 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:35:16.396 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:16.407 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:16.407 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:16.800 INFO:teuthology.orchestra.run.smithi132.stdout:generic/035 0s 2023-05-10T04:35:16.813 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/035 2023-05-10T04:35:16.813 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:16.819 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:16.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:16.912 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-05-10T04:35:17.483 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:17.495 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:17.495 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:27.908 INFO:teuthology.orchestra.run.smithi132.stdout:generic/036 10s 2023-05-10T04:35:27.919 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/036 2023-05-10T04:35:27.919 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:27.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:27.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:27.963 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-05-10T04:35:28.593 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:28.604 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:28.604 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:28.884 INFO:teuthology.orchestra.run.smithi132.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:28.892 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/037 2023-05-10T04:35:28.893 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/037 2023-05-10T04:35:28.893 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:28.898 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:28.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:28.918 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-05-10T04:35:29.309 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:29.320 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:29.320 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:29.596 INFO:teuthology.orchestra.run.smithi132.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:29.604 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/038 2023-05-10T04:35:29.605 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/038 2023-05-10T04:35:29.605 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:29.610 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:29.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:29.630 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-05-10T04:35:30.011 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:30.022 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:30.022 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:30.321 INFO:teuthology.orchestra.run.smithi132.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:30.329 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/039 2023-05-10T04:35:30.330 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/039 2023-05-10T04:35:30.331 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:30.335 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:30.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:30.356 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-05-10T04:35:30.740 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:30.751 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:30.752 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:31.044 INFO:teuthology.orchestra.run.smithi132.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:31.053 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/040 2023-05-10T04:35:31.053 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/040 2023-05-10T04:35:31.053 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:31.058 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:31.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:31.078 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-05-10T04:35:31.457 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:31.469 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:31.469 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:31.768 INFO:teuthology.orchestra.run.smithi132.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:31.776 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/041 2023-05-10T04:35:31.776 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/041 2023-05-10T04:35:31.777 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:31.782 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:31.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:31.802 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-05-10T04:35:32.186 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:32.198 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:32.198 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:32.472 INFO:teuthology.orchestra.run.smithi132.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:32.480 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/042 2023-05-10T04:35:32.480 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/042 2023-05-10T04:35:32.481 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:32.485 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:32.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:32.506 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-05-10T04:35:32.891 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:32.903 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:32.903 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:33.175 INFO:teuthology.orchestra.run.smithi132.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:33.183 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/043 2023-05-10T04:35:33.183 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/043 2023-05-10T04:35:33.183 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:33.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:33.209 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-05-10T04:35:33.588 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:33.599 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:33.600 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:33.877 INFO:teuthology.orchestra.run.smithi132.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:33.887 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/044 2023-05-10T04:35:33.887 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/044 2023-05-10T04:35:33.887 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:33.890 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:33.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:33.911 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-05-10T04:35:34.297 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:34.308 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:34.309 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:34.585 INFO:teuthology.orchestra.run.smithi132.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/045 2023-05-10T04:35:34.593 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/045 2023-05-10T04:35:34.594 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:34.599 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:34.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:34.618 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-05-10T04:35:35.003 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:35.015 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:35.015 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:35.299 INFO:teuthology.orchestra.run.smithi132.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:35.307 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/046 2023-05-10T04:35:35.308 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/046 2023-05-10T04:35:35.308 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:35.313 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:35.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:35.332 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-05-10T04:35:35.712 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:35.723 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:35.723 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:35.996 INFO:teuthology.orchestra.run.smithi132.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:36.003 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/047 2023-05-10T04:35:36.004 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/047 2023-05-10T04:35:36.004 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:36.009 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:36.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:36.029 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-05-10T04:35:36.413 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:36.424 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:36.424 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:36.700 INFO:teuthology.orchestra.run.smithi132.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:36.709 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/048 2023-05-10T04:35:36.709 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/048 2023-05-10T04:35:36.709 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:36.714 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:36.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:36.734 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-05-10T04:35:37.112 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:37.123 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:37.123 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:37.401 INFO:teuthology.orchestra.run.smithi132.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:37.410 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/049 2023-05-10T04:35:37.410 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/049 2023-05-10T04:35:37.410 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:37.415 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:37.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:37.436 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-05-10T04:35:37.822 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:37.833 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:37.833 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:38.112 INFO:teuthology.orchestra.run.smithi132.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:38.120 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/050 2023-05-10T04:35:38.121 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/050 2023-05-10T04:35:38.121 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:38.126 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:38.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:38.145 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-05-10T04:35:38.530 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:38.541 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:38.821 INFO:teuthology.orchestra.run.smithi132.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:38.829 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/051 2023-05-10T04:35:38.829 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/051 2023-05-10T04:35:38.829 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:38.836 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:38.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:38.855 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-05-10T04:35:39.232 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:39.244 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:39.244 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:39.528 INFO:teuthology.orchestra.run.smithi132.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:39.536 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/052 2023-05-10T04:35:39.536 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/052 2023-05-10T04:35:39.536 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:39.541 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:39.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:39.562 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-05-10T04:35:39.950 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:39.962 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:39.963 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:40.246 INFO:teuthology.orchestra.run.smithi132.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:40.254 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/053 2023-05-10T04:35:40.255 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/053 2023-05-10T04:35:40.255 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:40.259 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:40.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:40.279 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-05-10T04:35:40.666 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:40.677 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:40.678 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:40.958 INFO:teuthology.orchestra.run.smithi132.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:40.967 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/054 2023-05-10T04:35:40.967 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/054 2023-05-10T04:35:40.968 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:40.972 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:40.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:40.992 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-05-10T04:35:41.374 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:41.385 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:41.385 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:41.664 INFO:teuthology.orchestra.run.smithi132.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:41.672 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/055 2023-05-10T04:35:41.673 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/055 2023-05-10T04:35:41.673 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:41.678 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:41.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:41.699 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-05-10T04:35:42.079 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:42.090 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:42.090 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:42.390 INFO:teuthology.orchestra.run.smithi132.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:42.398 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/056 2023-05-10T04:35:42.399 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/056 2023-05-10T04:35:42.399 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:42.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:42.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:42.424 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-05-10T04:35:42.808 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:42.820 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:42.820 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:43.125 INFO:teuthology.orchestra.run.smithi132.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:43.134 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/057 2023-05-10T04:35:43.134 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/057 2023-05-10T04:35:43.134 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:43.139 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:43.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:43.158 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-05-10T04:35:43.535 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:43.547 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:43.547 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:45.137 INFO:teuthology.orchestra.run.smithi132.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-10T04:35:45.146 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/058 2023-05-10T04:35:45.146 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/058 2023-05-10T04:35:45.146 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:45.151 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:45.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:45.179 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-05-10T04:35:45.833 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:45.844 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:45.845 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:46.150 INFO:teuthology.orchestra.run.smithi132.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:46.158 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/059 2023-05-10T04:35:46.158 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/059 2023-05-10T04:35:46.159 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:46.164 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:46.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:46.183 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-05-10T04:35:46.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:35:46.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:35:46.564 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:46.575 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:46.576 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:48.182 INFO:teuthology.orchestra.run.smithi132.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-10T04:35:48.191 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/060 2023-05-10T04:35:48.191 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/060 2023-05-10T04:35:48.191 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:48.196 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:48.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:48.287 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-05-10T04:35:48.854 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:48.865 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:48.865 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:50.490 INFO:teuthology.orchestra.run.smithi132.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-10T04:35:50.499 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/061 2023-05-10T04:35:50.499 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/061 2023-05-10T04:35:50.500 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:50.504 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:50.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:50.765 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-05-10T04:35:51.188 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:51.199 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:51.200 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:51.481 INFO:teuthology.orchestra.run.smithi132.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:51.489 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/062 2023-05-10T04:35:51.489 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/062 2023-05-10T04:35:51.489 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:51.494 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:51.512 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:51.513 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-05-10T04:35:51.892 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:51.903 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:51.904 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:53.523 INFO:teuthology.orchestra.run.smithi132.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-10T04:35:53.531 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/063 2023-05-10T04:35:53.531 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/063 2023-05-10T04:35:53.531 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:53.536 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:53.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:53.610 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-05-10T04:35:54.208 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:54.219 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:54.219 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:54.501 INFO:teuthology.orchestra.run.smithi132.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:54.510 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/064 2023-05-10T04:35:54.510 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/064 2023-05-10T04:35:54.510 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:54.514 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:54.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:54.534 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-05-10T04:35:54.919 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:54.930 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:54.931 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:55.227 INFO:teuthology.orchestra.run.smithi132.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:55.235 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/065 2023-05-10T04:35:55.235 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/065 2023-05-10T04:35:55.236 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:55.241 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:55.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:55.261 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-05-10T04:35:55.646 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:55.657 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:55.657 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:55.961 INFO:teuthology.orchestra.run.smithi132.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:55.970 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/066 2023-05-10T04:35:55.970 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/066 2023-05-10T04:35:55.970 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:55.975 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:55.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:55.995 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-05-10T04:35:56.381 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:56.392 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:56.393 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:56.705 INFO:teuthology.orchestra.run.smithi132.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:56.713 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/067 2023-05-10T04:35:56.714 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/067 2023-05-10T04:35:56.714 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:56.719 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:56.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:56.739 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-05-10T04:35:57.123 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:57.134 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:57.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:57.435 INFO:teuthology.orchestra.run.smithi132.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:57.444 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/068 2023-05-10T04:35:57.444 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/068 2023-05-10T04:35:57.444 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:57.449 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:57.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:57.469 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-05-10T04:35:57.857 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:57.868 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:57.869 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:58.145 INFO:teuthology.orchestra.run.smithi132.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:35:58.153 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/069 2023-05-10T04:35:58.153 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/069 2023-05-10T04:35:58.153 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:35:58.159 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:35:58.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:35:58.178 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-05-10T04:35:58.565 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:35:58.576 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:35:58.576 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:36:16.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:36:16.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:36:46.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:36:46.535 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:37:15.765 INFO:teuthology.orchestra.run.smithi132.stdout:generic/070 77s 2023-05-10T04:37:15.776 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/070 2023-05-10T04:37:15.776 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:37:15.782 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:37:15.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:37:15.905 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-05-10T04:37:16.461 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:37:16.472 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:37:16.473 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:37:16.856 INFO:teuthology.orchestra.run.smithi132.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:37:16.866 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/071 2023-05-10T04:37:16.867 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/071 2023-05-10T04:37:16.867 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:37:16.874 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:37:16.901 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:37:16.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:37:16.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:37:16.917 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-05-10T04:37:17.544 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:37:17.559 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:37:17.560 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:37:20.073 INFO:teuthology.orchestra.run.smithi132.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-05-10T04:37:20.083 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/072 2023-05-10T04:37:20.083 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/072 2023-05-10T04:37:20.083 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:37:20.090 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:37:20.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:37:20.119 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-05-10T04:37:20.690 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:37:20.709 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:37:20.710 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:37:21.140 INFO:teuthology.orchestra.run.smithi132.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T04:37:21.152 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/073 2023-05-10T04:37:21.153 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/073 2023-05-10T04:37:21.153 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T04:37:21.159 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:37:21.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T04:37:21.197 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-05-10T04:37:21.749 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T04:37:21.767 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T04:37:21.767 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T04:37:47.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:37:47.054 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:38:19.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:38:19.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:38:49.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:38:49.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:39:19.614 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:39:19.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:39:49.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:39:49.912 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:40:20.179 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:40:20.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:40:56.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:40:56.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:41:31.688 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:41:31.692 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:42:06.016 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:42:06.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:42:38.351 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:42:38.358 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:43:09.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:43:09.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:43:40.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:43:40.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:43:40.879 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T04:43:40.877+0000 7f2fa13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135953) UID: 0 2023-05-10T04:43:40.880 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T04:43:40.877+0000 7fb8d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135953) UID: 0 2023-05-10T04:43:40.880 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T04:43:40.877+0000 7f5ec51f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135953) UID: 0 2023-05-10T04:43:40.881 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T04:43:40.877+0000 7f1b3e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135953) UID: 0 2023-05-10T04:47:39.691 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:47:39.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:47:40.315 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T04:47:40.304+0000 7f1b3e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136203) UID: 0 2023-05-10T04:47:40.316 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T04:47:40.304+0000 7f2fa13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136203) UID: 0 2023-05-10T04:47:40.316 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T04:47:40.304+0000 7fb8d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136203) UID: 0 2023-05-10T04:47:40.317 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T04:47:40.304+0000 7f5ec51f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136203) UID: 0 2023-05-10T04:51:44.173 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:51:44.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T04:51:44.440 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T04:51:44.438+0000 7f2fa13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136274) UID: 0 2023-05-10T04:51:44.444 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-05-10T04:51:44.442+0000 7f73ebbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 226293) UID: 0 2023-05-10T04:51:44.444 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-05-10T04:51:44.442+0000 7f011b3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 226293) UID: 0 2023-05-10T04:51:44.444 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-05-10T04:51:44.442+0000 7fa5d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 226293) UID: 0 2023-05-10T04:51:44.445 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-05-10T04:51:44.443+0000 7f7d771f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 226293) UID: 0 2023-05-10T04:51:44.445 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T04:51:44.442+0000 7fb8d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136274) UID: 0 2023-05-10T04:51:44.446 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T04:51:44.443+0000 7f1b3e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136274) UID: 0 2023-05-10T04:51:44.446 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T04:51:44.443+0000 7f5ec51f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136274) UID: 0 2023-05-10T05:00:26.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:00:26.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:00:26.382 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-05-10T05:00:26.380+0000 7f73ebbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 226422) UID: 0 2023-05-10T05:00:26.382 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-05-10T05:00:26.380+0000 7f7d771f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 226422) UID: 0 2023-05-10T05:00:26.383 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-05-10T05:00:26.381+0000 7fa5d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 226422) UID: 0 2023-05-10T05:00:26.383 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-05-10T05:00:26.380+0000 7f011b3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 226422) UID: 0 2023-05-10T05:00:27.973 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T05:00:27.971+0000 7f2fa13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136431) UID: 0 2023-05-10T05:00:27.977 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T05:00:27.973+0000 7f1b3e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136431) UID: 0 2023-05-10T05:00:27.978 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T05:00:27.973+0000 7f5ec51f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136431) UID: 0 2023-05-10T05:00:27.978 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T05:00:27.973+0000 7fb8d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136431) UID: 0 2023-05-10T05:09:15.040 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:09:15.077 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:09:15.276 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T05:09:15.274+0000 7f2fa13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136602) UID: 0 2023-05-10T05:09:15.277 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T05:09:15.274+0000 7fb8d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136602) UID: 0 2023-05-10T05:09:15.277 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T05:09:15.274+0000 7f5ec51f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136602) UID: 0 2023-05-10T05:09:15.278 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T05:09:15.274+0000 7f1b3e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 136602) UID: 0 2023-05-10T05:10:28.255 INFO:teuthology.orchestra.run.smithi132.stdout:generic/074 1987s 2023-05-10T05:10:28.284 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/074 2023-05-10T05:10:28.285 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:10:28.290 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:10:28.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:10:28.334 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-05-10T05:10:29.193 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:10:29.204 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:10:29.204 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:16.657 INFO:teuthology.orchestra.run.smithi132.stdout:generic/075 47s 2023-05-10T05:11:16.670 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/075 2023-05-10T05:11:16.670 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:16.674 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:16.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:16.797 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-05-10T05:11:17.365 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:17.376 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:17.376 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:17.656 INFO:teuthology.orchestra.run.smithi132.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T05:11:17.664 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/076 2023-05-10T05:11:17.664 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/076 2023-05-10T05:11:17.664 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:17.669 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:17.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:17.689 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-05-10T05:11:18.075 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:18.086 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:18.087 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:18.924 INFO:teuthology.orchestra.run.smithi132.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T05:11:18.932 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/077 2023-05-10T05:11:18.932 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/077 2023-05-10T05:11:18.932 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:18.937 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:18.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:18.959 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-05-10T05:11:19.353 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:19.364 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:19.365 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:19.701 INFO:teuthology.orchestra.run.smithi132.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-05-10T05:11:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/078 2023-05-10T05:11:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/078 2023-05-10T05:11:19.710 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:19.715 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:19.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:19.773 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-05-10T05:11:20.408 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:20.419 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:20.420 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:20.754 INFO:teuthology.orchestra.run.smithi132.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-05-10T05:11:20.763 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/079 2023-05-10T05:11:20.763 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/079 2023-05-10T05:11:20.763 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:20.768 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:20.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:20.790 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-05-10T05:11:21.173 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:21.185 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:21.185 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:23.562 INFO:teuthology.orchestra.run.smithi132.stdout:generic/080 2s 2023-05-10T05:11:23.574 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/080 2023-05-10T05:11:23.574 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:23.580 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:23.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:23.606 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-05-10T05:11:23.991 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:24.002 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:24.002 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:24.300 INFO:teuthology.orchestra.run.smithi132.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T05:11:24.308 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/081 2023-05-10T05:11:24.308 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/081 2023-05-10T05:11:24.309 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:24.314 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:24.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:24.334 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-05-10T05:11:24.717 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:24.728 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:24.728 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:25.020 INFO:teuthology.orchestra.run.smithi132.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T05:11:25.132 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/082 2023-05-10T05:11:25.133 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/082 2023-05-10T05:11:25.133 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:25.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:25.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:25.134 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-05-10T05:11:25.519 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:25.530 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:25.530 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:25.803 INFO:teuthology.orchestra.run.smithi132.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T05:11:25.812 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/083 2023-05-10T05:11:25.812 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/083 2023-05-10T05:11:25.812 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:25.817 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:25.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:25.837 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-05-10T05:11:26.216 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:26.227 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:26.227 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:26.496 INFO:teuthology.orchestra.run.smithi132.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T05:11:26.505 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/084 2023-05-10T05:11:26.505 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/084 2023-05-10T05:11:26.505 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:26.510 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:26.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:26.530 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-05-10T05:11:26.920 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:26.931 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:26.932 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:27.274 INFO:teuthology.orchestra.run.smithi132.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-05-10T05:11:27.283 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/085 2023-05-10T05:11:27.283 INFO:teuthology.orchestra.run.smithi132.stdout:Not run: generic/085 2023-05-10T05:11:27.283 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:27.288 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:27.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:27.308 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-05-10T05:11:27.694 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:27.705 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:27.705 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:45.849 INFO:teuthology.orchestra.run.smithi132.stdout:generic/086 18s 2023-05-10T05:11:45.904 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/086 2023-05-10T05:11:45.904 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:46.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:46.021 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-05-10T05:11:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:47.327 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:47.948 INFO:teuthology.orchestra.run.smithi132.stdout:generic/087 0s 2023-05-10T05:11:47.959 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/087 2023-05-10T05:11:47.959 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:47.965 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:48.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:48.056 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-05-10T05:11:48.670 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:48.681 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:48.681 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:49.044 INFO:teuthology.orchestra.run.smithi132.stdout:generic/088 1s 2023-05-10T05:11:49.056 INFO:teuthology.orchestra.run.smithi132.stdout:Ran: generic/088 2023-05-10T05:11:49.056 INFO:teuthology.orchestra.run.smithi132.stdout:Passed all 1 tests 2023-05-10T05:11:49.061 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:11:49.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-05-10T05:11:49.122 DEBUG:teuthology.orchestra.run.smithi132:> (cd /tmp/tmp.I82EepBFpzxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-05-10T05:11:49.767 INFO:teuthology.orchestra.run.smithi132.stdout:FSTYP -- ceph-fuse 2023-05-10T05:11:49.779 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM -- Linux/x86_64 smithi132 6.3.0-gf1e69e4d3654 #1 SMP PREEMPT_DYNAMIC Tue May 9 01:45:18 UTC 2023 2023-05-10T05:11:49.779 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-05-10T05:12:26.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:12:26.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:12:57.038 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:12:57.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:13:27.160 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:13:27.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:13:57.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:13:57.313 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:14:27.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:14:27.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:14:57.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:14:57.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:15:27.824 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:15:27.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:15:58.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:15:58.018 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:16:28.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:16:28.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:16:58.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:16:58.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:17:28.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:17:28.426 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:17:58.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:17:58.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:18:28.732 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:18:28.736 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:18:58.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:18:58.859 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:19:29.017 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:19:29.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:19:59.139 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:19:59.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:20:29.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:20:29.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:20:59.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:20:59.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:21:29.615 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:21:29.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:21:59.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:21:59.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:22:29.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:22:29.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:23:00.130 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:23:00.135 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:23:30.249 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:23:30.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:24:00.372 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:24:00.377 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:24:30.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:24:30.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:25:00.624 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:25:00.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:25:30.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:25:30.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:26:00.934 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:26:00.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:26:31.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:26:31.050 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:27:01.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:27:01.232 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:27:31.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:27:31.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:28:01.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:28:01.442 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:28:31.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:28:31.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:29:01.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:29:01.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:29:31.845 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:29:31.850 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:30:01.967 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:30:01.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:30:32.164 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:30:32.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:31:02.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:31:02.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:31:32.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:31:32.473 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:32:02.599 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:32:02.604 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:32:32.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:32:32.787 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:33:02.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:33:02.962 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:33:33.078 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:33:33.083 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:34:03.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:34:03.197 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:34:33.380 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:34:33.385 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:35:03.578 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:35:03.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:35:33.734 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:35:33.739 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:36:03.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:36:03.894 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:36:34.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:36:34.014 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:37:04.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:37:04.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:37:34.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:37:34.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:38:04.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:38:04.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:38:34.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:38:34.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:39:04.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:39:04.821 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:39:35.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:39:35.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:40:05.153 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:40:05.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:40:35.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:40:35.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:41:05.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:41:05.517 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:41:35.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:41:35.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:42:05.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:42:05.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:42:35.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:42:35.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:43:06.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:43:06.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:43:36.298 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:43:36.303 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:44:06.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:44:06.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:44:36.540 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:44:36.545 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:45:06.748 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:45:06.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:45:36.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:45:36.976 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:46:07.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:46:07.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:46:37.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:46:37.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:47:07.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:47:07.541 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:47:37.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:47:37.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:48:07.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:48:07.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:48:38.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:48:38.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:49:08.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:49:08.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:49:38.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:49:38.369 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:50:08.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:50:08.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:50:38.609 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:50:38.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:51:08.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:51:08.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:51:38.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:51:38.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:52:09.062 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:52:09.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:52:39.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:52:39.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:53:09.447 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:53:09.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:53:39.553 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:53:39.558 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:54:09.667 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:54:09.672 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:54:39.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:54:39.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:55:10.196 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:55:10.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:55:40.306 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:55:40.311 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:56:10.495 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:56:10.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:56:40.610 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:56:40.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:57:10.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:57:10.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:57:40.935 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:57:40.940 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:58:11.107 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:58:11.112 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:58:41.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:58:41.234 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:59:11.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:59:11.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:59:41.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T05:59:41.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:00:11.918 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:00:11.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:00:42.096 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:00:42.100 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:01:12.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:01:12.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:01:42.424 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:01:42.428 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:02:12.598 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:02:12.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:02:42.787 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:02:42.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:03:12.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:03:12.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:03:43.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:03:43.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:04:13.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:04:13.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:04:43.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:04:43.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:05:13.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:05:13.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:05:43.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:05:43.793 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:06:13.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:06:13.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:06:44.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:06:44.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:07:14.189 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:07:14.194 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:07:44.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:07:44.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:08:14.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:08:14.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:08:44.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:08:44.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:09:14.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:09:14.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:09:44.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:09:44.923 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:10:15.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:10:15.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:10:45.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:10:45.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:11:15.480 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:11:15.485 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:11:45.580 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:11:45.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:12:15.759 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:12:15.764 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:12:45.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:12:45.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:13:16.096 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:13:16.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:13:46.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:13:46.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:14:16.363 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:14:16.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:14:46.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:14:46.606 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:15:16.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:15:16.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:15:46.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:15:46.840 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:16:17.000 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:16:17.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:16:47.225 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:16:47.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:17:17.357 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:17:17.361 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:17:47.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:17:47.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:18:17.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:18:17.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:18:47.926 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:18:47.931 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:19:18.089 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:19:18.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:19:48.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:19:48.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:20:18.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:20:18.580 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:20:48.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:20:48.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:21:18.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:21:18.833 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:21:49.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:21:49.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:22:19.181 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:22:19.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:22:49.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:22:49.364 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:23:19.482 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:23:19.487 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:23:49.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:23:49.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:24:19.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:24:19.771 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:24:49.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:24:49.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:25:20.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:25:20.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:25:50.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:25:50.269 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:26:20.453 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:26:20.465 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:26:50.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:26:50.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:27:20.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:27:20.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:27:50.895 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:27:50.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:28:21.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:28:21.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:28:51.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:28:51.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:29:21.410 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:29:21.415 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:29:51.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:29:51.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:30:21.720 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:30:21.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:30:51.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:30:51.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:31:21.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:31:22.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:31:52.160 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:31:52.165 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:32:22.399 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:32:22.404 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:32:52.579 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:32:52.584 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:33:22.687 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:33:22.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:33:52.884 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:33:52.889 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:34:23.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:34:23.107 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:34:53.223 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:34:53.227 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:35:23.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:35:23.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:35:53.525 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:35:53.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:36:23.707 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:36:23.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:36:53.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:36:53.915 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:37:24.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:37:24.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:37:54.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:37:54.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:38:24.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:38:24.394 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:38:54.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:38:54.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:39:24.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:39:24.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:39:54.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:39:54.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:40:25.029 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:40:25.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:40:55.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:40:55.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:41:25.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:41:25.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:41:55.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:41:55.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:42:25.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:42:25.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:42:55.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:42:55.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:43:25.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:43:25.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:43:56.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:43:56.144 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:44:26.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:44:26.341 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:44:56.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:44:56.447 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:45:26.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:45:26.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:45:56.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:45:56.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:46:27.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:46:27.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:46:57.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:46:57.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:47:27.326 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:47:27.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:47:57.524 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:47:57.529 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:48:27.636 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:48:27.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:48:57.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:48:57.755 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:49:27.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:49:27.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:49:58.069 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:49:58.074 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:50:28.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:50:28.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:50:58.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:50:58.417 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:51:28.578 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:51:28.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:51:58.682 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:51:58.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:52:29.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:52:29.058 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:52:59.295 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:52:59.321 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:53:29.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:53:29.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:53:59.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:53:59.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:54:29.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:54:29.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:55:00.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:55:00.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:55:30.186 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:55:30.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:56:00.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:56:00.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:56:30.571 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:56:30.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:57:00.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:57:00.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:57:30.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:57:30.821 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:58:00.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:58:00.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:58:31.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:58:31.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:59:01.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:59:01.272 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:59:31.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T06:59:31.671 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:00:01.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:00:01.779 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:00:31.911 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:00:31.916 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:01:02.093 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:01:02.098 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:01:32.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:01:32.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:02:02.420 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:02:02.425 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:02:32.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:02:32.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:03:02.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:03:02.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:03:33.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:03:33.058 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:04:03.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:04:03.222 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:04:33.346 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:04:33.350 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:05:03.535 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:05:03.539 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:05:33.680 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:05:33.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:06:03.842 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:06:03.847 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:06:34.015 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:06:34.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:07:04.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:07:04.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:07:34.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:07:34.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:08:04.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:08:04.570 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:08:34.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:08:34.685 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:09:04.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:09:04.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:09:34.974 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:09:34.978 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:10:05.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:10:05.184 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:10:35.360 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:10:35.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:11:05.491 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:11:05.495 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:11:35.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:11:35.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:12:05.894 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:12:05.900 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:12:36.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:12:36.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:13:06.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:13:06.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:13:36.394 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:13:36.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:14:06.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:14:06.577 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:14:36.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:14:36.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:15:06.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:15:06.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:15:37.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:15:37.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:16:07.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:16:07.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:16:37.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:16:37.643 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:17:07.752 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:17:07.756 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:17:37.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:17:37.930 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:18:08.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:18:08.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:18:38.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:18:38.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:19:08.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:19:08.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:19:38.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:19:38.653 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:20:08.806 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:20:08.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:20:39.019 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:20:39.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:21:09.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:21:09.143 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:21:39.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:21:39.326 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:22:09.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:22:09.441 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:22:39.618 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:22:39.623 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:23:09.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:23:09.804 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:23:39.901 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:23:39.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:24:10.098 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:24:10.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:24:40.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:24:40.207 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:25:10.400 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:25:10.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:25:40.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:25:40.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:26:10.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:26:10.660 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:26:40.765 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:26:40.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:27:11.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:27:11.084 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:27:41.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:27:41.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:28:11.379 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:28:11.384 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:28:41.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:28:41.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:29:11.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:29:11.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:29:41.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:29:41.852 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:30:12.018 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:30:12.023 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:30:42.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:30:42.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:31:12.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:31:12.522 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:31:42.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:31:42.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:32:12.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:32:12.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:32:43.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:32:43.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:33:13.366 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:33:13.371 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:33:43.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:33:43.477 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:34:13.577 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:34:13.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:34:43.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:34:43.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:35:13.882 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:35:13.887 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:35:44.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:35:44.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:36:14.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:36:14.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:36:44.291 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:36:44.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:37:14.455 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:37:14.460 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:37:44.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:37:44.615 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:38:14.848 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:38:14.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:38:44.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:38:44.962 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:39:15.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:39:15.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:39:45.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:39:45.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:40:15.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:40:15.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:40:45.664 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:40:45.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:41:15.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:41:15.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:41:45.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:41:45.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:42:16.134 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:42:16.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:42:46.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:42:46.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:43:16.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:43:16.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:43:46.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:43:46.786 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:44:17.123 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:44:17.128 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:44:47.295 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:44:47.300 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:45:17.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:45:17.406 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:45:47.607 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:45:47.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:46:17.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:46:17.727 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:46:47.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:46:47.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:47:17.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:47:17.990 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:47:48.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:47:48.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:48:18.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:48:18.400 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:48:48.574 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:48:48.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:49:18.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:49:18.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:49:49.003 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:49:49.008 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:50:19.200 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:50:19.206 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:50:49.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:50:49.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:51:19.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:51:19.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:51:49.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:51:49.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:52:19.803 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:52:19.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:52:49.974 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:52:49.978 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:53:20.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:53:20.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:53:50.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:53:50.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:54:20.562 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:54:20.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:54:50.736 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:54:50.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:55:20.924 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:55:20.929 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:55:51.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:55:51.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:56:21.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:56:21.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:56:51.374 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:56:51.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:57:21.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:57:21.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:57:51.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:57:51.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:58:21.823 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:58:21.828 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:58:51.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:58:51.993 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:59:22.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:59:22.132 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:59:52.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T07:59:52.421 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:00:22.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:00:22.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:00:52.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:00:52.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:01:23.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:01:23.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:01:53.194 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:01:53.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:02:23.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:02:23.389 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:02:53.533 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:02:53.538 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:03:23.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:03:23.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:03:53.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:03:53.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:04:24.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:04:24.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:04:54.135 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:04:54.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:05:24.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:05:24.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:05:54.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:05:54.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:06:24.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:06:24.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:06:54.830 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:06:54.834 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:07:24.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:07:24.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:07:55.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:07:55.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:08:25.220 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:08:25.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:08:55.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:08:55.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:09:25.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:09:25.511 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:09:55.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:09:55.706 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:10:25.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:10:25.839 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:10:56.014 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:10:56.022 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:11:26.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:11:26.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:11:56.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:11:56.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:12:26.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:12:26.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:12:56.883 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:12:56.888 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:13:27.014 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:13:27.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:13:57.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:13:57.160 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:14:27.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:14:27.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:14:57.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:14:57.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:15:27.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:15:27.726 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:15:57.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:15:57.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:16:28.133 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:16:28.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:16:58.304 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:16:58.308 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:17:28.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:17:28.492 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:17:58.607 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:17:58.612 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:18:28.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:18:28.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:18:58.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:18:58.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:19:29.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:19:29.076 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:19:59.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:19:59.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:20:29.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:20:29.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:20:59.540 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:20:59.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:21:29.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:21:29.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:21:59.853 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:21:59.857 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:22:30.045 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:22:30.050 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:23:00.223 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:23:00.228 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:23:30.347 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:23:30.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:24:00.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:24:00.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:24:30.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:24:30.621 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:25:00.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:25:00.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:25:30.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:25:30.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:26:01.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:26:01.161 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:26:31.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:26:31.307 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:27:01.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:27:01.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:27:31.546 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:27:31.551 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:28:01.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:28:01.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:28:31.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:28:31.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:29:01.998 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:29:02.004 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:29:32.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:29:32.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:30:02.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:30:02.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:30:32.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:30:32.570 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:31:02.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:31:02.743 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:31:32.934 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:31:32.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:32:03.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:32:03.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:32:33.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:32:33.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:33:03.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:33:03.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:33:33.537 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:33:33.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:34:03.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:34:03.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:34:33.811 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:34:33.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:35:03.989 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:35:03.993 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:35:34.154 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:35:34.159 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:36:04.351 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:36:04.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:36:34.525 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:36:34.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:37:04.713 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:37:04.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:37:34.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:37:34.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:38:04.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:38:05.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:38:35.274 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:38:35.279 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:39:05.464 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:39:05.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:39:35.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:39:35.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:40:05.833 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:40:05.838 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:40:35.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:40:35.952 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:41:06.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:41:06.116 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:41:36.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:41:36.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:42:06.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:42:06.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:42:36.610 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:42:36.616 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:43:06.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:43:06.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:43:36.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:43:36.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:44:07.031 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:44:07.036 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:44:37.131 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:44:37.136 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:45:07.297 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:45:07.302 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:45:37.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:45:37.398 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:46:07.608 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:46:07.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:46:37.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:46:37.837 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:47:07.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:47:08.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:47:38.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:47:38.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:48:08.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:48:08.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:48:38.478 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:48:38.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:49:08.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:49:08.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:49:38.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:49:38.711 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:50:08.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:50:08.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:50:39.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:50:39.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:51:09.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:51:09.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:51:39.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:51:39.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:52:09.689 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:52:09.694 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:52:39.789 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:52:39.794 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:53:09.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:53:09.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:53:40.084 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:53:40.089 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:54:10.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:54:10.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:54:40.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:54:40.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:55:10.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:55:10.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:55:40.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:55:40.560 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:56:10.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:56:10.691 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:56:40.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:56:40.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:57:11.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:57:11.059 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:57:41.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:57:41.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:58:11.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:58:11.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:58:41.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:58:41.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:59:11.741 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:59:11.746 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:59:42.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T08:59:42.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:00:12.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:00:12.258 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:00:42.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:00:42.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:01:12.537 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:01:12.542 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:01:42.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:01:42.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:02:12.866 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:02:12.871 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:02:43.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:02:43.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:03:13.343 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:03:13.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:03:43.447 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:03:43.452 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:04:13.604 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:04:13.609 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:04:43.849 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:04:43.855 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:05:14.038 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:05:14.043 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:05:44.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:05:44.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:06:14.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:06:14.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:06:44.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:06:44.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:07:14.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:07:14.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:07:44.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:07:44.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:08:15.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:08:15.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:08:45.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:08:45.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:09:15.573 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:09:15.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:09:45.713 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:09:45.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:10:15.850 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:10:15.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:10:45.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:10:45.958 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:11:16.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:11:16.106 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:11:46.221 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:11:46.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:12:16.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:12:16.433 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:12:46.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:12:46.579 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:13:16.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:13:16.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:13:46.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:13:46.984 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:14:17.152 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:14:17.157 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:14:47.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:14:47.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:15:17.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:15:17.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:15:47.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:15:47.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:16:17.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:16:17.777 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:16:47.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:16:47.962 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:17:18.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:17:18.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:17:48.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:17:48.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:18:18.859 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:18:18.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:18:48.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:18:48.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:19:19.164 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:19:19.168 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:19:49.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:19:49.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:20:19.407 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:20:19.412 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:20:19.608 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-05-10T09:20:19.604+0000 7f011b3f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 247304) UID: 0 2023-05-10T09:20:19.608 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-05-10T09:20:19.604+0000 7fa5d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 247304) UID: 0 2023-05-10T09:20:19.609 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-05-10T09:20:19.604+0000 7f73ebbf9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 247304) UID: 0 2023-05-10T09:20:19.609 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-05-10T09:20:19.605+0000 7f7d771f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 247304) UID: 0 2023-05-10T09:22:53.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:22:53.349 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:23:23.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:23:23.483 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:23:53.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:23:53.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:24:23.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:24:23.836 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:24:53.928 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:24:53.933 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:25:24.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:25:24.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:25:54.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:25:54.244 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:26:24.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:26:24.448 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:26:54.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:26:54.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:27:24.796 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:27:24.801 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:27:54.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:27:54.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:28:25.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:28:25.096 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:28:55.296 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:28:55.301 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:29:25.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:29:25.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:29:55.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:29:55.599 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:30:25.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:30:25.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:30:55.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:30:55.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:31:26.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:31:26.111 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:31:56.527 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:31:56.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:32:26.725 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:32:26.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:32:56.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:32:56.891 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:33:27.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:33:27.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:33:57.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:33:57.185 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:34:27.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:34:27.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:34:57.482 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:34:57.487 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:35:27.612 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:35:27.617 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:35:57.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:35:57.781 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:36:27.897 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:36:27.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:36:58.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:36:58.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:37:28.220 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:37:28.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:37:58.388 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:37:58.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:38:28.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:38:28.532 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:38:58.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:38:58.720 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:39:28.896 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:39:28.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:39:59.002 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:39:59.007 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:40:29.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:40:29.180 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:40:59.348 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:40:59.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:41:29.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:41:29.479 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:41:59.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:41:59.665 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:42:29.777 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:42:29.782 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:42:59.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:42:59.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:43:30.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:43:30.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:44:00.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:44:00.473 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:44:30.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:44:30.595 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:45:00.738 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:45:00.743 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:45:30.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:45:30.867 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:46:01.050 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:46:01.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:46:31.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:46:31.220 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:47:01.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:47:01.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:47:31.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:47:31.510 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:48:01.707 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:48:01.712 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:48:31.928 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:48:31.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:49:02.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:49:02.049 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:49:32.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:49:32.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:50:02.624 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:50:02.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:50:32.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:50:32.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:51:02.934 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:51:02.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:51:33.133 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:51:33.138 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:52:03.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:52:03.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:52:33.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:52:33.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:53:03.690 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:53:03.695 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:53:33.811 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:53:33.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:54:03.987 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:54:03.992 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:54:34.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:54:34.226 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:55:04.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:55:04.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:55:34.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:55:34.611 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:56:04.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:56:04.741 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:56:34.934 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:56:34.939 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:57:05.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:57:05.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:57:35.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:57:35.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:58:05.461 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:58:05.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:58:35.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:58:35.589 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:59:05.691 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:59:05.696 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:59:35.814 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T09:59:35.819 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:00:05.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:00:05.949 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:00:36.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:00:36.072 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:01:06.349 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:01:06.354 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:01:36.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:01:36.517 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:02:06.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:02:06.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:02:36.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:02:36.913 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:03:07.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:03:07.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:03:37.332 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:03:37.337 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:04:07.445 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:04:07.449 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:04:37.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:04:37.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:05:07.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:05:07.751 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:05:37.901 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:05:37.905 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:06:08.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:06:08.053 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:06:38.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:06:38.241 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:07:08.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:07:08.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:07:38.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:07:38.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:08:08.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:08:08.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:08:38.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:08:38.821 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:09:08.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:09:09.002 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:09:39.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:09:39.123 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:10:09.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:10:09.295 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:10:39.495 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:10:39.500 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:11:09.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:11:09.639 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:11:39.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:11:39.872 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:12:10.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:12:10.044 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:12:40.191 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:12:40.196 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:13:10.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:13:10.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:13:40.557 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:13:40.562 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:14:10.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:14:10.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:14:41.104 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:14:41.109 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:15:11.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:15:11.231 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:15:41.374 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:15:41.379 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:16:11.596 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:16:11.601 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:16:41.784 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:16:41.788 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:17:11.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:17:12.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:17:42.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:17:42.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:18:12.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:18:12.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:18:42.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:18:42.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:19:12.578 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:19:12.583 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:19:42.733 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:19:42.738 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:20:12.848 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:20:12.853 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:20:42.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:20:42.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:21:13.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:21:13.170 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:21:43.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:21:43.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:22:13.518 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:22:13.524 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:22:43.682 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:22:43.687 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:23:14.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:23:14.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:23:44.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:23:44.154 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:24:14.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:24:14.335 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:24:44.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:24:44.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:25:14.633 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:25:14.637 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:25:44.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:25:44.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:26:14.918 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:26:14.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:26:45.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:26:45.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:27:15.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:27:15.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:27:45.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:27:45.498 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:28:15.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:28:15.673 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:28:45.790 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:28:45.795 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:29:15.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:29:15.980 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:29:46.139 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:29:46.144 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:30:16.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:30:16.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:30:46.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:30:46.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:31:16.619 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:31:16.624 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:31:46.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:31:46.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:32:17.006 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:32:17.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:32:47.111 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:32:47.115 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:33:17.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:33:17.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:33:47.388 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:33:47.393 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:34:17.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:34:17.531 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:34:47.853 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:34:47.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:35:18.050 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:35:18.055 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:35:48.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:35:48.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:36:18.378 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:36:18.383 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:36:48.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:36:48.539 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:37:18.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:37:18.719 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:37:48.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:37:48.893 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:38:19.000 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:38:19.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:38:49.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:38:49.221 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:39:19.339 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:39:19.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:39:49.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:39:49.526 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:40:19.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:40:19.684 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:40:50.066 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:40:50.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:41:20.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:41:20.251 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:41:50.360 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:41:50.365 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:42:20.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:42:20.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:42:50.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:42:50.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:43:21.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:43:21.040 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:43:51.198 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:43:51.202 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:44:21.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:44:21.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:44:51.654 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:44:51.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:45:21.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:45:21.785 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:45:51.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:45:51.953 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:46:22.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:46:22.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:46:52.229 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:46:52.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:47:22.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:47:22.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:47:52.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:47:52.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:48:22.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:48:22.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:48:52.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:48:52.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:49:22.933 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:49:22.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:49:53.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:49:53.145 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:50:23.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:50:23.342 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:50:53.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:50:53.457 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:51:23.637 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:51:23.641 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:51:53.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:51:53.752 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:52:23.945 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:52:23.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:52:54.117 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:52:54.122 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:53:24.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:53:24.313 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:53:54.563 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:53:54.567 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:54:24.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:54:24.758 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:54:54.865 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:54:54.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:55:25.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:55:25.037 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:55:55.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:55:55.152 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:56:25.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:56:25.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:56:55.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:56:55.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:57:25.748 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:57:25.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:57:55.896 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:57:55.901 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:58:26.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:58:26.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:58:56.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:58:56.210 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:59:26.469 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:59:26.474 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:59:56.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T10:59:56.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:00:26.846 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:00:26.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:00:56.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:00:56.955 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:01:27.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:01:27.094 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:01:57.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:01:57.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:02:27.400 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:02:27.405 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:02:57.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:02:57.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:03:27.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:03:27.675 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:03:57.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:03:57.823 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:04:27.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:04:27.926 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:04:58.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:04:58.102 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:05:28.196 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:05:28.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:05:58.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:05:58.339 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:06:28.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:06:28.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:06:58.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:06:58.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:07:28.893 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:07:28.898 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:07:59.065 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:07:59.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:08:29.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:08:29.211 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:08:59.345 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:08:59.350 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:09:29.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:09:29.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:09:59.865 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:09:59.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:10:29.963 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:10:29.967 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:11:00.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:11:00.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:11:30.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:11:30.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:12:00.406 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:12:00.410 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:12:30.528 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:12:30.533 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:13:00.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:13:00.723 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:13:30.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:13:30.880 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:14:01.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:14:01.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:14:31.220 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:14:31.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:15:01.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:15:01.347 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:15:31.448 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:15:31.453 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:16:01.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:16:01.575 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:16:31.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:16:31.722 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:17:01.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:17:01.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:17:32.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:17:32.292 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:18:02.410 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:18:02.414 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:18:32.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:18:32.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:19:02.705 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:19:02.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:19:32.819 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:19:32.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:20:02.936 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:20:02.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:20:33.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:20:33.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:21:03.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:21:03.208 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:21:33.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:21:33.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:22:03.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:22:03.486 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:22:33.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:22:33.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:23:03.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:23:03.814 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:23:33.915 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:23:33.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:23:34.027 INFO:tasks.ceph.osd.5.smithi154.stderr:2023-05-10T11:23:34.024+0000 7f2fa13f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155930) UID: 0 2023-05-10T11:23:34.027 INFO:tasks.ceph.osd.6.smithi154.stderr:2023-05-10T11:23:34.024+0000 7fb8d7ff9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155930) UID: 0 2023-05-10T11:23:34.028 INFO:tasks.ceph.osd.7.smithi154.stderr:2023-05-10T11:23:34.024+0000 7f5ec51f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155930) UID: 0 2023-05-10T11:23:34.028 INFO:tasks.ceph.osd.4.smithi154.stderr:2023-05-10T11:23:34.024+0000 7f1b3e1f9700 -1 received signal: Hangup from killall ceph-osd -1 (PID: 155930) UID: 0 2023-05-10T11:26:06.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:26:06.548 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:26:36.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:26:36.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:27:06.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:27:06.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:27:37.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:27:37.241 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:28:07.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:28:07.340 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:28:37.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:28:37.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:29:07.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:29:07.594 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:29:37.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:29:37.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:30:07.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:30:07.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:30:38.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:30:38.099 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:31:08.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:31:08.229 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:31:38.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:31:38.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:32:08.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:32:08.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:32:38.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:32:38.733 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:33:08.902 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:33:08.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:33:39.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:33:39.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:34:09.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:34:09.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:34:39.553 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:34:39.557 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:35:09.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:35:09.688 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:35:39.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:35:39.866 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:36:10.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:36:10.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:36:40.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:36:40.330 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:37:10.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:37:10.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:37:40.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:37:40.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:38:10.694 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:38:10.699 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:38:40.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:38:40.829 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:39:10.955 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:39:10.960 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:39:41.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:39:41.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:40:11.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:40:11.169 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:40:41.326 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:40:41.332 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:41:11.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:41:11.519 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:41:41.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:41:41.634 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:42:11.784 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:42:11.789 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:42:41.991 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:42:41.996 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:43:12.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:43:12.101 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:43:42.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:43:42.215 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:44:12.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:44:12.329 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:44:42.524 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:44:42.528 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:45:12.624 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:45:12.629 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:45:42.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:45:42.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:46:12.933 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:46:12.938 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:46:43.281 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:46:43.286 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:47:13.404 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:47:13.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:47:43.584 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:47:43.588 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:48:13.765 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:48:13.769 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:48:43.877 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:48:43.882 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:49:14.067 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:49:14.073 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:49:44.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:49:44.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:50:14.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:50:14.475 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:50:44.583 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:50:44.587 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:51:14.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:51:14.710 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:51:44.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:51:44.892 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:52:15.052 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:52:15.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:52:45.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:52:45.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:53:15.263 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:53:15.268 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:53:45.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:53:45.367 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:54:15.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:54:15.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:54:45.640 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:54:45.645 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:55:15.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:55:15.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:55:45.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:55:45.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:56:16.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:56:16.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:56:46.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:56:46.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:57:16.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:57:16.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:57:46.768 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:57:46.774 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:58:17.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:58:17.119 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:58:47.213 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:58:47.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:59:17.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:59:17.356 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:59:47.485 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T11:59:47.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:00:17.609 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:00:17.614 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:00:47.723 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:00:47.728 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:01:17.905 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:01:17.909 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:01:48.019 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:01:48.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:02:18.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:02:18.190 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:02:48.458 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:02:48.462 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:03:18.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:03:18.563 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:03:48.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:03:48.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:04:18.937 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:04:18.941 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:04:49.134 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:04:49.139 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:05:19.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:05:19.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:05:49.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:05:49.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:06:19.681 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:06:19.686 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:06:49.869 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:06:49.873 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:07:20.066 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:07:20.070 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:07:50.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:07:50.259 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:08:20.376 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:08:20.380 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:08:50.480 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:08:50.485 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:09:20.678 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:09:20.683 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:09:50.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:09:50.865 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:10:21.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:10:21.163 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:10:51.348 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:10:51.353 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:11:21.447 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:11:21.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:11:51.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:11:51.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:12:21.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:12:21.845 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:12:51.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:12:52.001 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:13:22.161 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:13:22.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:13:52.293 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:13:52.298 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:14:22.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:14:22.424 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:14:52.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:14:52.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:15:22.753 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:15:22.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:15:52.858 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:15:52.864 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:16:22.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:16:22.986 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:16:53.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:16:53.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:17:23.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:17:23.230 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:17:53.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:17:53.554 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:18:23.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:18:23.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:18:53.761 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:18:53.766 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:19:23.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:19:23.965 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:19:54.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:19:54.087 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:20:24.256 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:20:24.261 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:20:54.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:20:54.399 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:21:24.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:21:24.512 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:21:54.622 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:21:54.627 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:22:24.802 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:22:24.807 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:22:54.974 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:22:54.983 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:23:25.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:23:25.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:23:55.318 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:23:55.322 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:24:25.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:24:25.488 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:24:55.644 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:24:55.648 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:25:25.756 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:25:25.761 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:25:55.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:25:55.950 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:26:26.126 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:26:26.130 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:26:56.231 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:26:56.236 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:27:26.438 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:27:26.443 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:27:56.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:27:56.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:28:26.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:28:26.721 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:28:56.902 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:28:56.906 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:29:27.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:29:27.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:29:57.271 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:29:57.276 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:30:27.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:30:27.461 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:30:57.578 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:30:57.582 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:31:27.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:31:27.697 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:31:57.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:31:57.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:32:28.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:32:28.093 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:32:58.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:32:58.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:33:28.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:33:28.438 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:33:58.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:33:58.537 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:34:28.654 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:34:28.659 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:34:58.810 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:34:58.815 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:35:28.999 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:35:29.005 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:35:59.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:35:59.245 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:36:29.358 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:36:29.363 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:36:59.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:36:59.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:37:29.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:37:29.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:37:59.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:37:59.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:38:29.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:38:29.964 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:39:00.133 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:39:00.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:39:30.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:39:30.343 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:40:00.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:40:00.490 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:40:30.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:40:30.679 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:41:00.793 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:41:00.797 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:41:30.898 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:41:30.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:42:01.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:42:01.012 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:42:31.124 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:42:31.129 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:43:01.229 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:43:01.233 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:43:31.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:43:31.338 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:44:01.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:44:01.436 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:44:31.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:44:31.556 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:45:01.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:45:01.657 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:45:31.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:45:31.767 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:46:01.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:46:01.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:46:31.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:46:31.994 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:47:02.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:47:02.117 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:47:32.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:47:32.213 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:48:02.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:48:02.336 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:48:32.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:48:32.440 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:49:02.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:49:02.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:49:32.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:49:32.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:50:02.766 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:50:02.770 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:50:32.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:50:32.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:51:02.993 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:51:02.998 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:51:33.090 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:51:33.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:52:03.196 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:52:03.201 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:52:33.302 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:52:33.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:53:03.411 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:53:03.416 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:53:33.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:53:33.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:54:03.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:54:03.651 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:54:33.768 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:54:33.772 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:55:03.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:55:03.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:55:33.978 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:55:33.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:56:04.082 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:56:04.086 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:56:34.187 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:56:34.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:57:04.309 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:57:04.314 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:57:34.413 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:57:34.418 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:58:04.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:58:04.515 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:58:34.607 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:58:34.613 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:59:04.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:59:04.732 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:59:34.916 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T12:59:34.921 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:00:05.020 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:00:05.025 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:00:35.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:00:35.205 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:01:05.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:01:05.327 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:01:35.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:01:35.499 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:02:05.615 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:02:05.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:02:35.720 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:02:35.725 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:03:05.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:03:05.827 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:03:35.931 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:03:35.936 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:04:06.037 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:04:06.042 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:04:36.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:04:36.199 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:05:06.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:05:06.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:05:36.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:05:36.423 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:06:06.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:06:06.536 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:06:36.656 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:06:36.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:07:06.753 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:07:06.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:07:36.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:07:36.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:08:06.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:08:06.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:08:37.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:08:37.078 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:09:07.187 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:09:07.192 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:09:37.326 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:09:37.331 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:10:07.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:10:07.437 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:10:37.546 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:10:37.552 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:11:07.647 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:11:07.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:11:37.752 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:11:37.757 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:12:07.866 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:12:07.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:12:37.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:12:37.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:13:08.092 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:13:08.097 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:13:38.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:13:38.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:14:08.320 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:14:08.325 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:14:38.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:14:38.472 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:15:08.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:15:08.576 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:15:38.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:15:38.681 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:16:08.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:16:08.805 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:16:38.903 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:16:38.908 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:17:09.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:17:09.015 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:17:39.131 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:17:39.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:18:09.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:18:09.241 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:18:39.343 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:18:39.351 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:19:09.447 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:19:09.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:19:39.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:19:39.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:20:09.685 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:20:09.690 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:20:39.804 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:20:39.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:21:09.909 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:21:09.914 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:21:40.019 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:21:40.024 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:22:10.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:22:10.124 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:22:40.315 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:22:40.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:23:10.496 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:23:10.501 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:23:40.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:23:40.605 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:24:10.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:24:10.778 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:24:40.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:24:40.959 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:25:11.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:25:11.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:25:41.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:25:41.246 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:26:11.346 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:26:11.351 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:26:41.522 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:26:41.527 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:27:11.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:27:11.682 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:27:41.865 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:27:41.870 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:28:12.029 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:28:12.033 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:28:42.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:28:42.171 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:29:12.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:29:12.344 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:29:42.459 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:29:42.464 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:30:12.740 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:30:12.746 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:30:42.920 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:30:42.925 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:31:13.029 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:31:13.034 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:31:43.220 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:31:43.225 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:32:13.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:32:13.422 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:32:43.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:32:43.593 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:33:13.770 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:33:13.775 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:33:43.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:33:43.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:34:14.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:34:14.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:34:44.293 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:34:44.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:35:14.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:35:14.494 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:35:44.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:35:44.640 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:36:14.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:36:14.846 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:36:45.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:36:45.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:37:15.136 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:37:15.140 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:37:45.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:37:45.271 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:38:15.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:38:15.468 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:38:45.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:38:45.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:39:15.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:39:15.677 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:39:45.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:39:45.802 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:40:15.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:40:15.922 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:40:46.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:40:46.057 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:41:16.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:41:16.162 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:41:46.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:41:46.270 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:42:16.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:42:16.375 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:42:46.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:42:46.480 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:43:16.583 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:43:16.588 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:43:46.696 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:43:46.701 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:44:16.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:44:16.806 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:44:46.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:44:46.975 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:45:17.074 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:45:17.079 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:45:47.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:45:47.183 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:46:17.292 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:46:17.296 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:46:47.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:46:47.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:47:17.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:47:17.530 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:47:47.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:47:47.632 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:48:17.725 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:48:17.730 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:48:47.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:48:47.911 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:49:18.014 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:49:18.019 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:49:48.153 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:49:48.158 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:50:18.257 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:50:18.262 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:50:48.363 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:50:48.372 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:51:18.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:51:18.473 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:51:48.597 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:51:48.602 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:52:18.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:52:18.707 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:52:48.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:52:48.811 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:53:19.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:53:19.009 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:53:49.133 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:53:49.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:54:19.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:54:19.310 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:54:49.518 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:54:49.525 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:55:19.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:55:19.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:55:49.804 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:55:49.809 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:56:19.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:56:19.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:56:50.113 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:56:50.118 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:57:20.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:57:20.224 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:57:50.358 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:57:50.363 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:58:20.546 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:58:20.551 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:58:50.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:58:50.655 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:59:20.853 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:59:20.858 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:59:50.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T13:59:50.982 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:00:21.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:00:21.187 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:00:51.354 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:00:51.359 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:01:21.535 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:01:21.589 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:01:51.741 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:01:51.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:02:21.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:02:21.918 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:02:52.012 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:02:52.017 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:03:22.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:03:22.126 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:03:52.235 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:03:52.240 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:04:22.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:04:22.345 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:04:52.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:04:52.491 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:05:22.658 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:05:22.663 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:05:52.864 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:05:52.869 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:06:22.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:06:22.966 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:06:53.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:06:53.112 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:07:23.313 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:07:23.317 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:07:53.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:07:53.506 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:08:23.614 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:08:23.619 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:08:53.811 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:08:53.816 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:09:24.016 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:09:24.021 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:09:54.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:09:54.151 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:10:24.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:10:24.264 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:10:54.365 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:10:54.370 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:11:24.461 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:11:24.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:11:54.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:11:54.571 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:12:24.688 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:12:24.693 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:12:54.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:12:54.800 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:13:24.915 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:13:24.920 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:13:55.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:13:55.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:14:25.126 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:14:25.131 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:14:55.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:14:55.248 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:15:25.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:15:25.352 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:15:55.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:15:55.454 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:16:25.554 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:16:25.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:16:55.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:16:55.664 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:17:25.849 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:17:25.854 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:17:56.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:17:56.027 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:18:26.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:18:26.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:18:56.560 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:18:56.565 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:19:26.673 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:19:26.678 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:19:56.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:19:56.825 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:20:26.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:20:26.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:20:57.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:20:57.121 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:21:27.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:21:27.235 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:21:57.427 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:21:57.432 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:22:27.626 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:22:27.630 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:22:57.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:22:57.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:23:27.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:23:27.979 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:23:58.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:23:58.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:24:28.250 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:24:28.254 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:24:58.464 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:24:58.469 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:25:28.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:25:28.573 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:25:58.740 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:25:58.744 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:26:28.920 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:26:28.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:26:59.058 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:26:59.063 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:27:29.258 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:27:29.263 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:27:59.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:27:59.444 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:28:29.573 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:28:29.578 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:28:59.787 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:28:59.792 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:29:29.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:29:29.987 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:30:00.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:30:00.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:30:30.319 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:30:30.324 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:31:00.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:31:00.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:31:30.621 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:31:30.625 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:32:00.743 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:32:00.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:32:30.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:32:30.924 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:33:01.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:33:01.029 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:33:31.123 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:33:31.127 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:34:01.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:34:01.274 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:34:31.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:34:31.439 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:35:01.649 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:35:01.654 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:35:31.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:35:31.749 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:36:01.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:36:01.896 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:36:32.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:36:32.069 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:37:02.260 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:37:02.265 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:37:32.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:37:32.387 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:38:02.554 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:38:02.559 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:38:32.685 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:38:32.689 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:39:02.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:39:02.877 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:39:33.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:39:33.058 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:40:03.174 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:40:03.179 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:40:33.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:40:33.360 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:41:03.477 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:41:03.481 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:41:33.615 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:41:33.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:42:03.793 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:42:03.798 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:42:33.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:42:33.912 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:43:04.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:43:04.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:43:34.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:43:34.188 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:44:04.304 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:44:04.309 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:44:34.509 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:44:34.516 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:45:04.698 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:45:04.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:45:34.878 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:45:34.883 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:46:04.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:46:04.989 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:46:35.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:46:35.175 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:47:05.292 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:47:05.297 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:47:35.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:47:35.420 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:48:05.517 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:48:05.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:48:35.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:48:35.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:49:05.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:49:05.760 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:49:35.927 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:49:35.946 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:50:06.090 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:50:06.095 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:50:36.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:50:36.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:51:06.459 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:51:06.463 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:51:36.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:51:36.568 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:52:06.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:52:06.667 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:52:36.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:52:36.773 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:53:06.870 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:53:06.875 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:53:37.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:53:37.068 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:54:07.253 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:54:07.257 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:54:37.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:54:37.388 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:55:07.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:55:07.618 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:55:37.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:55:37.776 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:56:07.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:56:07.964 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:56:38.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:56:38.067 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:57:08.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:57:08.218 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:57:38.403 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:57:38.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:58:08.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:58:08.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:58:38.748 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:58:38.753 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:59:08.940 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:59:08.945 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:59:39.120 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T14:59:39.125 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:00:09.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:00:09.306 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:00:39.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:00:39.478 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:01:09.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:01:09.709 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:01:39.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:01:39.897 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:02:10.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:02:10.061 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:02:40.162 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:02:40.166 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:03:10.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:03:10.287 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:03:40.462 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:03:40.466 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:04:10.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:04:10.597 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:04:40.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:04:40.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:05:10.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:05:10.972 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:05:41.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:05:41.080 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:06:11.279 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:06:11.284 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:06:41.441 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:06:41.446 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:07:11.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:07:11.610 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:07:41.794 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:07:41.799 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:08:11.983 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:08:11.988 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:08:42.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:08:42.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:09:12.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:09:12.283 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:09:42.616 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:09:42.620 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:10:12.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:10:12.826 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:10:43.011 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:10:43.016 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:11:13.181 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:11:13.186 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:11:43.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:11:43.333 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:12:13.466 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:12:13.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:12:43.663 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:12:43.668 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:13:13.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:13:13.848 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:13:43.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:13:43.973 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:14:14.144 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:14:14.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:14:44.315 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:14:44.320 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:15:14.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:15:14.451 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:15:44.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:15:44.555 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:16:14.656 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:16:14.661 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:16:44.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:16:44.783 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:17:14.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:17:14.881 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:17:45.006 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:17:45.011 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:18:15.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:18:15.181 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:18:45.540 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:18:45.544 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:19:15.644 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:19:15.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:19:45.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:19:45.818 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:20:15.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:20:15.985 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:20:46.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:20:46.182 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:21:16.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:21:16.376 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:21:46.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:21:46.509 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:22:16.644 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:22:16.649 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:22:46.858 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:22:46.863 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:23:17.031 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:23:17.035 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:23:47.132 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:23:47.137 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:24:17.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:24:17.289 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:24:47.465 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:24:47.470 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:25:17.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:25:17.598 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:25:47.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:25:47.715 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:26:17.857 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:26:17.862 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:26:48.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:26:48.051 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:27:18.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:27:18.155 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:27:48.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:27:48.305 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:28:18.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:28:18.407 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:28:48.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:28:48.521 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:29:18.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:29:18.646 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:29:48.742 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:29:48.747 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:30:18.881 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:30:18.886 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:30:49.078 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:30:49.082 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:31:19.208 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:31:19.212 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:31:49.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:31:49.396 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:32:19.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:32:19.572 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:32:49.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:32:49.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:33:19.924 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:33:19.929 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:33:50.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:33:50.092 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:34:20.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:34:20.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:34:50.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:34:50.455 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:35:20.622 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:35:20.626 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:35:50.786 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:35:50.791 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:36:20.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:36:20.978 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:36:51.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:36:51.149 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:37:21.299 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:37:21.304 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:37:51.630 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:37:51.635 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:38:21.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:38:21.740 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:38:51.915 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:38:51.919 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:39:22.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:39:22.108 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:39:52.234 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:39:52.239 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:40:22.381 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:40:22.386 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:40:52.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:40:52.549 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:41:22.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:41:22.729 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:41:52.863 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:41:52.868 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:42:22.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:42:23.000 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:42:53.285 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:42:53.290 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:43:23.404 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:43:23.409 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:43:53.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:43:53.600 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:44:23.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:44:23.702 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:44:53.869 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:44:53.874 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:45:24.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:45:24.060 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:45:54.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:45:54.223 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:46:24.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:46:24.397 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:46:54.497 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:46:54.502 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:47:24.713 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:47:24.718 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:47:54.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:47:54.832 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:48:24.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:48:24.934 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:48:55.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:48:55.039 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:49:25.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:49:25.150 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:49:55.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:49:55.275 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:50:25.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:50:25.497 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:50:55.698 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:50:55.704 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:51:25.819 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:51:25.824 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:51:55.990 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:51:55.995 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:52:26.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:52:26.142 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:52:56.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:52:56.247 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:53:26.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:53:26.419 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:53:56.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:53:56.574 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:54:26.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:54:26.755 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:54:56.897 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:54:56.902 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:55:27.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:55:27.065 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:55:57.233 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:55:57.237 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:56:27.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:56:27.401 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:56:57.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:56:57.564 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:57:27.665 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:57:27.670 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:57:57.846 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:57:57.851 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:58:27.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:58:27.964 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:58:58.148 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:58:58.153 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:59:28.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:59:28.291 DEBUG:teuthology.orchestra.run.smithi154:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-10T15:59:52.792 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-10T15:59:52.793 DEBUG:teuthology.task.console_log:Killing console logger for smithi132 2023-05-10T15:59:52.794 DEBUG:teuthology.task.console_log:Killing console logger for smithi154 2023-05-10T15:59:52.794 DEBUG:teuthology.exit:Finished running handlers